2024-03-16T17:36:54.271 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-16T17:36:54.271 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602014 --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} --owner scheduled_leonidus@teuthology --name leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi -- /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602014/orig.config.yaml 2024-03-16T17:36:54.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T17:36:54.424 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602014 branch: wip-lusov-qdb-squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} email: null first_in_suite: false job_id: '7602014' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-qdb-squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-qdb-squid sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b owner: scheduled_leonidus@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6918 sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b sleep_before_teardown: 0 subset: 111/10000 suite: fs suite_branch: wip-lusov-qdb-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC5/r2ksxuD3gClYm5uU1JZqlr35fYDfLO4Cq/+oDXIQUeVhQ/X1frbmu9/kF/DytT05ZN/611EUVH49C732UBY= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMpENCmvgYxMAGoO/WoBcQUE2Llxts/BRS7cerwYOhsT2nDIzlH0vr+2p4Oy+vNUtX0p+/HoH2W3Hgl4X+rcXgc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-15_11:44:52 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-16T17:36:54.424 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/qa; will attempt to use it 2024-03-16T17:36:54.425 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/qa/tasks 2024-03-16T17:36:54.425 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-16T17:36:54.427 INFO:teuthology.task.internal:Checking packages... 2024-03-16T17:36:54.452 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b' 2024-03-16T17:36:54.452 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-16T17:36:54.453 INFO:teuthology.packaging:ref: None 2024-03-16T17:36:54.453 INFO:teuthology.packaging:tag: None 2024-03-16T17:36:54.453 INFO:teuthology.packaging:branch: wip-lusov-qdb-squid 2024-03-16T17:36:54.453 INFO:teuthology.packaging:sha1: aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T17:36:54.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-qdb-squid 2024-03-16T17:36:54.594 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1681.gaba3c1d2 2024-03-16T17:36:54.595 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-16T17:36:54.601 INFO:teuthology.task.internal:no buildpackages task found 2024-03-16T17:36:54.601 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-16T17:36:54.606 INFO:teuthology.task.internal:Saving configuration 2024-03-16T17:36:54.622 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-16T17:36:54.628 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-16T17:36:54.654 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602014', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 17:32:00.399316', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC5/r2ksxuD3gClYm5uU1JZqlr35fYDfLO4Cq/+oDXIQUeVhQ/X1frbmu9/kF/DytT05ZN/611EUVH49C732UBY='} 2024-03-16T17:36:54.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602014', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-16 17:32:00.397808', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMpENCmvgYxMAGoO/WoBcQUE2Llxts/BRS7cerwYOhsT2nDIzlH0vr+2p4Oy+vNUtX0p+/HoH2W3Hgl4X+rcXgc='} 2024-03-16T17:36:54.676 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-16T17:36:54.681 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-16T17:36:54.681 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-16T17:36:54.681 INFO:teuthology.run_tasks:Running task console_log... 2024-03-16T17:36:54.757 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f57478400d0>, signals=[15]) 2024-03-16T17:36:54.758 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-16T17:36:54.763 INFO:teuthology.task.internal:Opening connections... 2024-03-16T17:36:54.763 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-03-16T17:36:54.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T17:36:54.859 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-03-16T17:36:54.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T17:36:54.948 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-16T17:36:54.954 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-03-16T17:36:54.970 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-03-16T17:36:54.971 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-03-16T17:36:55.026 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T17:36:55.027 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T17:36:55.028 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-03-16T17:36:55.047 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-03-16T17:36:55.065 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-03-16T17:36:55.065 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-03-16T17:36:55.121 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-03-16T17:36:55.121 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-03-16T17:36:55.121 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-03-16T17:36:55.121 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-03-16T17:36:55.121 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-03-16T17:36:55.121 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-03-16T17:36:55.121 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T17:36:55.122 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-03-16T17:36:55.122 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-03-16T17:36:55.122 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T17:36:55.122 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-03-16T17:36:55.122 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T17:36:55.122 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T17:36:55.122 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T17:36:55.122 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-03-16T17:36:55.139 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-16T17:36:55.147 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-16T17:36:55.152 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-16T17:36:55.152 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-03-16T17:36:55.154 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-03-16T17:36:55.178 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-16T17:36:55.183 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-16T17:36:55.184 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-03-16T17:36:55.210 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-03-16T17:36:55.243 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-16T17:36:55.295 INFO:teuthology.run_tasks:Running task kernel... 2024-03-16T17:36:55.309 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-03-16T17:36:55.310 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-03-16T17:36:55.310 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-03-16T17:36:55.310 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-16T17:36:55.311 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-16T17:36:55.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T17:36:55.326 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-03-16T17:36:55.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T17:36:55.327 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-03-16T17:36:55.381 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-361.el9.x86_64 2024-03-16T17:36:55.382 INFO:teuthology.task.kernel:Running kernel on smithi132: 5.14.0-361.el9.x86_64 2024-03-16T17:36:55.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2024-03-16T17:36:55.383 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-361.el9.x86_64 2024-03-16T17:36:55.383 INFO:teuthology.task.kernel:Running kernel on smithi194: 5.14.0-361.el9.x86_64 2024-03-16T17:36:55.383 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2024-03-16T17:36:57.536 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-16T17:36:57.726 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - AppStream 9.4 MB/s | 6.7 MB 00:00 2024-03-16T17:36:59.112 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-03-16T17:36:59.294 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2024-03-16T17:37:00.148 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-16T17:37:00.169 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-03-16T17:37:02.144 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-03-16T17:37:02.153 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-03-16T17:37:06.413 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.1 MB 00:00 2024-03-16T17:37:06.421 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.1 MB 00:00 2024-03-16T17:37:07.729 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 15 kB 00:00 2024-03-16T17:37:08.036 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2024-03-16T17:37:08.472 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 33 MB/s | 21 MB 00:00 2024-03-16T17:37:09.804 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-16T17:37:13.514 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-03-16T17:37:14.712 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-03-16T17:37:15.746 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-16T17:37:15.746 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-16T17:37:15.843 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-03-16T17:37:15.849 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-03-16T17:37:15.849 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-03-16T17:37:15.849 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout:Install 4 Packages 2024-03-16T17:37:15.850 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:37:15.851 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 100 M 2024-03-16T17:37:15.851 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 123 M 2024-03-16T17:37:15.851 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-03-16T17:37:16.919 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-16T17:37:16.919 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-16T17:37:17.020 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-03-16T17:37:17.025 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-03-16T17:37:17.025 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-03-16T17:37:17.025 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-03-16T17:37:17.025 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-03-16T17:37:17.025 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-16T17:37:17.025 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-03-16T17:37:17.025 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-16T17:37:17.025 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-16T17:37:17.026 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-16T17:37:17.026 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:37:17.026 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-03-16T17:37:17.026 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-03-16T17:37:17.026 INFO:teuthology.orchestra.run.smithi194.stdout:Install 4 Packages 2024-03-16T17:37:17.026 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:37:17.027 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 100 M 2024-03-16T17:37:17.027 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 123 M 2024-03-16T17:37:17.027 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-03-16T17:37:20.213 INFO:teuthology.orchestra.run.smithi194.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 2.0 MB/s | 6.0 MB 00:02 2024-03-16T17:37:29.279 INFO:teuthology.orchestra.run.smithi194.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 1.7 MB/s | 21 MB 00:12 2024-03-16T17:37:29.972 INFO:teuthology.orchestra.run.smithi132.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 442 kB/s | 6.0 MB 00:13 2024-03-16T17:37:48.768 INFO:teuthology.orchestra.run.smithi194.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 1.2 MB/s | 39 MB 00:31 2024-03-16T17:37:50.426 INFO:teuthology.orchestra.run.smithi194.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 1.1 MB/s | 33 MB 00:30 2024-03-16T17:37:50.427 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-03-16T17:37:50.427 INFO:teuthology.orchestra.run.smithi194.stdout:Total 3.0 MB/s | 100 MB 00:33 2024-03-16T17:37:51.314 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-03-16T17:37:51.681 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-03-16T17:37:51.682 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-03-16T17:37:52.570 INFO:teuthology.orchestra.run.smithi132.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 585 kB/s | 21 MB 00:36 2024-03-16T17:37:53.364 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-03-16T17:37:53.364 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-03-16T17:37:56.280 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-03-16T17:37:56.956 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-16T17:37:57.084 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T17:37:58.861 INFO:teuthology.orchestra.run.smithi132.stdout:(3/4): kernel-modules-core-5.14.0-427.el9.x86_6 1.2 MB/s | 33 MB 00:28 2024-03-16T17:37:59.859 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T17:38:00.036 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T17:38:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T17:38:04.954 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:05.052 INFO:teuthology.orchestra.run.smithi132.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 822 kB/s | 39 MB 00:48 2024-03-16T17:38:05.052 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-03-16T17:38:05.052 INFO:teuthology.orchestra.run.smithi132.stdout:Total 2.0 MB/s | 100 MB 00:49 2024-03-16T17:38:05.939 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-03-16T17:38:06.303 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-03-16T17:38:06.303 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-03-16T17:38:07.654 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-03-16T17:38:07.654 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-03-16T17:38:09.703 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:10.354 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-03-16T17:38:11.010 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-16T17:38:11.153 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T17:38:13.911 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T17:38:14.109 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T17:38:18.863 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T17:38:19.085 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:23.829 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:38.828 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:38.828 INFO:teuthology.orchestra.run.smithi194.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-16T17:38:38.828 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:38:38.912 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-16T17:38:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T17:38:39.397 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T17:38:39.834 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:39.835 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:38:39.835 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-03-16T17:38:39.835 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-16T17:38:39.835 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-16T17:38:39.835 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-16T17:38:39.835 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-16T17:38:39.835 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:38:39.835 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-03-16T17:38:40.360 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-03-16T17:38:40.504 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-16T17:38:40.505 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-16T17:38:40.505 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-16T17:38:40.505 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-16T17:38:40.505 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-16T17:38:40.505 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-03-16T17:38:40.505 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2024-03-16T17:38:40.505 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-03-16T17:38:40.627 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-16T17:38:40.627 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-16T17:38:40.628 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2024-03-16T17:38:40.661 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2024-03-16T17:38:40.661 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2024-03-16T17:38:40.661 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.06 2024-03-16T17:38:40.661 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 68.el9 2024-03-16T17:38:40.661 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2024-03-16T17:38:40.661 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-16T17:38:40.661 INFO:teuthology.orchestra.run.smithi194.stdout:Group : Unspecified 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 8264254 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : builder@centos.org 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-16T17:38:40.662 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-16T17:38:40.663 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-16T17:38:40.663 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2024-03-16T17:38:40.663 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:38:40.663 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2024-03-16T17:38:40.664 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-16T17:38:40.664 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 5.14.0-427.el9.x86_64 2024-03-16T17:38:40.664 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-16T17:38:41.276 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-03-16T17:38:42.730 INFO:teuthology.orchestra.run.smithi194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-16T17:38:42.760 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-03-16T17:38:42.763 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-03-16T17:38:42.779 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.Lm0Mnvpa3U 2024-03-16T17:38:42.779 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Lm0Mnvpa3U 2024-03-16T17:38:42.848 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.Lm0Mnvpa3U 2024-03-16T17:38:42.991 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.Lm0Mnvpa3U is 6KB 2024-03-16T17:38:43.040 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.Lm0Mnvpa3U 2024-03-16T17:38:43.054 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2024-03-16T17:38:43.118 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-16T17:38:43.118 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-16T17:38:43.118 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-16T17:38:43.118 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-16T17:38:43.119 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-16T17:38:43.273 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-03-16T17:38:53.076 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:53.076 INFO:teuthology.orchestra.run.smithi132.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-16T17:38:53.076 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:38:53.160 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:53.569 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:53.569 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-16T17:38:53.569 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-16T17:38:53.569 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-16T17:38:53.968 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-16T17:38:53.968 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:38:53.968 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-03-16T17:38:53.968 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-16T17:38:53.968 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-16T17:38:53.968 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-16T17:38:53.968 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-16T17:38:53.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:38:53.969 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-03-16T17:38:54.489 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-03-16T17:38:54.624 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-16T17:38:54.625 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-16T17:38:54.625 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-16T17:38:54.625 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-16T17:38:54.625 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-16T17:38:54.625 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-03-16T17:38:54.625 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=None, version=distro) 2024-03-16T17:38:54.625 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-03-16T17:38:54.747 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-16T17:38:54.747 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-16T17:38:54.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -qi grub2-tools 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Name : grub2-tools 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Epoch : 1 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Version : 2.06 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Release : 68.el9 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: x86_64 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Group : Unspecified 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Size : 8264254 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:License : GPLv3+ 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-16T17:38:54.781 INFO:teuthology.orchestra.run.smithi132.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout:Packager : builder@centos.org 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout:Vendor : CentOS 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout:Summary : Support tools for GRUB. 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout:Description : 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout:hardware devices. 2024-03-16T17:38:54.782 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:38:54.783 INFO:teuthology.orchestra.run.smithi132.stdout:This subpackage provides tools for support of all platforms. 2024-03-16T17:38:54.783 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-16T17:38:54.783 INFO:teuthology.task.kernel:Updating grub on smithi132 to boot 5.14.0-427.el9.x86_64 2024-03-16T17:38:54.784 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-16T17:38:55.354 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2024-03-16T17:38:56.762 INFO:teuthology.orchestra.run.smithi132.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-16T17:38:56.811 INFO:teuthology.orchestra.run.smithi132.stderr:done 2024-03-16T17:38:56.814 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-03-16T17:38:56.829 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.2DXEQDdsOC 2024-03-16T17:38:56.829 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2DXEQDdsOC 2024-03-16T17:38:56.898 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.2DXEQDdsOC 2024-03-16T17:38:57.037 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.2DXEQDdsOC is 6KB 2024-03-16T17:38:57.057 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.2DXEQDdsOC 2024-03-16T17:38:57.071 DEBUG:teuthology.orchestra.run.smithi132:> sudo /bin/ls /boot/loader/entries || true 2024-03-16T17:38:57.135 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-16T17:38:57.136 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-16T17:38:57.136 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-16T17:38:57.136 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-16T17:38:57.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-16T17:38:57.308 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2024-03-16T17:39:13.290 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-16T17:39:13.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-16T17:39:13.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T17:39:27.325 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-16T17:39:27.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-16T17:39:27.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T17:40:13.339 DEBUG:teuthology.orchestra.remote:timed out 2024-03-16T17:40:22.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-16T17:40:22.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T17:40:22.758 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-03-16T17:40:23.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-16T17:40:23.166 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-427.el9.x86_64"... 2024-03-16T17:40:23.167 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-03-16T17:40:23.180 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-427.el9.x86_64 2024-03-16T17:40:23.181 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-16T17:40:23.181 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-16T17:40:23.181 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-16T17:40:24.182 DEBUG:teuthology.parallel:result is None 2024-03-16T17:40:27.328 DEBUG:teuthology.orchestra.remote:timed out 2024-03-16T17:40:36.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-16T17:40:36.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T17:40:36.727 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-03-16T17:40:37.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-16T17:40:37.153 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-427.el9.x86_64"... 2024-03-16T17:40:37.154 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-03-16T17:40:37.167 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-427.el9.x86_64 2024-03-16T17:40:37.167 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-16T17:40:37.167 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-16T17:40:37.168 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-16T17:40:38.169 DEBUG:teuthology.parallel:result is None 2024-03-16T17:40:38.169 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-16T17:40:38.177 INFO:teuthology.task.internal:Creating test directory... 2024-03-16T17:40:38.177 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-16T17:40:38.179 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-16T17:40:38.198 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-16T17:40:38.205 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-16T17:40:38.212 INFO:teuthology.task.internal:Creating archive directory... 2024-03-16T17:40:38.212 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-16T17:40:38.238 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-16T17:40:38.348 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-16T17:40:38.355 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-16T17:40:38.355 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-16T17:40:38.357 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-16T17:40:38.412 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T17:40:38.430 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T17:40:38.468 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T17:40:38.482 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-16T17:40:38.484 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-16T17:40:38.491 INFO:teuthology.task.internal:Configuring sudo... 2024-03-16T17:40:38.491 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-16T17:40:38.494 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-16T17:40:38.524 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-16T17:40:38.533 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-16T17:40:38.533 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-16T17:40:38.565 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-16T17:40:38.582 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T17:40:38.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T17:40:38.718 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T17:40:38.799 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T17:40:38.848 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:40:38.848 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-16T17:40:38.918 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T17:40:38.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-16T17:40:39.016 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T17:40:39.096 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-16T17:40:39.148 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:40:39.148 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-16T17:40:39.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-03-16T17:40:39.221 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-03-16T17:40:39.304 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T17:40:39.327 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-16T17:40:39.817 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-16T17:40:39.825 INFO:teuthology.task.internal:Starting timer... 2024-03-16T17:40:39.825 INFO:teuthology.run_tasks:Running task pcp... 2024-03-16T17:40:39.836 INFO:teuthology.run_tasks:Running task selinux... 2024-03-16T17:40:39.845 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2024-03-16T17:40:39.938 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2024-03-16T17:40:39.942 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-03-16T17:40:39.999 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-03-16T17:40:40.001 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-16T17:40:40.001 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2024-03-16T17:40:40.034 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2024-03-16T17:40:40.034 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-03-16T17:40:40.059 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-03-16T17:40:40.060 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi132.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-03-16T17:40:40.060 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-16T17:40:40.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T17:40:40.132 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-16T17:40:40.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T17:40:40.161 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-16T17:40:40.161 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2024-03-16T17:40:40.502 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-03-16T17:40:40.535 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-16T17:40:40.544 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-16T17:40:40.550 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-16T17:40:40.759 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-16T17:40:40.777 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-16T17:40:40.778 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi132.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-16T17:44:50.652 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi132.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-03-16T17:44:50.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-16T17:44:50.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T17:44:50.743 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-03-16T17:44:50.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-03-16T17:44:50.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-16T17:44:50.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T17:44:50.902 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-03-16T17:44:50.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-16T17:44:50.980 INFO:teuthology.run_tasks:Running task clock... 2024-03-16T17:44:50.991 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-16T17:44:50.992 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-16T17:44:50.992 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T17:44:50.994 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-16T17:44:50.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-16T17:44:51.023 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-16T17:44:51.039 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-16T17:44:51.051 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-16T17:44:51.067 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-16T17:44:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2024-03-16T17:44:51.081 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2024-03-16T17:44:51.096 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-03-16T17:44:51.098 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-16T17:44:51.110 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-03-16T17:44:51.114 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-16T17:44:51.126 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-16T17:44:51.143 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-16T17:44:51.168 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-03-16T17:44:51.171 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T17:44:51.171 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-03-16T17:44:51.171 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T17:44:51.171 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T17:44:51.171 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T17:44:51.171 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T17:44:51.196 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-03-16T17:44:51.200 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-16T17:44:51.200 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-03-16T17:44:51.200 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T17:44:51.200 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T17:44:51.200 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T17:44:51.200 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-16T17:44:51.201 INFO:teuthology.run_tasks:Running task install... 2024-03-16T17:44:51.208 DEBUG:teuthology.task.install:project ceph 2024-03-16T17:44:51.209 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b'}} 2024-03-16T17:44:51.209 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b'} 2024-03-16T17:44:51.209 INFO:teuthology.task.install:Using flavor: default 2024-03-16T17:44:51.214 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-16T17:44:51.214 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-16T17:44:51.214 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', 'tag': None, 'wait_for_package': False} 2024-03-16T17:44:51.215 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T17:44:51.216 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', 'tag': None, 'wait_for_package': False} 2024-03-16T17:44:51.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T17:44:51.354 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/ 2024-03-16T17:44:51.355 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1681.gaba3c1d2 2024-03-16T17:44:51.360 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/ 2024-03-16T17:44:51.360 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1681.gaba3c1d2 2024-03-16T17:44:51.477 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-16T17:44:51.477 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:44:51.477 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-16T17:44:51.505 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-16T17:44:51.505 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-16T17:44:51.573 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-16T17:44:51.592 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb-squid/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-16T17:44:51.593 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:44:51.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-16T17:44:51.620 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-16T17:44:51.620 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-16T17:44:51.653 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-16T17:44:51.689 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-16T17:44:51.720 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-03-16T17:44:51.721 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-03-16T17:44:51.769 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-16T17:44:51.835 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2024-03-16T17:44:51.836 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2024-03-16T17:44:51.968 INFO:teuthology.orchestra.run.smithi194.stdout:74 files removed 2024-03-16T17:44:51.995 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-16T17:44:52.086 INFO:teuthology.orchestra.run.smithi132.stdout:74 files removed 2024-03-16T17:44:52.115 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-16T17:44:52.693 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 217 kB/s | 83 kB 00:00 2024-03-16T17:44:52.855 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 197 kB/s | 83 kB 00:00 2024-03-16T17:44:53.127 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 26 kB/s | 10 kB 00:00 2024-03-16T17:44:53.281 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 27 kB/s | 10 kB 00:00 2024-03-16T17:44:53.499 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-03-16T17:44:53.690 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-03-16T17:44:53.955 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-16T17:44:54.259 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-16T17:44:55.381 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.0 MB 00:00 2024-03-16T17:44:56.093 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 2.8 MB/s | 2.0 MB 00:00 2024-03-16T17:44:56.841 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 8.0 MB 00:01 2024-03-16T17:44:57.150 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-03-16T17:44:59.126 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-03-16T17:45:00.006 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 19 MB 00:02 2024-03-16T17:45:11.126 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 737 kB/s | 6.1 MB 00:08 2024-03-16T17:45:11.814 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 762 kB/s | 6.1 MB 00:08 2024-03-16T17:45:12.894 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 15 kB 00:00 2024-03-16T17:45:13.987 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:00 2024-03-16T17:45:14.339 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 15 kB 00:01 2024-03-16T17:45:15.768 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-03-16T17:45:18.945 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-16T17:45:20.674 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-16T17:45:21.456 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T17:45:21.457 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T17:45:21.469 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-16T17:45:21.470 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-16T17:45:21.471 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-16T17:45:21.472 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-16T17:45:21.473 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-16T17:45:21.476 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-16T17:45:21.477 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-16T17:45:21.555 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-03-16T17:45:21.586 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2024-03-16T17:45:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-03-16T17:45:21.586 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2024-03-16T17:45:21.586 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-03-16T17:45:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-16T17:45:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 6.6 k 2024-03-16T17:45:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 5.3 M 2024-03-16T17:45:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 887 k 2024-03-16T17:45:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 145 k 2024-03-16T17:45:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 1.5 M 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 138 k 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 1.8 M 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 7.4 M 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 49 k 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 9.8 M 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 47 M 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 264 k 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 748 k 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 218 k 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 27 k 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 18 k 2024-03-16T17:45:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 31 k 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 744 k 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 127 k 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 161 k 2024-03-16T17:45:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 321 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 298 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 99 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 85 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.1 M 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 171 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-16T17:45:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.4 M 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.1 M 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-16T17:45:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 20 M 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 31 k 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 2.3 M 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 248 k 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 4.7 M 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 17 M 2024-03-16T17:45:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 15 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 25 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 163 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-16T17:45:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 498 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 5.1 M 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-16T17:45:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 45 k 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 131 k 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-16T17:45:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-16T17:45:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-16T17:45:21.596 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-16T17:45:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-16T17:45:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================================ 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout:Install 150 Packages 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 24 Packages 2024-03-16T17:45:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:45:21.600 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 224 M 2024-03-16T17:45:21.600 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-03-16T17:45:22.738 INFO:teuthology.orchestra.run.smithi132.stdout:(1/174): ceph-19.0.0-1681.gaba3c1d2.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-03-16T17:45:23.096 INFO:teuthology.orchestra.run.smithi132.stdout:(2/174): ceph-fuse-19.0.0-1681.gaba3c1d2.el9.x8 2.4 MB/s | 887 kB 00:00 2024-03-16T17:45:23.164 INFO:teuthology.orchestra.run.smithi132.stdout:(3/174): ceph-base-19.0.0-1681.gaba3c1d2.el9.x8 9.1 MB/s | 5.3 MB 00:00 2024-03-16T17:45:23.189 INFO:teuthology.orchestra.run.smithi132.stdout:(4/174): ceph-immutable-object-cache-19.0.0-168 1.5 MB/s | 145 kB 00:00 2024-03-16T17:45:23.196 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T17:45:23.197 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-16T17:45:23.211 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-16T17:45:23.212 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-16T17:45:23.213 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-16T17:45:23.214 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-16T17:45:23.216 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-16T17:45:23.219 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-16T17:45:23.220 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-16T17:45:23.298 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-03-16T17:45:23.314 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================ 2024-03-16T17:45:23.314 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================ 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 6.6 k 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 5.3 M 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 887 k 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 145 k 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 1.5 M 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 138 k 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 1.8 M 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 7.4 M 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 49 k 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 9.8 M 2024-03-16T17:45:23.315 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 47 M 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 264 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 748 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 218 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 27 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 18 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 31 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 744 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 127 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-16T17:45:23.316 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 161 k 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 321 k 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 298 k 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 99 k 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 85 k 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.1 M 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 171 k 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-16T17:45:23.317 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.4 M 2024-03-16T17:45:23.318 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 3.1 M 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-16T17:45:23.319 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 20 M 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 31 k 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 2.3 M 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 248 k 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 4.7 M 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 17 M 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1681.gaba3c1d2.el9 ceph-noarch 15 k 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 25 k 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-16T17:45:23.320 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 163 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 498 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 5.1 M 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-16T17:45:23.321 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-16T17:45:23.322 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 45 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:19.0.0-1681.gaba3c1d2.el9 ceph 131 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-16T17:45:23.323 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-16T17:45:23.324 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-16T17:45:23.325 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-16T17:45:23.326 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================ 2024-03-16T17:45:23.327 INFO:teuthology.orchestra.run.smithi194.stdout:Install 150 Packages 2024-03-16T17:45:23.328 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 24 Packages 2024-03-16T17:45:23.328 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:45:23.328 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 224 M 2024-03-16T17:45:23.328 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-03-16T17:45:23.331 INFO:teuthology.orchestra.run.smithi132.stdout:(5/174): ceph-mds-19.0.0-1681.gaba3c1d2.el9.x86 14 MB/s | 2.3 MB 00:00 2024-03-16T17:45:23.597 INFO:teuthology.orchestra.run.smithi132.stdout:(6/174): ceph-mgr-19.0.0-1681.gaba3c1d2.el9.x86 3.6 MB/s | 1.5 MB 00:00 2024-03-16T17:45:23.673 INFO:teuthology.orchestra.run.smithi132.stdout:(7/174): ceph-mon-19.0.0-1681.gaba3c1d2.el9.x86 14 MB/s | 4.7 MB 00:00 2024-03-16T17:45:24.450 INFO:teuthology.orchestra.run.smithi194.stdout:(1/174): ceph-19.0.0-1681.gaba3c1d2.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-03-16T17:45:24.581 INFO:teuthology.orchestra.run.smithi132.stdout:(8/174): ceph-radosgw-19.0.0-1681.gaba3c1d2.el9 11 MB/s | 9.8 MB 00:00 2024-03-16T17:45:24.657 INFO:teuthology.orchestra.run.smithi132.stdout:(9/174): ceph-selinux-19.0.0-1681.gaba3c1d2.el9 335 kB/s | 25 kB 00:00 2024-03-16T17:45:24.725 INFO:teuthology.orchestra.run.smithi194.stdout:(2/174): ceph-fuse-19.0.0-1681.gaba3c1d2.el9.x8 3.2 MB/s | 887 kB 00:00 2024-03-16T17:45:24.825 INFO:teuthology.orchestra.run.smithi194.stdout:(3/174): ceph-immutable-object-cache-19.0.0-168 1.4 MB/s | 145 kB 00:00 2024-03-16T17:45:25.401 INFO:teuthology.orchestra.run.smithi194.stdout:(4/174): ceph-mds-19.0.0-1681.gaba3c1d2.el9.x86 4.0 MB/s | 2.3 MB 00:00 2024-03-16T17:45:25.490 INFO:teuthology.orchestra.run.smithi132.stdout:(10/174): ceph-osd-19.0.0-1681.gaba3c1d2.el9.x8 8.9 MB/s | 17 MB 00:01 2024-03-16T17:45:25.574 INFO:teuthology.orchestra.run.smithi132.stdout:(11/174): cephfs-mirror-19.0.0-1681.gaba3c1d2.e 2.6 MB/s | 218 kB 00:00 2024-03-16T17:45:25.601 INFO:teuthology.orchestra.run.smithi194.stdout:(5/174): ceph-mgr-19.0.0-1681.gaba3c1d2.el9.x86 7.5 MB/s | 1.5 MB 00:00 2024-03-16T17:45:25.632 INFO:teuthology.orchestra.run.smithi132.stdout:(12/174): cephfs-shell-19.0.0-1681.gaba3c1d2.el 464 kB/s | 27 kB 00:00 2024-03-16T17:45:25.707 INFO:teuthology.orchestra.run.smithi132.stdout:(13/174): libcephfs-devel-19.0.0-1681.gaba3c1d2 417 kB/s | 31 kB 00:00 2024-03-16T17:45:25.866 INFO:teuthology.orchestra.run.smithi132.stdout:(14/174): libcephfs2-19.0.0-1681.gaba3c1d2.el9. 4.6 MB/s | 744 kB 00:00 2024-03-16T17:45:25.950 INFO:teuthology.orchestra.run.smithi132.stdout:(15/174): libcephsqlite-19.0.0-1681.gaba3c1d2.e 1.9 MB/s | 163 kB 00:00 2024-03-16T17:45:26.025 INFO:teuthology.orchestra.run.smithi132.stdout:(16/174): librados-devel-19.0.0-1681.gaba3c1d2. 1.6 MB/s | 127 kB 00:00 2024-03-16T17:45:26.125 INFO:teuthology.orchestra.run.smithi132.stdout:(17/174): libradosstriper1-19.0.0-1681.gaba3c1d 4.9 MB/s | 498 kB 00:00 2024-03-16T17:45:26.359 INFO:teuthology.orchestra.run.smithi194.stdout:(6/174): ceph-mon-19.0.0-1681.gaba3c1d2.el9.x86 6.2 MB/s | 4.7 MB 00:00 2024-03-16T17:45:26.592 INFO:teuthology.orchestra.run.smithi132.stdout:(18/174): ceph-common-19.0.0-1681.gaba3c1d2.el9 5.1 MB/s | 20 MB 00:04 2024-03-16T17:45:26.618 INFO:teuthology.orchestra.run.smithi194.stdout:(7/174): ceph-base-19.0.0-1681.gaba3c1d2.el9.x8 2.2 MB/s | 5.3 MB 00:02 2024-03-16T17:45:26.667 INFO:teuthology.orchestra.run.smithi132.stdout:(19/174): python3-ceph-argparse-19.0.0-1681.gab 604 kB/s | 45 kB 00:00 2024-03-16T17:45:26.743 INFO:teuthology.orchestra.run.smithi132.stdout:(20/174): librgw2-19.0.0-1681.gaba3c1d2.el9.x86 8.3 MB/s | 5.1 MB 00:00 2024-03-16T17:45:26.768 INFO:teuthology.orchestra.run.smithi132.stdout:(21/174): python3-ceph-common-19.0.0-1681.gaba3 1.3 MB/s | 131 kB 00:00 2024-03-16T17:45:26.818 INFO:teuthology.orchestra.run.smithi132.stdout:(22/174): python3-cephfs-19.0.0-1681.gaba3c1d2. 2.1 MB/s | 161 kB 00:00 2024-03-16T17:45:26.910 INFO:teuthology.orchestra.run.smithi132.stdout:(23/174): python3-rbd-19.0.0-1681.gaba3c1d2.el9 3.2 MB/s | 298 kB 00:00 2024-03-16T17:45:26.935 INFO:teuthology.orchestra.run.smithi132.stdout:(24/174): python3-rados-19.0.0-1681.gaba3c1d2.e 1.9 MB/s | 321 kB 00:00 2024-03-16T17:45:26.986 INFO:teuthology.orchestra.run.smithi132.stdout:(25/174): python3-rgw-19.0.0-1681.gaba3c1d2.el9 1.3 MB/s | 99 kB 00:00 2024-03-16T17:45:27.003 INFO:teuthology.orchestra.run.smithi132.stdout:(26/174): rbd-fuse-19.0.0-1681.gaba3c1d2.el9.x8 1.2 MB/s | 85 kB 00:00 2024-03-16T17:45:27.104 INFO:teuthology.orchestra.run.smithi132.stdout:(27/174): rbd-nbd-19.0.0-1681.gaba3c1d2.el9.x86 1.7 MB/s | 171 kB 00:00 2024-03-16T17:45:27.203 INFO:teuthology.orchestra.run.smithi132.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1681.g 314 kB/s | 31 kB 00:00 2024-03-16T17:45:27.304 INFO:teuthology.orchestra.run.smithi132.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1681.gaba3c1d 1.3 MB/s | 138 kB 00:00 2024-03-16T17:45:27.387 INFO:teuthology.orchestra.run.smithi132.stdout:(30/174): rbd-mirror-19.0.0-1681.gaba3c1d2.el9. 7.7 MB/s | 3.1 MB 00:00 2024-03-16T17:45:27.855 INFO:teuthology.orchestra.run.smithi132.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1681.gaba3c 3.2 MB/s | 1.8 MB 00:00 2024-03-16T17:45:27.955 INFO:teuthology.orchestra.run.smithi132.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1681.gab 2.4 MB/s | 248 kB 00:00 2024-03-16T17:45:28.047 INFO:teuthology.orchestra.run.smithi132.stdout:(33/174): ceph-mgr-rook-19.0.0-1681.gaba3c1d2.e 538 kB/s | 49 kB 00:00 2024-03-16T17:45:28.139 INFO:teuthology.orchestra.run.smithi132.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1681.ga 167 kB/s | 15 kB 00:00 2024-03-16T17:45:28.231 INFO:teuthology.orchestra.run.smithi132.stdout:(35/174): ceph-mgr-diskprediction-local-19.0.0- 8.8 MB/s | 7.4 MB 00:00 2024-03-16T17:45:28.256 INFO:teuthology.orchestra.run.smithi132.stdout:(36/174): ceph-volume-19.0.0-1681.gaba3c1d2.el9 2.2 MB/s | 264 kB 00:00 2024-03-16T17:45:28.323 INFO:teuthology.orchestra.run.smithi132.stdout:(37/174): cephadm-19.0.0-1681.gaba3c1d2.el9.noa 8.0 MB/s | 748 kB 00:00 2024-03-16T17:45:28.348 INFO:teuthology.orchestra.run.smithi132.stdout:(38/174): cephfs-top-19.0.0-1681.gaba3c1d2.el9. 198 kB/s | 18 kB 00:00 2024-03-16T17:45:28.507 INFO:teuthology.orchestra.run.smithi132.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 662 kB 00:00 2024-03-16T17:45:28.548 INFO:teuthology.orchestra.run.smithi132.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 4.5 MB/s | 920 kB 00:00 2024-03-16T17:45:28.574 INFO:teuthology.orchestra.run.smithi132.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-03-16T17:45:28.599 INFO:teuthology.orchestra.run.smithi132.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-03-16T17:45:28.625 INFO:teuthology.orchestra.run.smithi132.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 636 kB/s | 32 kB 00:00 2024-03-16T17:45:28.717 INFO:teuthology.orchestra.run.smithi132.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-03-16T17:45:28.742 INFO:teuthology.orchestra.run.smithi132.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 148 kB/s | 17 kB 00:00 2024-03-16T17:45:28.767 INFO:teuthology.orchestra.run.smithi132.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-03-16T17:45:28.784 INFO:teuthology.orchestra.run.smithi132.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-03-16T17:45:28.802 INFO:teuthology.orchestra.run.smithi132.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-16T17:45:28.826 INFO:teuthology.orchestra.run.smithi132.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 661 kB 00:00 2024-03-16T17:45:28.860 INFO:teuthology.orchestra.run.smithi132.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2024-03-16T17:45:28.877 INFO:teuthology.orchestra.run.smithi132.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 46 kB 00:00 2024-03-16T17:45:28.902 INFO:teuthology.orchestra.run.smithi132.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-03-16T17:45:28.927 INFO:teuthology.orchestra.run.smithi132.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-16T17:45:28.952 INFO:teuthology.orchestra.run.smithi132.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-16T17:45:28.995 INFO:teuthology.orchestra.run.smithi132.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 511 kB/s | 34 kB 00:00 2024-03-16T17:45:29.051 INFO:teuthology.orchestra.run.smithi194.stdout:(8/174): ceph-osd-19.0.0-1681.gaba3c1d2.el9.x86 6.2 MB/s | 17 MB 00:02 2024-03-16T17:45:29.093 INFO:teuthology.orchestra.run.smithi194.stdout:(9/174): ceph-selinux-19.0.0-1681.gaba3c1d2.el9 607 kB/s | 25 kB 00:00 2024-03-16T17:45:29.103 INFO:teuthology.orchestra.run.smithi132.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 31 MB/s | 4.7 MB 00:00 2024-03-16T17:45:29.137 INFO:teuthology.orchestra.run.smithi132.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2024-03-16T17:45:29.162 INFO:teuthology.orchestra.run.smithi132.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2024-03-16T17:45:29.196 INFO:teuthology.orchestra.run.smithi132.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-03-16T17:45:29.338 INFO:teuthology.orchestra.run.smithi132.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 33 MB/s | 5.7 MB 00:00 2024-03-16T17:45:29.372 INFO:teuthology.orchestra.run.smithi132.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-03-16T17:45:29.397 INFO:teuthology.orchestra.run.smithi132.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-16T17:45:29.576 INFO:teuthology.orchestra.run.smithi194.stdout:(10/174): ceph-radosgw-19.0.0-1681.gaba3c1d2.el 3.3 MB/s | 9.8 MB 00:02 2024-03-16T17:45:29.655 INFO:teuthology.orchestra.run.smithi132.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-03-16T17:45:29.677 INFO:teuthology.orchestra.run.smithi194.stdout:(11/174): cephfs-mirror-19.0.0-1681.gaba3c1d2.e 2.1 MB/s | 218 kB 00:00 2024-03-16T17:45:29.697 INFO:teuthology.orchestra.run.smithi132.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 81 kB/s | 24 kB 00:00 2024-03-16T17:45:29.731 INFO:teuthology.orchestra.run.smithi132.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 241 kB/s | 18 kB 00:00 2024-03-16T17:45:29.735 INFO:teuthology.orchestra.run.smithi194.stdout:(12/174): cephfs-shell-19.0.0-1681.gaba3c1d2.el 466 kB/s | 27 kB 00:00 2024-03-16T17:45:29.756 INFO:teuthology.orchestra.run.smithi132.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-03-16T17:45:29.790 INFO:teuthology.orchestra.run.smithi132.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 542 kB/s | 32 kB 00:00 2024-03-16T17:45:29.794 INFO:teuthology.orchestra.run.smithi194.stdout:(13/174): libcephfs-devel-19.0.0-1681.gaba3c1d2 535 kB/s | 31 kB 00:00 2024-03-16T17:45:30.007 INFO:teuthology.orchestra.run.smithi132.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2024-03-16T17:45:30.019 INFO:teuthology.orchestra.run.smithi194.stdout:(14/174): libcephfs2-19.0.0-1681.gaba3c1d2.el9. 3.2 MB/s | 744 kB 00:00 2024-03-16T17:45:30.056 INFO:teuthology.orchestra.run.smithi132.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 817 kB/s | 217 kB 00:00 2024-03-16T17:45:30.078 INFO:teuthology.orchestra.run.smithi194.stdout:(15/174): libcephsqlite-19.0.0-1681.gaba3c1d2.e 2.7 MB/s | 163 kB 00:00 2024-03-16T17:45:30.082 INFO:teuthology.orchestra.run.smithi132.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.3 MB/s | 174 kB 00:00 2024-03-16T17:45:30.107 INFO:teuthology.orchestra.run.smithi132.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-16T17:45:30.133 INFO:teuthology.orchestra.run.smithi132.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 820 kB/s | 41 kB 00:00 2024-03-16T17:45:30.136 INFO:teuthology.orchestra.run.smithi194.stdout:(16/174): librados-devel-19.0.0-1681.gaba3c1d2. 2.1 MB/s | 127 kB 00:00 2024-03-16T17:45:30.167 INFO:teuthology.orchestra.run.smithi132.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-03-16T17:45:30.200 INFO:teuthology.orchestra.run.smithi132.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-03-16T17:45:30.345 INFO:teuthology.orchestra.run.smithi194.stdout:(17/174): ceph-common-19.0.0-1681.gaba3c1d2.el9 3.3 MB/s | 20 MB 00:06 2024-03-16T17:45:30.378 INFO:teuthology.orchestra.run.smithi194.stdout:(18/174): libradosstriper1-19.0.0-1681.gaba3c1d 2.0 MB/s | 498 kB 00:00 2024-03-16T17:45:30.437 INFO:teuthology.orchestra.run.smithi194.stdout:(19/174): python3-ceph-argparse-19.0.0-1681.gab 775 kB/s | 45 kB 00:00 2024-03-16T17:45:30.496 INFO:teuthology.orchestra.run.smithi194.stdout:(20/174): python3-ceph-common-19.0.0-1681.gaba3 2.2 MB/s | 131 kB 00:00 2024-03-16T17:45:30.554 INFO:teuthology.orchestra.run.smithi194.stdout:(21/174): python3-cephfs-19.0.0-1681.gaba3c1d2. 2.7 MB/s | 161 kB 00:00 2024-03-16T17:45:30.642 INFO:teuthology.orchestra.run.smithi132.stdout:(75/174): ceph-test-19.0.0-1681.gaba3c1d2.el9.x 7.9 MB/s | 47 MB 00:05 2024-03-16T17:45:30.646 INFO:teuthology.orchestra.run.smithi194.stdout:(22/174): python3-rados-19.0.0-1681.gaba3c1d2.e 3.4 MB/s | 321 kB 00:00 2024-03-16T17:45:30.667 INFO:teuthology.orchestra.run.smithi132.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 421 kB/s | 211 kB 00:00 2024-03-16T17:45:30.692 INFO:teuthology.orchestra.run.smithi132.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 96 kB/s | 47 kB 00:00 2024-03-16T17:45:30.718 INFO:teuthology.orchestra.run.smithi132.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 575 kB/s | 43 kB 00:00 2024-03-16T17:45:30.738 INFO:teuthology.orchestra.run.smithi194.stdout:(23/174): python3-rbd-19.0.0-1681.gaba3c1d2.el9 3.2 MB/s | 298 kB 00:00 2024-03-16T17:45:30.743 INFO:teuthology.orchestra.run.smithi132.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 775 kB/s | 39 kB 00:00 2024-03-16T17:45:30.797 INFO:teuthology.orchestra.run.smithi194.stdout:(24/174): python3-rgw-19.0.0-1681.gaba3c1d2.el9 1.7 MB/s | 99 kB 00:00 2024-03-16T17:45:30.856 INFO:teuthology.orchestra.run.smithi194.stdout:(25/174): rbd-fuse-19.0.0-1681.gaba3c1d2.el9.x8 1.4 MB/s | 85 kB 00:00 2024-03-16T17:45:30.893 INFO:teuthology.orchestra.run.smithi132.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 234 kB/s | 41 kB 00:00 2024-03-16T17:45:30.969 INFO:teuthology.orchestra.run.smithi132.stdout:(81/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 300 kB 00:00 2024-03-16T17:45:31.123 INFO:teuthology.orchestra.run.smithi194.stdout:(26/174): librgw2-19.0.0-1681.gaba3c1d2.el9.x86 6.6 MB/s | 5.1 MB 00:00 2024-03-16T17:45:31.135 INFO:teuthology.orchestra.run.smithi132.stdout:(82/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-03-16T17:45:31.160 INFO:teuthology.orchestra.run.smithi132.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 214 kB/s | 56 kB 00:00 2024-03-16T17:45:31.181 INFO:teuthology.orchestra.run.smithi194.stdout:(27/174): rbd-nbd-19.0.0-1681.gaba3c1d2.el9.x86 2.9 MB/s | 171 kB 00:00 2024-03-16T17:45:31.186 INFO:teuthology.orchestra.run.smithi132.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 292 kB/s | 63 kB 00:00 2024-03-16T17:45:31.212 INFO:teuthology.orchestra.run.smithi132.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 876 kB/s | 44 kB 00:00 2024-03-16T17:45:31.237 INFO:teuthology.orchestra.run.smithi132.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-16T17:45:31.240 INFO:teuthology.orchestra.run.smithi194.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1681.g 540 kB/s | 31 kB 00:00 2024-03-16T17:45:31.262 INFO:teuthology.orchestra.run.smithi132.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-16T17:45:31.295 INFO:teuthology.orchestra.run.smithi132.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-03-16T17:45:31.298 INFO:teuthology.orchestra.run.smithi194.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1681.gaba3c1d 2.3 MB/s | 138 kB 00:00 2024-03-16T17:45:31.321 INFO:teuthology.orchestra.run.smithi132.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-16T17:45:31.346 INFO:teuthology.orchestra.run.smithi132.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-03-16T17:45:31.371 INFO:teuthology.orchestra.run.smithi132.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-03-16T17:45:31.415 INFO:teuthology.orchestra.run.smithi194.stdout:(30/174): rbd-mirror-19.0.0-1681.gaba3c1d2.el9. 5.5 MB/s | 3.1 MB 00:00 2024-03-16T17:45:31.591 INFO:teuthology.orchestra.run.smithi194.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1681.gaba3c 6.1 MB/s | 1.8 MB 00:00 2024-03-16T17:45:31.682 INFO:teuthology.orchestra.run.smithi194.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1681.gab 2.7 MB/s | 248 kB 00:00 2024-03-16T17:45:31.741 INFO:teuthology.orchestra.run.smithi194.stdout:(33/174): ceph-mgr-rook-19.0.0-1681.gaba3c1d2.e 844 kB/s | 49 kB 00:00 2024-03-16T17:45:31.800 INFO:teuthology.orchestra.run.smithi194.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1681.ga 264 kB/s | 15 kB 00:00 2024-03-16T17:45:31.855 INFO:teuthology.orchestra.run.smithi132.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 351 kB/s | 187 kB 00:00 2024-03-16T17:45:31.883 INFO:teuthology.orchestra.run.smithi194.stdout:(35/174): ceph-volume-19.0.0-1681.gaba3c1d2.el9 3.1 MB/s | 264 kB 00:00 2024-03-16T17:45:32.030 INFO:teuthology.orchestra.run.smithi132.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 297 kB/s | 195 kB 00:00 2024-03-16T17:45:32.033 INFO:teuthology.orchestra.run.smithi194.stdout:(36/174): cephadm-19.0.0-1681.gaba3c1d2.el9.noa 4.9 MB/s | 748 kB 00:00 2024-03-16T17:45:32.092 INFO:teuthology.orchestra.run.smithi194.stdout:(37/174): cephfs-top-19.0.0-1681.gaba3c1d2.el9. 313 kB/s | 18 kB 00:00 2024-03-16T17:45:32.205 INFO:teuthology.orchestra.run.smithi132.stdout:(94/174): elfutils-libelf-devel-0.190-2.el9.x86 123 kB/s | 21 kB 00:00 2024-03-16T17:45:32.234 INFO:teuthology.orchestra.run.smithi194.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-03-16T17:45:32.272 INFO:teuthology.orchestra.run.smithi132.stdout:(95/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 382 kB/s | 25 kB 00:00 2024-03-16T17:45:32.284 INFO:teuthology.orchestra.run.smithi194.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2024-03-16T17:45:32.318 INFO:teuthology.orchestra.run.smithi194.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-03-16T17:45:32.347 INFO:teuthology.orchestra.run.smithi132.stdout:(96/174): python3-requests-2.25.1-8.el9.noarch. 254 kB/s | 125 kB 00:00 2024-03-16T17:45:32.360 INFO:teuthology.orchestra.run.smithi194.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-03-16T17:45:32.393 INFO:teuthology.orchestra.run.smithi194.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 952 kB/s | 32 kB 00:00 2024-03-16T17:45:32.569 INFO:teuthology.orchestra.run.smithi194.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-03-16T17:45:32.573 INFO:teuthology.orchestra.run.smithi132.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-03-16T17:45:32.631 INFO:teuthology.orchestra.run.smithi132.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-03-16T17:45:32.661 INFO:teuthology.orchestra.run.smithi194.stdout:(44/174): ceph-mgr-diskprediction-local-19.0.0- 6.0 MB/s | 7.4 MB 00:01 2024-03-16T17:45:32.686 INFO:teuthology.orchestra.run.smithi194.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 147 kB/s | 17 kB 00:00 2024-03-16T17:45:32.690 INFO:teuthology.orchestra.run.smithi132.stdout:(99/174): qatlib-23.11.0-1.el9.x86_64.rpm 3.6 MB/s | 216 kB 00:00 2024-03-16T17:45:32.711 INFO:teuthology.orchestra.run.smithi194.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 202 kB/s | 10 kB 00:00 2024-03-16T17:45:32.736 INFO:teuthology.orchestra.run.smithi194.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-16T17:45:32.762 INFO:teuthology.orchestra.run.smithi194.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 885 kB/s | 44 kB 00:00 2024-03-16T17:45:32.795 INFO:teuthology.orchestra.run.smithi194.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-16T17:45:32.820 INFO:teuthology.orchestra.run.smithi194.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2024-03-16T17:45:32.846 INFO:teuthology.orchestra.run.smithi194.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 46 kB 00:00 2024-03-16T17:45:32.871 INFO:teuthology.orchestra.run.smithi194.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-16T17:45:32.897 INFO:teuthology.orchestra.run.smithi194.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-16T17:45:32.915 INFO:teuthology.orchestra.run.smithi132.stdout:(100/174): qatlib-service-23.11.0-1.el9.x86_64. 155 kB/s | 35 kB 00:00 2024-03-16T17:45:32.922 INFO:teuthology.orchestra.run.smithi194.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-03-16T17:45:32.947 INFO:teuthology.orchestra.run.smithi194.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 688 kB/s | 34 kB 00:00 2024-03-16T17:45:32.974 INFO:teuthology.orchestra.run.smithi132.stdout:(101/174): openssl-devel-3.0.7-27.el9.x86_64.rp 5.9 MB/s | 4.1 MB 00:00 2024-03-16T17:45:32.999 INFO:teuthology.orchestra.run.smithi132.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 533 kB/s | 44 kB 00:00 2024-03-16T17:45:33.024 INFO:teuthology.orchestra.run.smithi132.stdout:(103/174): libgfortran-11.4.1-3.el9.x86_64.rpm 479 kB/s | 803 kB 00:01 2024-03-16T17:45:33.048 INFO:teuthology.orchestra.run.smithi194.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-03-16T17:45:33.049 INFO:teuthology.orchestra.run.smithi132.stdout:(104/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-03-16T17:45:33.089 INFO:teuthology.orchestra.run.smithi194.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2024-03-16T17:45:33.108 INFO:teuthology.orchestra.run.smithi132.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-03-16T17:45:33.123 INFO:teuthology.orchestra.run.smithi194.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-03-16T17:45:33.148 INFO:teuthology.orchestra.run.smithi194.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-03-16T17:45:33.250 INFO:teuthology.orchestra.run.smithi132.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.7 MB/s | 548 kB 00:00 2024-03-16T17:45:33.292 INFO:teuthology.orchestra.run.smithi132.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 468 kB/s | 19 kB 00:00 2024-03-16T17:45:33.317 INFO:teuthology.orchestra.run.smithi132.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-03-16T17:45:33.359 INFO:teuthology.orchestra.run.smithi132.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-03-16T17:45:33.401 INFO:teuthology.orchestra.run.smithi132.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-03-16T17:45:33.435 INFO:teuthology.orchestra.run.smithi132.stdout:(111/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-03-16T17:45:33.460 INFO:teuthology.orchestra.run.smithi132.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-03-16T17:45:33.582 INFO:teuthology.orchestra.run.smithi194.stdout:(60/174): ceph-test-19.0.0-1681.gaba3c1d2.el9.x 11 MB/s | 47 MB 00:04 2024-03-16T17:45:33.585 INFO:teuthology.orchestra.run.smithi132.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-03-16T17:45:33.652 INFO:teuthology.orchestra.run.smithi132.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2024-03-16T17:45:33.665 INFO:teuthology.orchestra.run.smithi194.stdout:(61/174): postgresql-server-13.11-1.el9.x86_64. 10 MB/s | 5.7 MB 00:00 2024-03-16T17:45:33.690 INFO:teuthology.orchestra.run.smithi194.stdout:(62/174): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-03-16T17:45:33.703 INFO:teuthology.orchestra.run.smithi132.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-03-16T17:45:33.708 INFO:teuthology.orchestra.run.smithi194.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 638 kB/s | 78 kB 00:00 2024-03-16T17:45:33.753 INFO:teuthology.orchestra.run.smithi132.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 647 kB/s | 32 kB 00:00 2024-03-16T17:45:33.766 INFO:teuthology.orchestra.run.smithi194.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 326 kB/s | 24 kB 00:00 2024-03-16T17:45:33.786 INFO:teuthology.orchestra.run.smithi132.stdout:(117/174): python3-asyncssh-2.13.2-4.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-03-16T17:45:33.812 INFO:teuthology.orchestra.run.smithi132.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 256 kB/s | 15 kB 00:00 2024-03-16T17:45:33.858 INFO:teuthology.orchestra.run.smithi194.stdout:(65/174): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2024-03-16T17:45:33.862 INFO:teuthology.orchestra.run.smithi132.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-03-16T17:45:33.883 INFO:teuthology.orchestra.run.smithi194.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 104 kB/s | 18 kB 00:00 2024-03-16T17:45:33.908 INFO:teuthology.orchestra.run.smithi194.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 144 kB 00:00 2024-03-16T17:45:33.929 INFO:teuthology.orchestra.run.smithi132.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-03-16T17:45:33.934 INFO:teuthology.orchestra.run.smithi194.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 422 kB/s | 32 kB 00:00 2024-03-16T17:45:33.954 INFO:teuthology.orchestra.run.smithi132.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-03-16T17:45:33.979 INFO:teuthology.orchestra.run.smithi132.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 703 kB/s | 35 kB 00:00 2024-03-16T17:45:33.984 INFO:teuthology.orchestra.run.smithi194.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.8 MB/s | 217 kB 00:00 2024-03-16T17:45:34.030 INFO:teuthology.orchestra.run.smithi132.stdout:(123/174): python3-google-auth-2.28.0-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-03-16T17:45:34.051 INFO:teuthology.orchestra.run.smithi194.stdout:(70/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-03-16T17:45:34.076 INFO:teuthology.orchestra.run.smithi194.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-03-16T17:45:34.101 INFO:teuthology.orchestra.run.smithi194.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 600 kB/s | 69 kB 00:00 2024-03-16T17:45:34.105 INFO:teuthology.orchestra.run.smithi132.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-03-16T17:45:34.126 INFO:teuthology.orchestra.run.smithi194.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 827 kB/s | 41 kB 00:00 2024-03-16T17:45:34.152 INFO:teuthology.orchestra.run.smithi194.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-16T17:45:34.155 INFO:teuthology.orchestra.run.smithi132.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-03-16T17:45:34.177 INFO:teuthology.orchestra.run.smithi194.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-16T17:45:34.202 INFO:teuthology.orchestra.run.smithi194.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-16T17:45:34.214 INFO:teuthology.orchestra.run.smithi132.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 303 kB/s | 18 kB 00:00 2024-03-16T17:45:34.227 INFO:teuthology.orchestra.run.smithi194.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 633 kB/s | 47 kB 00:00 2024-03-16T17:45:34.253 INFO:teuthology.orchestra.run.smithi194.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 571 kB/s | 43 kB 00:00 2024-03-16T17:45:34.281 INFO:teuthology.orchestra.run.smithi132.stdout:(127/174): libarrow-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-03-16T17:45:34.303 INFO:teuthology.orchestra.run.smithi194.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 516 kB/s | 39 kB 00:00 2024-03-16T17:45:34.315 INFO:teuthology.orchestra.run.smithi132.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-03-16T17:45:34.357 INFO:teuthology.orchestra.run.smithi132.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-03-16T17:45:34.382 INFO:teuthology.orchestra.run.smithi132.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 295 kB/s | 20 kB 00:00 2024-03-16T17:45:34.432 INFO:teuthology.orchestra.run.smithi132.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 926 kB/s | 46 kB 00:00 2024-03-16T17:45:34.453 INFO:teuthology.orchestra.run.smithi194.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 208 kB/s | 41 kB 00:00 2024-03-16T17:45:34.474 INFO:teuthology.orchestra.run.smithi132.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-03-16T17:45:34.516 INFO:teuthology.orchestra.run.smithi132.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-03-16T17:45:34.591 INFO:teuthology.orchestra.run.smithi132.stdout:(134/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-16T17:45:34.603 INFO:teuthology.orchestra.run.smithi194.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-03-16T17:45:34.625 INFO:teuthology.orchestra.run.smithi132.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 495 kB/s | 16 kB 00:00 2024-03-16T17:45:34.628 INFO:teuthology.orchestra.run.smithi194.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 930 kB/s | 300 kB 00:00 2024-03-16T17:45:34.654 INFO:teuthology.orchestra.run.smithi194.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 284 kB/s | 56 kB 00:00 2024-03-16T17:45:34.667 INFO:teuthology.orchestra.run.smithi132.stdout:(136/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-03-16T17:45:34.679 INFO:teuthology.orchestra.run.smithi194.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-16T17:45:34.704 INFO:teuthology.orchestra.run.smithi194.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 588 kB/s | 44 kB 00:00 2024-03-16T17:45:34.709 INFO:teuthology.orchestra.run.smithi132.stdout:(137/174): python3-grpcio-1.46.7-10.el9.x86_64. 2.8 MB/s | 2.0 MB 00:00 2024-03-16T17:45:34.726 INFO:teuthology.orchestra.run.smithi132.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-03-16T17:45:34.730 INFO:teuthology.orchestra.run.smithi194.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-16T17:45:34.743 INFO:teuthology.orchestra.run.smithi132.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 922 kB/s | 31 kB 00:00 2024-03-16T17:45:34.755 INFO:teuthology.orchestra.run.smithi194.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-16T17:45:34.776 INFO:teuthology.orchestra.run.smithi132.stdout:(140/174): python3-kubernetes-26.1.0-2.el9.noar 2.4 MB/s | 1.0 MB 00:00 2024-03-16T17:45:34.788 INFO:teuthology.orchestra.run.smithi194.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-16T17:45:34.793 INFO:teuthology.orchestra.run.smithi132.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-03-16T17:45:34.814 INFO:teuthology.orchestra.run.smithi194.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-16T17:45:34.818 INFO:teuthology.orchestra.run.smithi132.stdout:(142/174): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-03-16T17:45:34.839 INFO:teuthology.orchestra.run.smithi194.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-03-16T17:45:34.844 INFO:teuthology.orchestra.run.smithi132.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 533 kB/s | 36 kB 00:00 2024-03-16T17:45:34.864 INFO:teuthology.orchestra.run.smithi194.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-03-16T17:45:34.869 INFO:teuthology.orchestra.run.smithi132.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-03-16T17:45:34.920 INFO:teuthology.orchestra.run.smithi132.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-16T17:45:34.946 INFO:teuthology.orchestra.run.smithi132.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-03-16T17:45:34.970 INFO:teuthology.orchestra.run.smithi132.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-03-16T17:45:34.981 INFO:teuthology.orchestra.run.smithi194.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-03-16T17:45:34.995 INFO:teuthology.orchestra.run.smithi132.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-03-16T17:45:35.006 INFO:teuthology.orchestra.run.smithi194.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-03-16T17:45:35.020 INFO:teuthology.orchestra.run.smithi132.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-16T17:45:35.031 INFO:teuthology.orchestra.run.smithi194.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-03-16T17:45:35.057 INFO:teuthology.orchestra.run.smithi194.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.6 MB/s | 803 kB 00:00 2024-03-16T17:45:35.291 INFO:teuthology.orchestra.run.smithi194.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 76 kB/s | 21 kB 00:00 2024-03-16T17:45:35.313 INFO:teuthology.orchestra.run.smithi132.stdout:(150/174): librados2-19.0.0-1681.gaba3c1d2.el9. 11 MB/s | 3.4 MB 00:00 2024-03-16T17:45:35.316 INFO:teuthology.orchestra.run.smithi194.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 90 kB/s | 25 kB 00:00 2024-03-16T17:45:35.355 INFO:teuthology.orchestra.run.smithi132.stdout:(151/174): thrift-0.15.0-2.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-03-16T17:45:35.380 INFO:teuthology.orchestra.run.smithi132.stdout:(152/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.7 MB/s | 321 kB 00:00 2024-03-16T17:45:35.447 INFO:teuthology.orchestra.run.smithi132.stdout:(153/174): librbd1-19.0.0-1681.gaba3c1d2.el9.x8 7.4 MB/s | 3.1 MB 00:00 2024-03-16T17:45:35.633 INFO:teuthology.orchestra.run.smithi194.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 717 kB/s | 245 kB 00:00 2024-03-16T17:45:35.741 INFO:teuthology.orchestra.run.smithi194.stdout:(99/174): qatlib-23.11.0-1.el9.x86_64.rpm 2.0 MB/s | 216 kB 00:00 2024-03-16T17:45:35.766 INFO:teuthology.orchestra.run.smithi194.stdout:(100/174): python3-jinja2-2.11.3-5.el9.noarch.r 550 kB/s | 248 kB 00:00 2024-03-16T17:45:35.788 INFO:teuthology.orchestra.run.smithi132.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 124 kB/s | 42 kB 00:00 2024-03-16T17:45:35.842 INFO:teuthology.orchestra.run.smithi194.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 348 kB/s | 35 kB 00:00 2024-03-16T17:45:35.867 INFO:teuthology.orchestra.run.smithi194.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 444 kB/s | 44 kB 00:00 2024-03-16T17:45:35.942 INFO:teuthology.orchestra.run.smithi194.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 935 kB/s | 94 kB 00:00 2024-03-16T17:45:36.051 INFO:teuthology.orchestra.run.smithi194.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 121 kB/s | 22 kB 00:00 2024-03-16T17:45:36.218 INFO:teuthology.orchestra.run.smithi194.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.4 MB/s | 863 kB 00:00 2024-03-16T17:45:36.410 INFO:teuthology.orchestra.run.smithi194.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-03-16T17:45:36.468 INFO:teuthology.orchestra.run.smithi194.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 335 kB/s | 19 kB 00:00 2024-03-16T17:45:36.531 INFO:teuthology.orchestra.run.smithi132.stdout:(155/174): NetworkManager-libnm-1.46.0-1.el9.x8 1.6 MB/s | 1.8 MB 00:01 2024-03-16T17:45:36.552 INFO:teuthology.orchestra.run.smithi194.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 926 kB/s | 309 kB 00:00 2024-03-16T17:45:36.556 INFO:teuthology.orchestra.run.smithi132.stdout:(156/174): NetworkManager-tui-1.46.0-1.el9.x86_ 324 kB/s | 248 kB 00:00 2024-03-16T17:45:36.610 INFO:teuthology.orchestra.run.smithi194.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 447 kB/s | 26 kB 00:00 2024-03-16T17:45:36.669 INFO:teuthology.orchestra.run.smithi194.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 834 kB/s | 49 kB 00:00 2024-03-16T17:45:36.727 INFO:teuthology.orchestra.run.smithi194.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-03-16T17:45:36.811 INFO:teuthology.orchestra.run.smithi194.stdout:(112/174): openssl-devel-3.0.7-27.el9.x86_64.rp 2.4 MB/s | 4.1 MB 00:01 2024-03-16T17:45:36.836 INFO:teuthology.orchestra.run.smithi194.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-03-16T17:45:36.839 INFO:teuthology.orchestra.run.smithi132.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 129 kB/s | 36 kB 00:00 2024-03-16T17:45:36.881 INFO:teuthology.orchestra.run.smithi132.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 204 kB/s | 71 kB 00:00 2024-03-16T17:45:36.895 INFO:teuthology.orchestra.run.smithi194.stdout:(114/174): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-03-16T17:45:36.979 INFO:teuthology.orchestra.run.smithi194.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 750 kB/s | 43 kB 00:00 2024-03-16T17:45:37.012 INFO:teuthology.orchestra.run.smithi194.stdout:(116/174): python3-asyncssh-2.13.2-4.el9.noarch 3.1 MB/s | 548 kB 00:00 2024-03-16T17:45:37.037 INFO:teuthology.orchestra.run.smithi194.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 563 kB/s | 32 kB 00:00 2024-03-16T17:45:37.071 INFO:teuthology.orchestra.run.smithi194.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-03-16T17:45:37.097 INFO:teuthology.orchestra.run.smithi194.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.8 MB/s | 172 kB 00:00 2024-03-16T17:45:37.163 INFO:teuthology.orchestra.run.smithi194.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-03-16T17:45:37.189 INFO:teuthology.orchestra.run.smithi194.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-03-16T17:45:37.222 INFO:teuthology.orchestra.run.smithi194.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 603 kB/s | 35 kB 00:00 2024-03-16T17:45:37.264 INFO:teuthology.orchestra.run.smithi194.stdout:(123/174): python3-google-auth-2.28.0-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-03-16T17:45:37.289 INFO:teuthology.orchestra.run.smithi194.stdout:(124/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.7 MB/s | 838 kB 00:00 2024-03-16T17:45:37.323 INFO:teuthology.orchestra.run.smithi194.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-03-16T17:45:37.348 INFO:teuthology.orchestra.run.smithi194.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-03-16T17:45:37.382 INFO:teuthology.orchestra.run.smithi194.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-03-16T17:45:37.407 INFO:teuthology.orchestra.run.smithi194.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-03-16T17:45:37.449 INFO:teuthology.orchestra.run.smithi194.stdout:(129/174): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-03-16T17:45:37.474 INFO:teuthology.orchestra.run.smithi194.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-03-16T17:45:37.490 INFO:teuthology.orchestra.run.smithi132.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 420 kB/s | 256 kB 00:00 2024-03-16T17:45:37.499 INFO:teuthology.orchestra.run.smithi194.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-03-16T17:45:37.507 INFO:teuthology.orchestra.run.smithi132.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 288 kB/s | 192 kB 00:00 2024-03-16T17:45:37.558 INFO:teuthology.orchestra.run.smithi194.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 798 kB/s | 46 kB 00:00 2024-03-16T17:45:37.675 INFO:teuthology.orchestra.run.smithi194.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-03-16T17:45:37.700 INFO:teuthology.orchestra.run.smithi194.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 394 kB/s | 79 kB 00:00 2024-03-16T17:45:37.726 INFO:teuthology.orchestra.run.smithi194.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 345 kB/s | 58 kB 00:00 2024-03-16T17:45:37.757 INFO:teuthology.orchestra.run.smithi132.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 86 kB/s | 23 kB 00:00 2024-03-16T17:45:37.759 INFO:teuthology.orchestra.run.smithi194.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 282 kB/s | 16 kB 00:00 2024-03-16T17:45:37.784 INFO:teuthology.orchestra.run.smithi194.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-03-16T17:45:37.810 INFO:teuthology.orchestra.run.smithi194.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-03-16T17:45:37.835 INFO:teuthology.orchestra.run.smithi194.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 373 kB/s | 28 kB 00:00 2024-03-16T17:45:37.860 INFO:teuthology.orchestra.run.smithi194.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-03-16T17:45:37.885 INFO:teuthology.orchestra.run.smithi194.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-16T17:45:37.911 INFO:teuthology.orchestra.run.smithi194.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-03-16T17:45:37.928 INFO:teuthology.orchestra.run.smithi194.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 532 kB/s | 36 kB 00:00 2024-03-16T17:45:37.944 INFO:teuthology.orchestra.run.smithi194.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 869 kB/s | 51 kB 00:00 2024-03-16T17:45:37.970 INFO:teuthology.orchestra.run.smithi194.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-03-16T17:45:37.995 INFO:teuthology.orchestra.run.smithi194.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-16T17:45:38.007 INFO:teuthology.orchestra.run.smithi132.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 217 kB/s | 108 kB 00:00 2024-03-16T17:45:38.020 INFO:teuthology.orchestra.run.smithi194.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-03-16T17:45:38.054 INFO:teuthology.orchestra.run.smithi194.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-03-16T17:45:38.079 INFO:teuthology.orchestra.run.smithi194.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-03-16T17:45:38.222 INFO:teuthology.orchestra.run.smithi194.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-03-16T17:45:38.266 INFO:teuthology.orchestra.run.smithi132.stdout:(163/174): NetworkManager-1.46.0-1.el9.x86_64.r 805 kB/s | 2.3 MB 00:02 2024-03-16T17:45:38.291 INFO:teuthology.orchestra.run.smithi132.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 290 kB/s | 155 kB 00:00 2024-03-16T17:45:38.346 INFO:teuthology.orchestra.run.smithi194.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.5 MB/s | 321 kB 00:00 2024-03-16T17:45:38.441 INFO:teuthology.orchestra.run.smithi132.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 313 kB/s | 136 kB 00:00 2024-03-16T17:45:38.558 INFO:teuthology.orchestra.run.smithi132.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 107 kB/s | 29 kB 00:00 2024-03-16T17:45:38.563 INFO:teuthology.orchestra.run.smithi194.stdout:(152/174): librbd1-19.0.0-1681.gaba3c1d2.el9.x8 6.5 MB/s | 3.1 MB 00:00 2024-03-16T17:45:38.614 INFO:teuthology.orchestra.run.smithi194.stdout:(153/174): NetworkManager-1.46.0-1.el9.x86_64.r 8.6 MB/s | 2.3 MB 00:00 2024-03-16T17:45:38.617 INFO:teuthology.orchestra.run.smithi132.stdout:(167/174): libsmartcols-2.37.4-18.el9.x86_64.rp 182 kB/s | 64 kB 00:00 2024-03-16T17:45:38.655 INFO:teuthology.orchestra.run.smithi194.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 1.0 MB/s | 42 kB 00:00 2024-03-16T17:45:38.697 INFO:teuthology.orchestra.run.smithi194.stdout:(155/174): NetworkManager-tui-1.46.0-1.el9.x86_ 5.8 MB/s | 248 kB 00:00 2024-03-16T17:45:38.739 INFO:teuthology.orchestra.run.smithi194.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-03-16T17:45:38.781 INFO:teuthology.orchestra.run.smithi194.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 873 kB/s | 36 kB 00:00 2024-03-16T17:45:38.823 INFO:teuthology.orchestra.run.smithi194.stdout:(158/174): NetworkManager-libnm-1.46.0-1.el9.x8 7.0 MB/s | 1.8 MB 00:00 2024-03-16T17:45:38.882 INFO:teuthology.orchestra.run.smithi194.stdout:(159/174): librados2-19.0.0-1681.gaba3c1d2.el9. 4.1 MB/s | 3.4 MB 00:00 2024-03-16T17:45:38.934 INFO:teuthology.orchestra.run.smithi194.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.2 MB/s | 192 kB 00:00 2024-03-16T17:45:38.966 INFO:teuthology.orchestra.run.smithi194.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.8 MB/s | 256 kB 00:00 2024-03-16T17:45:38.991 INFO:teuthology.orchestra.run.smithi194.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.9 MB/s | 108 kB 00:00 2024-03-16T17:45:39.016 INFO:teuthology.orchestra.run.smithi194.stdout:(163/174): libacl-2.3.1-4.el9.x86_64.rpm 172 kB/s | 23 kB 00:00 2024-03-16T17:45:39.042 INFO:teuthology.orchestra.run.smithi194.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 155 kB 00:00 2024-03-16T17:45:39.067 INFO:teuthology.orchestra.run.smithi194.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 136 kB 00:00 2024-03-16T17:45:39.092 INFO:teuthology.orchestra.run.smithi194.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 848 kB/s | 64 kB 00:00 2024-03-16T17:45:39.117 INFO:teuthology.orchestra.run.smithi194.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 573 kB/s | 29 kB 00:00 2024-03-16T17:45:39.159 INFO:teuthology.orchestra.run.smithi194.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2024-03-16T17:45:39.226 INFO:teuthology.orchestra.run.smithi194.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 21 MB/s | 2.3 MB 00:00 2024-03-16T17:45:39.260 INFO:teuthology.orchestra.run.smithi194.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 4.5 MB/s | 465 kB 00:00 2024-03-16T17:45:39.285 INFO:teuthology.orchestra.run.smithi194.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 534 kB/s | 31 kB 00:00 2024-03-16T17:45:39.335 INFO:teuthology.orchestra.run.smithi194.stdout:(172/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 8.9 MB/s | 2.2 MB 00:00 2024-03-16T17:45:39.342 INFO:teuthology.orchestra.run.smithi132.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 1.3 MB/s | 1.2 MB 00:00 2024-03-16T17:45:39.369 INFO:teuthology.orchestra.run.smithi194.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 9.9 MB/s | 1.1 MB 00:00 2024-03-16T17:45:39.552 INFO:teuthology.orchestra.run.smithi194.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 278 kB/s | 74 kB 00:00 2024-03-16T17:45:39.559 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-03-16T17:45:39.559 INFO:teuthology.orchestra.run.smithi194.stdout:Total 14 MB/s | 224 MB 00:16 2024-03-16T17:45:39.934 INFO:teuthology.orchestra.run.smithi132.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 786 kB/s | 465 kB 00:00 2024-03-16T17:45:40.022 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-03-16T17:45:40.201 INFO:teuthology.orchestra.run.smithi132.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 117 kB/s | 31 kB 00:00 2024-03-16T17:45:40.332 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-03-16T17:45:40.332 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-03-16T17:45:40.451 INFO:teuthology.orchestra.run.smithi132.stdout:(171/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 1.1 MB/s | 2.2 MB 00:01 2024-03-16T17:45:40.585 INFO:teuthology.orchestra.run.smithi132.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 558 kB/s | 74 kB 00:00 2024-03-16T17:45:41.360 INFO:teuthology.orchestra.run.smithi132.stdout:(173/174): util-linux-2.37.4-18.el9.x86_64.rpm 853 kB/s | 2.3 MB 00:02 2024-03-16T17:45:42.101 INFO:teuthology.orchestra.run.smithi132.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 578 kB/s | 1.1 MB 00:01 2024-03-16T17:45:42.106 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-03-16T17:45:42.106 INFO:teuthology.orchestra.run.smithi132.stdout:Total 11 MB/s | 224 MB 00:20 2024-03-16T17:45:42.326 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-03-16T17:45:42.327 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-03-16T17:45:42.573 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-03-16T17:45:42.882 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-03-16T17:45:42.882 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-03-16T17:45:45.038 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-03-16T17:45:45.038 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-03-16T17:45:49.332 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-03-16T17:45:49.424 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-16T17:45:49.450 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-16T17:45:49.496 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T17:45:49.506 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T17:45:49.550 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-16T17:45:49.608 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-16T17:45:49.641 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-16T17:45:49.667 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-16T17:45:49.716 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-16T17:45:50.035 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-16T17:45:50.084 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T17:45:50.204 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T17:45:50.257 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T17:45:50.344 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T17:45:50.378 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 12/198 2024-03-16T17:45:50.422 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-16T17:45:50.592 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-16T17:45:50.647 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-16T17:45:50.675 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T17:45:50.762 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T17:45:50.784 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 17/198 2024-03-16T17:45:50.849 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 17/198 2024-03-16T17:45:50.888 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-16T17:45:50.911 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T17:45:50.926 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T17:45:51.125 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T17:45:51.160 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T17:45:51.198 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-16T17:45:51.362 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-16T17:45:51.501 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T17:45:51.544 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T17:45:51.652 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T17:45:51.704 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T17:45:51.941 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T17:45:51.976 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-03-16T17:45:52.058 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-16T17:45:52.073 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-16T17:45:52.108 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-16T17:45:52.145 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-16T17:45:52.146 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T17:45:52.155 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-16T17:45:52.175 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-16T17:45:52.195 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-16T17:45:52.202 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-16T17:45:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-16T17:45:52.255 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-16T17:45:52.299 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-16T17:45:52.310 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-16T17:45:52.324 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-16T17:45:52.364 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-16T17:45:52.403 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-16T17:45:52.431 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-16T17:45:52.483 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-16T17:45:52.519 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-16T17:45:52.562 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-16T17:45:52.595 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-16T17:45:52.623 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-16T17:45:52.692 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-16T17:45:52.727 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9. 39/198 2024-03-16T17:45:52.771 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el 40/198 2024-03-16T17:45:52.799 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_6 41/198 2024-03-16T17:45:52.868 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-16T17:45:52.893 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-16T17:45:52.914 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-16T17:45:52.942 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T17:45:52.987 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-16T17:45:53.051 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T17:45:53.093 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T17:45:53.122 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-16T17:45:53.168 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T17:45:53.177 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-16T17:45:53.211 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 12/198 2024-03-16T17:45:53.263 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-16T17:45:53.460 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-16T17:45:53.509 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-16T17:45:53.537 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T17:45:53.641 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T17:45:53.664 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 17/198 2024-03-16T17:45:53.700 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-16T17:45:53.728 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 17/198 2024-03-16T17:45:53.776 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-16T17:45:53.780 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-16T17:45:53.798 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T17:45:53.814 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-16T17:45:53.864 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-16T17:45:53.908 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T17:45:53.916 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T17:45:53.950 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-16T17:45:53.998 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-16T17:45:54.030 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T17:45:54.060 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_6 53/198 2024-03-16T17:45:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-16T17:45:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-16T17:45:54.099 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-16T17:45:54.350 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-16T17:45:54.377 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-16T17:45:54.569 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-16T17:45:54.650 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-16T17:45:54.663 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T17:45:54.694 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-16T17:45:54.707 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-16T17:45:54.829 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T17:45:54.835 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-16T17:45:54.876 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T17:45:54.880 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-16T17:45:54.935 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-16T17:45:55.007 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-16T17:45:55.082 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-16T17:45:55.188 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-16T17:45:55.223 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-16T17:45:55.276 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-16T17:45:55.300 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-16T17:45:55.324 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-16T17:45:55.331 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-16T17:45:55.358 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-16T17:45:55.358 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-16T17:45:55.393 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-16T17:45:55.402 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-16T17:45:55.445 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-16T17:45:55.466 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-16T17:45:55.523 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-16T17:45:55.561 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-16T17:45:55.579 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-16T17:45:55.624 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-16T17:45:55.624 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-16T17:45:55.654 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-16T17:45:55.661 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-16T17:45:55.695 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-16T17:45:55.713 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-16T17:45:55.746 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-16T17:45:55.788 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-16T17:45:55.790 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-16T17:45:55.828 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-16T17:45:55.858 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-16T17:45:55.868 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-16T17:45:55.894 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-16T17:45:55.894 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9. 39/198 2024-03-16T17:45:55.919 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-16T17:45:55.938 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el 40/198 2024-03-16T17:45:55.967 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_6 41/198 2024-03-16T17:45:55.996 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-16T17:45:56.035 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-16T17:45:56.081 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-16T17:45:56.119 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-16T17:45:56.154 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-16T17:45:56.226 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-16T17:45:56.268 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-16T17:45:56.295 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-16T17:45:56.316 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-16T17:45:56.350 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-16T17:45:56.372 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-16T17:45:56.556 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-16T17:45:56.596 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-16T17:45:56.725 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-16T17:45:56.762 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-16T17:45:56.794 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-16T17:45:56.825 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-16T17:45:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-16T17:45:56.866 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-16T17:45:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-16T17:45:56.926 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-16T17:45:56.938 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-16T17:45:56.957 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-16T17:45:56.987 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-16T17:45:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-16T17:45:57.063 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-16T17:45:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T17:45:57.074 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-16T17:45:57.098 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-16T17:45:57.107 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-16T17:45:57.131 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-16T17:45:57.147 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-16T17:45:57.164 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-16T17:45:57.185 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_6 53/198 2024-03-16T17:45:57.198 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-16T17:45:57.216 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-16T17:45:57.287 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-16T17:45:57.369 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-16T17:45:57.412 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-16T17:45:57.444 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-16T17:45:57.475 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-16T17:45:57.491 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-16T17:45:57.588 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-16T17:45:57.645 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-16T17:45:57.653 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-16T17:45:57.726 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-16T17:45:57.769 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-16T17:45:57.913 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-16T17:45:57.973 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-16T17:45:58.027 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-16T17:45:58.092 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-16T17:45:58.124 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-16T17:45:58.160 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-16T17:45:58.207 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-16T17:45:58.235 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-16T17:45:58.278 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-16T17:45:58.319 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-16T17:45:58.370 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-16T17:45:58.418 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-16T17:45:58.451 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-16T17:45:58.453 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-16T17:45:58.499 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-16T17:45:58.508 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-16T17:45:58.539 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-16T17:45:58.579 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-16T17:45:58.589 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-16T17:45:58.610 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-16T17:45:58.683 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-16T17:45:58.723 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-16T17:45:58.763 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-16T17:45:58.789 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-16T17:45:58.793 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-16T17:45:58.813 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-16T17:45:58.833 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-16T17:45:58.904 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-16T17:45:58.911 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-16T17:45:59.031 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-16T17:45:59.129 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-16T17:45:59.172 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-16T17:45:59.221 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-16T17:45:59.284 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-16T17:45:59.467 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-16T17:45:59.509 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-16T17:45:59.578 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-16T17:45:59.637 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-16T17:45:59.685 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-16T17:45:59.691 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-16T17:45:59.723 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-16T17:45:59.754 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-16T17:45:59.782 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-16T17:45:59.816 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-16T17:45:59.856 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-16T17:45:59.887 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-16T17:45:59.918 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-16T17:45:59.993 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-16T17:46:00.027 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-16T17:46:00.061 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-16T17:46:00.094 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-16T17:46:00.129 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-16T17:46:00.217 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-16T17:46:00.307 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-16T17:46:00.360 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-16T17:46:00.391 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-16T17:46:00.438 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-16T17:46:00.534 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-16T17:46:00.592 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-16T17:46:00.902 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-16T17:46:00.997 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-16T17:46:01.028 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-16T17:46:01.059 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-16T17:46:01.087 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-16T17:46:01.321 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-16T17:46:01.365 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-16T17:46:01.393 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-16T17:46:01.399 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-16T17:46:01.425 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 124/198 2024-03-16T17:46:01.447 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-16T17:46:01.507 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 124/198 2024-03-16T17:46:01.526 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-16T17:46:01.538 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 125/198 2024-03-16T17:46:01.566 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-16T17:46:01.599 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-16T17:46:01.749 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-16T17:46:01.789 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-16T17:46:01.868 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-16T17:46:02.056 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-16T17:46:02.078 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 128/198 2024-03-16T17:46:02.155 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 128/198 2024-03-16T17:46:02.283 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 129/198 2024-03-16T17:46:02.504 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-16T17:46:02.614 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-16T17:46:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-16T17:46:03.910 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-16T17:46:03.941 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-16T17:46:03.973 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-16T17:46:04.000 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-16T17:46:04.308 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-16T17:46:04.339 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 124/198 2024-03-16T17:46:04.429 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 124/198 2024-03-16T17:46:04.460 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 125/198 2024-03-16T17:46:04.505 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-16T17:46:04.754 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T17:46:04.792 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T17:46:04.964 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-16T17:46:04.992 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 128/198 2024-03-16T17:46:05.062 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 128/198 2024-03-16T17:46:05.085 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 129/198 2024-03-16T17:46:05.335 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T17:46:05.386 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 131/198 2024-03-16T17:46:05.475 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 131/198 2024-03-16T17:46:05.475 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-16T17:46:05.475 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-16T17:46:05.475 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:05.504 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 132/198 2024-03-16T17:46:07.287 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T17:46:07.332 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T17:46:07.880 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 130/198 2024-03-16T17:46:07.918 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 131/198 2024-03-16T17:46:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 131/198 2024-03-16T17:46:07.998 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-16T17:46:07.998 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-16T17:46:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:08.028 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 132/198 2024-03-16T17:46:16.960 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 132/198 2024-03-16T17:46:16.960 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-03-16T17:46:16.960 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-03-16T17:46:16.960 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-03-16T17:46:16.960 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-03-16T17:46:16.960 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-03-16T17:46:16.961 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-03-16T17:46:16.961 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-03-16T17:46:16.961 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:17.132 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 133/198 2024-03-16T17:46:17.160 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 133/198 2024-03-16T17:46:17.160 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:17.160 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-16T17:46:17.160 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:18.627 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 134/198 2024-03-16T17:46:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 134/198 2024-03-16T17:46:18.652 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:18.652 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-16T17:46:18.652 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T17:46:18.652 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T17:46:18.652 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:18.877 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 135/198 2024-03-16T17:46:18.900 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 135/198 2024-03-16T17:46:18.900 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:18.900 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-16T17:46:18.900 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T17:46:18.900 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T17:46:18.900 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:19.344 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 136/198 2024-03-16T17:46:19.366 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 136/198 2024-03-16T17:46:19.367 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:19.367 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-16T17:46:19.367 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T17:46:19.367 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T17:46:19.367 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:19.463 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-16T17:46:19.845 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 132/198 2024-03-16T17:46:19.845 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2024-03-16T17:46:19.845 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2024-03-16T17:46:19.845 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2024-03-16T17:46:19.845 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2024-03-16T17:46:19.845 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2024-03-16T17:46:19.845 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2024-03-16T17:46:19.845 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2024-03-16T17:46:19.845 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:19.888 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 138/198 2024-03-16T17:46:19.910 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 138/198 2024-03-16T17:46:19.942 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.e 139/198 2024-03-16T17:46:20.002 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2. 140/198 2024-03-16T17:46:20.017 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 133/198 2024-03-16T17:46:20.025 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 141/198 2024-03-16T17:46:20.032 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 133/198 2024-03-16T17:46:20.033 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:20.033 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-16T17:46:20.033 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:20.257 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 141/198 2024-03-16T17:46:20.293 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 142/198 2024-03-16T17:46:21.253 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 142/198 2024-03-16T17:46:21.285 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 143/198 2024-03-16T17:46:21.384 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 143/198 2024-03-16T17:46:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 134/198 2024-03-16T17:46:21.538 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el 144/198 2024-03-16T17:46:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 134/198 2024-03-16T17:46:21.546 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:21.546 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-16T17:46:21.546 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T17:46:21.546 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-16T17:46:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:21.562 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 145/198 2024-03-16T17:46:21.585 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 145/198 2024-03-16T17:46:21.585 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:21.585 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-16T17:46:21.585 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T17:46:21.585 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T17:46:21.585 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:21.629 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 146/198 2024-03-16T17:46:21.640 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 146/198 2024-03-16T17:46:21.688 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 147/198 2024-03-16T17:46:21.762 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 135/198 2024-03-16T17:46:21.785 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 135/198 2024-03-16T17:46:21.785 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:21.786 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-16T17:46:21.786 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T17:46:21.786 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-16T17:46:21.786 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:22.230 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 136/198 2024-03-16T17:46:22.252 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 136/198 2024-03-16T17:46:22.252 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:22.252 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-16T17:46:22.253 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T17:46:22.253 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-16T17:46:22.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-16T17:46:22.534 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-16T17:46:22.564 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 149/198 2024-03-16T17:46:22.587 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 149/198 2024-03-16T17:46:22.587 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:22.587 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-16T17:46:22.587 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T17:46:22.587 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T17:46:22.587 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:22.632 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 150/198 2024-03-16T17:46:22.654 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 150/198 2024-03-16T17:46:22.654 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:22.654 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-16T17:46:22.654 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:22.707 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T17:46:22.709 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 138/198 2024-03-16T17:46:22.730 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T17:46:22.730 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:22.730 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-16T17:46:22.730 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T17:46:22.730 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T17:46:22.730 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:22.739 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 138/198 2024-03-16T17:46:22.771 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.e 139/198 2024-03-16T17:46:22.831 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2. 140/198 2024-03-16T17:46:22.854 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 141/198 2024-03-16T17:46:23.033 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 152/198 2024-03-16T17:46:23.055 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 152/198 2024-03-16T17:46:23.055 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:23.055 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-16T17:46:23.055 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T17:46:23.055 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T17:46:23.056 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:23.084 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 141/198 2024-03-16T17:46:23.113 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 142/198 2024-03-16T17:46:24.079 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 142/198 2024-03-16T17:46:24.105 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 143/198 2024-03-16T17:46:24.203 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 143/198 2024-03-16T17:46:24.367 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el 144/198 2024-03-16T17:46:24.398 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 145/198 2024-03-16T17:46:24.421 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 145/198 2024-03-16T17:46:24.421 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:24.422 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-16T17:46:24.422 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T17:46:24.422 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-16T17:46:24.422 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:24.466 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 146/198 2024-03-16T17:46:24.477 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 146/198 2024-03-16T17:46:24.526 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 147/198 2024-03-16T17:46:25.375 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-16T17:46:25.401 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 149/198 2024-03-16T17:46:25.424 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 149/198 2024-03-16T17:46:25.424 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:25.424 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-16T17:46:25.424 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T17:46:25.424 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-16T17:46:25.424 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:25.469 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 150/198 2024-03-16T17:46:25.490 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 150/198 2024-03-16T17:46:25.490 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:25.490 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-16T17:46:25.491 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:25.544 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T17:46:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T17:46:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-16T17:46:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T17:46:25.567 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-16T17:46:25.567 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:25.870 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 152/198 2024-03-16T17:46:25.893 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 152/198 2024-03-16T17:46:25.893 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-16T17:46:25.893 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-16T17:46:25.893 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T17:46:25.893 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-16T17:46:25.894 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:27.463 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 153/198 2024-03-16T17:46:27.503 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 154/198 2024-03-16T17:46:27.534 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 155/198 2024-03-16T17:46:27.562 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-16T17:46:27.744 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 157/198 2024-03-16T17:46:27.860 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-16T17:46:27.900 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 159/198 2024-03-16T17:46:27.953 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-16T17:46:28.034 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-16T17:46:28.096 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-16T17:46:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_ 163/198 2024-03-16T17:46:28.158 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-16T17:46:28.188 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-16T17:46:28.258 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-16T17:46:28.349 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-16T17:46:28.386 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-16T17:46:29.011 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T17:46:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T17:46:29.061 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T17:46:29.882 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 170/198 2024-03-16T17:46:29.969 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-16T17:46:30.010 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-16T17:46:30.097 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-16T17:46:30.131 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-16T17:46:30.156 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-16T17:46:30.181 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-16T17:46:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-16T17:46:30.208 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T17:46:30.296 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T17:46:30.316 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 153/198 2024-03-16T17:46:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-16T17:46:30.325 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T17:46:30.357 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 154/198 2024-03-16T17:46:30.388 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 155/198 2024-03-16T17:46:30.410 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T17:46:30.426 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-16T17:46:30.445 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-16T17:46:30.478 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-16T17:46:30.503 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-16T17:46:30.528 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-16T17:46:30.562 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-16T17:46:30.608 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 157/198 2024-03-16T17:46:30.614 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-16T17:46:30.642 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-16T17:46:30.668 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-16T17:46:30.693 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-16T17:46:30.723 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-16T17:46:30.726 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-16T17:46:30.752 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-16T17:46:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T17:46:30.758 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T17:46:30.763 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 159/198 2024-03-16T17:46:30.821 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-16T17:46:30.872 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-16T17:46:30.915 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-16T17:46:30.938 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T17:46:30.938 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T17:46:30.939 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_ 163/198 2024-03-16T17:46:30.981 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-16T17:46:31.010 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-16T17:46:31.021 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T17:46:31.045 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-16T17:46:31.071 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-16T17:46:31.086 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-16T17:46:31.103 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-16T17:46:31.130 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-16T17:46:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-16T17:46:31.183 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-16T17:46:31.195 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T17:46:31.794 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T17:46:31.833 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T17:46:31.852 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-16T17:46:32.662 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 170/198 2024-03-16T17:46:32.745 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-16T17:46:32.786 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-16T17:46:32.877 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-16T17:46:32.908 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-16T17:46:32.933 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-16T17:46:32.958 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-16T17:46:32.984 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-16T17:46:32.984 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T17:46:33.056 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-16T17:46:33.093 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-16T17:46:33.094 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T17:46:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-16T17:46:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-16T17:46:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-16T17:46:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-16T17:46:33.280 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-16T17:46:33.331 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-16T17:46:33.370 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-16T17:46:33.401 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-16T17:46:33.426 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-16T17:46:33.452 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-16T17:46:33.477 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-16T17:46:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-16T17:46:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T17:46:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T17:46:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-16T17:46:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T17:46:33.771 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-16T17:46:33.796 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-16T17:46:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-16T17:46:33.871 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-16T17:46:33.898 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-16T17:46:33.964 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T17:46:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T17:46:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 1/198 2024-03-16T17:46:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2/198 2024-03-16T17:46:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 3/198 2024-03-16T17:46:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 4/198 2024-03-16T17:46:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 5/198 2024-03-16T17:46:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 6/198 2024-03-16T17:46:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 7/198 2024-03-16T17:46:35.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 8/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 9/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 12/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 13/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 14/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_ 15/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 17/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_6 18/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 19/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 20/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el 21/198 2024-03-16T17:46:35.957 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9. 22/198 2024-03-16T17:46:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_6 23/198 2024-03-16T17:46:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 24/198 2024-03-16T17:46:35.958 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 25/198 2024-03-16T17:46:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 26/198 2024-03-16T17:46:35.972 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 27/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 28/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 29/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2. 30/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 31/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 32/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 33/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el 34/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 35/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.e 36/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 37/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 38/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 39/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-16T17:46:35.973 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-16T17:46:35.974 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-16T17:46:35.975 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-16T17:46:35.976 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-16T17:46:35.977 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-16T17:46:35.978 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-16T17:46:35.979 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-16T17:46:35.980 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 153/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-16T17:46:35.981 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-16T17:46:35.982 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-16T17:46:35.983 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-16T17:46:35.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-16T17:46:35.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-16T17:46:35.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-16T17:46:35.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-16T17:46:35.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-16T17:46:35.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-16T17:46:35.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-16T17:46:35.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-16T17:46:35.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-16T17:46:39.140 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-16T17:46:39.140 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 1/198 2024-03-16T17:46:39.140 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 3/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 4/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1681.gaba3c 5/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 6/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 7/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 8/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 9/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 10/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 11/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 12/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 13/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 14/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_ 15/198 2024-03-16T17:46:39.141 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 16/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 17/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_6 18/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86 19/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 20/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el 21/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9. 22/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_6 23/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 24/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 25/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 26/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 27/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 28/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 29/198 2024-03-16T17:46:39.142 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2. 30/198 2024-03-16T17:46:39.157 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noa 31/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.n 32/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba 33/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el 34/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 35/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.e 36/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 37/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 38/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 39/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-16T17:46:39.158 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-16T17:46:39.159 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-16T17:46:39.160 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-16T17:46:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-16T17:46:39.162 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-16T17:46:39.163 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-16T17:46:39.164 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-16T17:46:39.165 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 151/198 2024-03-16T17:46:39.166 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 153/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-16T17:46:39.167 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-16T17:46:39.168 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-16T17:46:39.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-16T17:46:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-16T17:46:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:39.170 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-03-16T17:46:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-16T17:46:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-16T17:46:39.170 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: acl-2.3.1-4.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-16T17:46:39.171 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.2-8.el9.noarch 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.7.4-5.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.172 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.173 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.4-9.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-16T17:46:39.174 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-16T17:46:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: jq-1.6-16.el9.x86_64 2024-03-16T17:46:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-16T17:46:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-16T17:46:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-16T17:46:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-16T17:46:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-16T17:46:39.175 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: lua-5.4.4-4.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-16T17:46:39.176 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-13.11-1.el9.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-16T17:46:39.177 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-16T17:46:39.178 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-16T17:46:39.179 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-16T17:46:39.180 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-16T17:46:39.181 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-16T17:46:39.182 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-3.el9.x86_64 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:39.183 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-03-16T17:46:39.641 DEBUG:teuthology.parallel:result is None 2024-03-16T17:46:42.161 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-16T17:46:42.161 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:42.161 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2024-03-16T17:46:42.161 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-16T17:46:42.161 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-16T17:46:42.161 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-16T17:46:42.161 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-16T17:46:42.161 INFO:teuthology.orchestra.run.smithi132.stdout: acl-2.3.1-4.el9.x86_64 2024-03-16T17:46:42.161 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-16T17:46:42.162 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.2-8.el9.noarch 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.7.4-5.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.163 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.164 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top-2:19.0.0-1681.gaba3c1d2.el9.noarch 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.4-9.el9.x86_64 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-16T17:46:42.165 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: jq-1.6-16.el9.x86_64 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-16T17:46:42.166 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: lua-5.4.4-4.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-16T17:46:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-13.11-1.el9.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-16T17:46:42.168 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-16T17:46:42.169 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-16T17:46:42.170 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-16T17:46:42.171 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.172 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-16T17:46:42.173 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.174 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.174 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:19.0.0-1681.gaba3c1d2.el9.x86_64 2024-03-16T17:46:42.174 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-3.el9.x86_64 2024-03-16T17:46:42.174 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-16T17:46:42.174 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-16T17:46:42.174 INFO:teuthology.orchestra.run.smithi132.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-16T17:46:42.174 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-16T17:46:42.174 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-16T17:46:42.174 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-16T17:46:42.175 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:42.175 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-03-16T17:46:42.667 DEBUG:teuthology.parallel:result is None 2024-03-16T17:46:42.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T17:46:42.811 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-16T17:46:42.833 INFO:teuthology.orchestra.run.smithi132.stdout:19.0.0-1681.gaba3c1d2.el9 2024-03-16T17:46:42.834 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1681.gaba3c1d2.el9 2024-03-16T17:46:42.834 INFO:teuthology.task.install:The correct ceph version 19.0.0-1681.gaba3c1d2 is installed. 2024-03-16T17:46:42.836 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b 2024-03-16T17:46:42.973 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-16T17:46:42.998 INFO:teuthology.orchestra.run.smithi194.stdout:19.0.0-1681.gaba3c1d2.el9 2024-03-16T17:46:42.998 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1681.gaba3c1d2.el9 2024-03-16T17:46:42.998 INFO:teuthology.task.install:The correct ceph version 19.0.0-1681.gaba3c1d2 is installed. 2024-03-16T17:46:43.000 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-16T17:46:43.000 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:43.001 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-16T17:46:43.030 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:46:43.030 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-16T17:46:43.072 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-16T17:46:43.072 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:43.072 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-03-16T17:46:43.099 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-16T17:46:43.166 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:46:43.166 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-03-16T17:46:43.196 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-16T17:46:43.265 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-16T17:46:43.266 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:43.266 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-16T17:46:43.293 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-16T17:46:43.360 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:46:43.360 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-16T17:46:43.389 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-16T17:46:43.457 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-16T17:46:43.458 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:43.458 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-03-16T17:46:43.484 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-16T17:46:43.551 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:46:43.551 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-03-16T17:46:43.579 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-16T17:46:43.648 INFO:teuthology.run_tasks:Running task ceph... 2024-03-16T17:46:43.739 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-16T17:46:43.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2024-03-16T17:46:43.742 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-03-16T17:46:43.769 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-16T17:46:43.770 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-16T17:46:43.809 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-16T17:46:43.836 INFO:tasks.ceph:Creating extra log directories... 2024-03-16T17:46:43.836 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-16T17:46:43.876 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-16T17:46:43.909 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-16T17:46:43.909 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-16T17:46:43.910 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-16T17:46:43.910 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:43.910 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-16T17:46:43.956 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-16T17:46:44.072 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-16T17:46:44.099 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:46:44.099 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-16T17:46:44.114 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-16T17:46:44.231 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-16T17:46:44.263 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-16T17:46:44.263 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-16T17:46:44.263 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602014', 'branch': 'wip-lusov-qdb-squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7602014', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-qdb-squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-qdb-squid', 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6918, 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', 'sleep_before_teardown': 0, 'subset': '111/10000', 'suite': 'fs', 'suite_branch': 'wip-lusov-qdb-squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC5/r2ksxuD3gClYm5uU1JZqlr35fYDfLO4Cq/+oDXIQUeVhQ/X1frbmu9/kF/DytT05ZN/611EUVH49C732UBY=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMpENCmvgYxMAGoO/WoBcQUE2Llxts/BRS7cerwYOhsT2nDIzlH0vr+2p4Oy+vNUtX0p+/HoH2W3Hgl4X+rcXgc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'aba3c1d240c873fc0cd3e1d30cd86b2dbb71f24b', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-15_11:44:52', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-16T17:46:44.264 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-16T17:46:44.266 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-16T17:46:44.312 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2024-03-16T17:46:44.320 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-03-16T17:46:44.379 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:44.379 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-03-16T17:46:44.400 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-16T17:46:44.400 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-03-16T17:46:44.455 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-16T17:46:44.455 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T17:46:44.455 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-03-16T17:46:44.455 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T17:46:44.455 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T17:46:44.455 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-03-16 17:46:34.341356116 +0000 2024-03-16T17:46:44.455 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-03-16 17:44:27.886933441 +0000 2024-03-16T17:46:44.455 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-03-16 17:44:27.886933441 +0000 2024-03-16T17:46:44.455 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-03-16 17:44:27.886933441 +0000 2024-03-16T17:46:44.455 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-16T17:46:44.520 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-03-16T17:46:44.520 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-03-16T17:46:44.520 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000176478 s, 2.9 MB/s 2024-03-16T17:46:44.521 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-16T17:46:44.576 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-03-16T17:46:44.631 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-16T17:46:44.632 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T17:46:44.632 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-03-16T17:46:44.632 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T17:46:44.632 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T17:46:44.632 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-03-16 17:46:34.341356116 +0000 2024-03-16T17:46:44.632 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-03-16 17:44:28.215924900 +0000 2024-03-16T17:46:44.632 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-03-16 17:44:28.215924900 +0000 2024-03-16T17:46:44.632 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-03-16 17:44:28.215924900 +0000 2024-03-16T17:46:44.632 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-16T17:46:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-03-16T17:46:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-03-16T17:46:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.0002092 s, 2.4 MB/s 2024-03-16T17:46:44.697 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-16T17:46:44.753 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-03-16T17:46:44.808 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-16T17:46:44.808 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T17:46:44.808 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-16T17:46:44.808 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T17:46:44.808 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T17:46:44.808 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-03-16 17:46:34.342356090 +0000 2024-03-16T17:46:44.808 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-03-16 17:44:28.536916568 +0000 2024-03-16T17:46:44.808 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-03-16 17:44:28.536916568 +0000 2024-03-16T17:46:44.808 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-03-16 17:44:28.536916568 +0000 2024-03-16T17:46:44.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-16T17:46:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-03-16T17:46:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-03-16T17:46:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.00023356 s, 2.2 MB/s 2024-03-16T17:46:44.874 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-16T17:46:44.930 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-03-16T17:46:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-16T17:46:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T17:46:44.985 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-16T17:46:44.985 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T17:46:44.985 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T17:46:44.985 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-03-16 17:46:34.342356090 +0000 2024-03-16T17:46:44.986 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-03-16 17:44:28.872907846 +0000 2024-03-16T17:46:44.986 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-03-16 17:44:28.872907846 +0000 2024-03-16T17:46:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-03-16 17:44:28.872907846 +0000 2024-03-16T17:46:44.986 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-16T17:46:45.051 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-03-16T17:46:45.051 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-03-16T17:46:45.051 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000234158 s, 2.2 MB/s 2024-03-16T17:46:45.052 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-16T17:46:45.107 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-16T17:46:45.108 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:46:45.108 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-03-16T17:46:45.125 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-16T17:46:45.125 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-03-16T17:46:45.186 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-16T17:46:45.186 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T17:46:45.186 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-16T17:46:45.186 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T17:46:45.186 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T17:46:45.186 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-03-16 17:46:31.533298737 +0000 2024-03-16T17:46:45.186 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-03-16 17:44:27.874427585 +0000 2024-03-16T17:46:45.186 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-03-16 17:44:27.874427585 +0000 2024-03-16T17:46:45.187 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-03-16 17:44:27.874427585 +0000 2024-03-16T17:46:45.187 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-16T17:46:45.255 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-03-16T17:46:45.255 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-03-16T17:46:45.255 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000199795 s, 2.6 MB/s 2024-03-16T17:46:45.256 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-16T17:46:45.314 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-03-16T17:46:45.374 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-16T17:46:45.374 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T17:46:45.374 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-03-16T17:46:45.375 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T17:46:45.375 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T17:46:45.375 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-03-16 17:46:31.533298737 +0000 2024-03-16T17:46:45.375 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-03-16 17:44:28.212420598 +0000 2024-03-16T17:46:45.375 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-03-16 17:44:28.212420598 +0000 2024-03-16T17:46:45.375 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-03-16 17:44:28.212420598 +0000 2024-03-16T17:46:45.375 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-16T17:46:45.442 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-03-16T17:46:45.442 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-03-16T17:46:45.443 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000195716 s, 2.6 MB/s 2024-03-16T17:46:45.443 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-16T17:46:45.500 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-03-16T17:46:45.556 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-16T17:46:45.556 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T17:46:45.556 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-16T17:46:45.556 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T17:46:45.556 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T17:46:45.556 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-03-16 17:46:31.533298737 +0000 2024-03-16T17:46:45.556 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-03-16 17:44:28.553413549 +0000 2024-03-16T17:46:45.556 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-03-16 17:44:28.553413549 +0000 2024-03-16T17:46:45.557 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-03-16 17:44:28.553413549 +0000 2024-03-16T17:46:45.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-16T17:46:45.622 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-03-16T17:46:45.622 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-03-16T17:46:45.622 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000167183 s, 3.1 MB/s 2024-03-16T17:46:45.623 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-16T17:46:45.679 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-03-16T17:46:45.734 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-16T17:46:45.734 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-16T17:46:45.734 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-16T17:46:45.734 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-16T17:46:45.734 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-03-16T17:46:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-03-16 17:46:31.534298716 +0000 2024-03-16T17:46:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-03-16 17:44:28.892406541 +0000 2024-03-16T17:46:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-03-16 17:44:28.892406541 +0000 2024-03-16T17:46:45.735 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-03-16 17:44:28.892406541 +0000 2024-03-16T17:46:45.735 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-16T17:46:45.802 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-03-16T17:46:45.802 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-03-16T17:46:45.802 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.00021893 s, 2.3 MB/s 2024-03-16T17:46:45.802 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-16T17:46:45.858 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-16T17:46:45.859 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-16T17:46:45.859 INFO:tasks.ceph:Generating config... 2024-03-16T17:46:45.860 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-16T17:46:45.860 INFO:tasks.ceph:[client] debug client = 20 2024-03-16T17:46:45.860 INFO:tasks.ceph:[client] debug ms = 1 2024-03-16T17:46:45.860 INFO:tasks.ceph:[client] pid file = 2024-03-16T17:46:45.860 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-16T17:46:45.860 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-16T17:46:45.861 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-16T17:46:45.861 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-16T17:46:45.862 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-16T17:46:45.862 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-16T17:46:45.863 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-16T17:46:45.863 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-16T17:46:45.863 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-16T17:46:45.863 INFO:tasks.ceph:Setting up mon.a... 2024-03-16T17:46:45.863 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-16T17:46:45.928 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.keyring 2024-03-16T17:46:45.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-16T17:46:45.978 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-16T17:46:46.006 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.132'), ('mon.b', '172.21.15.194'), ('mon.c', '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]')] 2024-03-16T17:46:46.006 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.132,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-16T17:46:46.007 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:46.007 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-16T17:46:46.061 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.132 --add b 172.21.15.194 --addv c '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:46:46.145 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: generated fsid 6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:setting min_mon_release = quincy 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:epoch 0 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:fsid 6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:last_changed 2024-03-16T17:46:46.143306+0000 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:created 2024-03-16T17:46:46.143306+0000 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:min_mon_release 17 (quincy) 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:election_strategy: 1 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:0: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.a 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:2: [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] mon.c 2024-03-16T17:46:46.146 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-16T17:46:46.148 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-16T17:46:46.162 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e... 2024-03-16T17:46:46.163 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-16T17:46:46.205 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-16T17:46:46.252 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2024-03-16T17:46:46.252 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2024-03-16T17:46:46.252 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-16T17:46:46.252 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2024-03-16T17:46:46.252 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.252 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2024-03-16T17:46:46.252 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.252 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2024-03-16T17:46:46.252 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.253 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.132,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on skipped message = False 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2024-03-16T17:46:46.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug trim objects = true 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2024-03-16T17:46:46.256 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: bdev async discard = True 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: bdev enable discard = True 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore allocator = bitmap 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 1/20 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 1/20 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-03-16T17:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 4/10 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-03-16T17:46:46.258 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-16T17:46:46.259 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2024-03-16T17:46:46.260 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = "" 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2024-03-16T17:46:46.261 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2024-03-16T17:46:46.262 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.263 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-03-16T17:46:46.264 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-03-16T17:46:46.265 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.132,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on skipped message = False 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = 6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.266 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-03-16T17:46:46.267 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: bdev async discard = True 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: bdev enable discard = True 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore allocator = bitmap 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-03-16T17:46:46.268 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-03-16T17:46:46.269 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.270 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: mon op complaint time = 120 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-16T17:46:46.271 INFO:teuthology.orchestra.run.smithi194.stdout: client mount timeout = 600 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = "" 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout:[mds] 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds = 20 2024-03-16T17:46:46.272 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds balancer = 20 2024-03-16T17:46:46.273 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-03-16T17:46:46.273 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug frag = True 2024-03-16T17:46:46.273 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug scatterstat = True 2024-03-16T17:46:46.273 INFO:teuthology.orchestra.run.smithi194.stdout: mds op complaint time = 180 2024-03-16T17:46:46.273 INFO:teuthology.orchestra.run.smithi194.stdout: mds verify scatter = True 2024-03-16T17:46:46.273 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2024-03-16T17:46:46.273 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2024-03-16T17:46:46.273 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2024-03-16T17:46:46.274 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-16T17:46:46.275 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-16T17:46:46.370 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-16T17:46:46.370 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:46.370 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-16T17:46:46.385 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:46.385 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-16T17:46:46.439 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2024-03-16T17:46:46.440 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:46.440 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-16T17:46:46.440 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-16T17:46:46.518 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:46:46.518 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:46:46.573 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-03-16T17:46:46.573 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:46:46.574 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-16T17:46:46.574 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-16T17:46:46.613 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:46:46.613 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:46:46.668 INFO:tasks.ceph:Setting up mon nodes... 2024-03-16T17:46:46.668 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-16T17:46:46.668 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-16T17:46:46.722 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-16T17:46:46.724 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-16T17:46:46.787 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-16T17:46:46.789 INFO:tasks.ceph:Setting up mds nodes... 2024-03-16T17:46:46.790 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-16T17:46:46.844 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-16T17:46:46.846 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-16T17:46:46.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-16T17:46:46.967 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-16T17:46:46.969 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-16T17:46:46.996 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-16T17:46:47.051 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-16T17:46:47.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-16T17:46:47.081 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-16T17:46:47.175 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-16T17:46:47.178 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-16T17:46:47.205 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-16T17:46:47.205 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-16T17:46:47.247 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-16T17:46:47.262 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-16T17:46:47.344 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-16T17:46:47.360 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-16T17:46:47.402 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-16T17:46:47.419 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-16T17:46:47.502 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-16T17:46:47.518 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-16T17:46:47.518 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-16T17:46:47.518 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-16T17:46:47.545 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-16T17:46:47.545 INFO:tasks.ceph:role: osd.0 2024-03-16T17:46:47.545 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-16T17:46:47.546 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-16T17:46:47.619 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T17:46:47.619 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T17:46:47.619 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T17:46:47.619 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T17:46:47.619 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T17:46:47.620 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-03-16T17:46:47.620 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T17:46:47.620 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T17:46:47.620 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T17:46:47.620 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T17:46:48.133 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-03-16T17:46:48.135 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-03-16T17:46:48.135 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-16T17:46:48.257 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-16T17:46:48.294 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-16T17:46:48.363 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-16T17:46:48.363 INFO:tasks.ceph:role: osd.1 2024-03-16T17:46:48.363 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-16T17:46:48.363 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-16T17:46:48.438 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T17:46:48.438 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T17:46:48.438 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T17:46:48.438 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T17:46:48.438 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T17:46:48.438 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-03-16T17:46:48.438 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T17:46:48.438 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T17:46:48.439 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T17:46:48.439 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T17:46:48.893 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-03-16T17:46:48.895 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-03-16T17:46:48.895 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-16T17:46:48.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-16T17:46:49.012 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-16T17:46:49.080 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-16T17:46:49.080 INFO:tasks.ceph:role: osd.2 2024-03-16T17:46:49.080 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-16T17:46:49.080 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-16T17:46:49.154 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T17:46:49.154 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T17:46:49.155 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T17:46:49.155 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T17:46:49.155 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T17:46:49.155 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-03-16T17:46:49.155 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T17:46:49.155 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T17:46:49.155 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T17:46:49.155 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T17:46:49.635 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-03-16T17:46:49.637 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-03-16T17:46:49.637 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-16T17:46:49.773 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-16T17:46:49.807 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-16T17:46:49.874 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-16T17:46:49.874 INFO:tasks.ceph:role: osd.3 2024-03-16T17:46:49.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2024-03-16T17:46:49.874 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-16T17:46:49.948 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T17:46:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T17:46:49.948 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T17:46:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T17:46:49.949 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T17:46:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-03-16T17:46:49.949 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T17:46:49.949 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T17:46:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T17:46:49.949 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T17:46:50.483 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-03-16T17:46:50.485 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-03-16T17:46:50.485 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-16T17:46:50.632 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-16T17:46:50.663 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:46:50.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:50.766+0000 7f4dcf824640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-16T17:46:50.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:50.767+0000 7f4dcf824640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-16T17:46:50.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:50.767+0000 7f4dcf824640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-16T17:46:50.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:50.767+0000 7f4dcf824640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-16T17:46:50.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:50.767+0000 7f4dcf824640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-16T17:46:50.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:50.767+0000 7f4dcf824640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-16T17:46:53.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-16T17:46:53.658 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:46:53.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:53.746+0000 7f58bbc48640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-16T17:46:53.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:53.746+0000 7f58bbc48640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-16T17:46:53.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:53.746+0000 7f58bbc48640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-16T17:46:53.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:53.746+0000 7f58bbc48640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-16T17:46:53.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:53.746+0000 7f58bbc48640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-16T17:46:53.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:53.747+0000 7f58bbc48640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-16T17:46:56.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-16T17:46:56.622 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:46:56.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:56.707+0000 7fa352945640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-16T17:46:56.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:56.707+0000 7fa352945640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-16T17:46:56.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:56.707+0000 7fa352945640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-16T17:46:56.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:56.707+0000 7fa352945640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-16T17:46:56.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:56.707+0000 7fa352945640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-16T17:46:56.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:56.707+0000 7fa352945640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-16T17:46:59.562 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-16T17:46:59.594 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:46:59.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:59.681+0000 7f75d0a19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-16T17:46:59.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:59.682+0000 7f75d0a19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-16T17:46:59.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:59.682+0000 7f75d0a19640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-16T17:46:59.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:59.682+0000 7f75d0a19640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-16T17:46:59.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:59.682+0000 7f75d0a19640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-16T17:46:59.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:46:59.682+0000 7f75d0a19640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-16T17:47:02.542 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-16T17:47:02.574 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-16T17:47:02.606 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-16T17:47:02.607 INFO:tasks.ceph:role: osd.4 2024-03-16T17:47:02.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-16T17:47:02.607 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-16T17:47:02.686 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T17:47:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T17:47:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T17:47:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T17:47:02.686 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T17:47:02.686 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-03-16T17:47:02.687 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T17:47:02.687 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T17:47:02.687 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T17:47:02.687 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T17:47:03.202 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-03-16T17:47:03.204 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-03-16T17:47:03.205 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-16T17:47:03.343 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-16T17:47:03.381 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-16T17:47:03.451 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-16T17:47:03.451 INFO:tasks.ceph:role: osd.5 2024-03-16T17:47:03.451 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-16T17:47:03.452 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-16T17:47:03.528 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T17:47:03.528 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T17:47:03.528 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T17:47:03.528 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T17:47:03.528 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T17:47:03.529 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-03-16T17:47:03.529 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T17:47:03.529 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T17:47:03.529 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T17:47:03.529 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T17:47:03.972 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-03-16T17:47:03.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-03-16T17:47:03.975 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-16T17:47:04.068 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-16T17:47:04.101 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-16T17:47:04.169 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-16T17:47:04.170 INFO:tasks.ceph:role: osd.6 2024-03-16T17:47:04.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-16T17:47:04.170 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-16T17:47:04.244 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T17:47:04.244 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T17:47:04.244 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T17:47:04.244 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T17:47:04.244 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T17:47:04.244 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-03-16T17:47:04.245 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T17:47:04.245 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T17:47:04.245 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T17:47:04.245 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T17:47:04.732 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-03-16T17:47:04.734 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-03-16T17:47:04.734 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-16T17:47:04.872 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-16T17:47:04.905 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-16T17:47:04.974 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-16T17:47:04.974 INFO:tasks.ceph:role: osd.7 2024-03-16T17:47:04.974 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-16T17:47:04.974 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-16T17:47:05.050 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-16T17:47:05.050 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-16T17:47:05.050 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-16T17:47:05.050 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-16T17:47:05.050 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-16T17:47:05.050 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-03-16T17:47:05.050 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-16T17:47:05.050 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-16T17:47:05.050 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-16T17:47:05.050 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-16T17:47:05.554 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-03-16T17:47:05.556 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-03-16T17:47:05.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-16T17:47:05.690 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-16T17:47:05.727 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:47:05.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:05.826+0000 7f12b75bd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-16T17:47:05.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:05.827+0000 7f12b75bd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-16T17:47:05.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:05.827+0000 7f12b75bd640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-16T17:47:05.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:05.827+0000 7f12b75bd640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-16T17:47:05.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:05.827+0000 7f12b75bd640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-16T17:47:05.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:05.829+0000 7f12b75bd640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-16T17:47:08.683 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-16T17:47:08.714 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:47:08.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:08.802+0000 7f1903bac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-16T17:47:08.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:08.802+0000 7f1903bac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-16T17:47:08.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:08.802+0000 7f1903bac640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-16T17:47:08.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:08.803+0000 7f1903bac640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-16T17:47:08.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:08.803+0000 7f1903bac640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-16T17:47:08.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:08.803+0000 7f1903bac640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-16T17:47:11.655 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-16T17:47:11.684 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:47:11.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:11.770+0000 7fda0f20c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-16T17:47:11.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:11.770+0000 7fda0f20c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-16T17:47:11.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:11.770+0000 7fda0f20c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-16T17:47:11.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:11.770+0000 7fda0f20c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-16T17:47:11.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:11.770+0000 7fda0f20c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-16T17:47:11.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:11.771+0000 7fda0f20c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-16T17:47:14.264 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:47:14.267 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:47:14.625 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-16T17:47:14.654 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:47:14.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:14.739+0000 7fd6cf119640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-16T17:47:14.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:14.739+0000 7fd6cf119640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-16T17:47:14.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:14.739+0000 7fd6cf119640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-16T17:47:14.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:14.739+0000 7fd6cf119640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-16T17:47:14.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:14.739+0000 7fd6cf119640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-16T17:47:14.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:14.740+0000 7fd6cf119640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-16T17:47:17.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-16T17:47:17.640 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-16T17:47:17.640 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:17.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-16T17:47:17.672 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:17.672 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-16T17:47:17.742 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:17.742 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-16T17:47:17.811 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:17.811 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-16T17:47:17.879 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:17.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-16T17:47:17.947 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:17.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-16T17:47:18.015 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:18.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-16T17:47:18.082 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:18.083 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-16T17:47:18.115 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:18.115 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-16T17:47:18.185 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:18.185 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-16T17:47:18.254 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:18.255 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-16T17:47:18.323 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:18.323 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-16T17:47:18.391 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:18.391 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-16T17:47:18.459 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:18.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-16T17:47:18.526 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:18.526 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-16T17:47:18.542 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:18.542 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-16T17:47:18.598 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:18.598 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-16T17:47:18.613 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:18.613 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-16T17:47:18.668 INFO:tasks.ceph:Adding keys to all mons... 2024-03-16T17:47:18.668 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-16T17:47:18.670 DEBUG:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-16T17:47:18.711 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2024-03-16T17:47:18.711 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAG2/Vl3wfpKhAACbfV/dKzpQddP7WTLy72NQ== 2024-03-16T17:47:18.711 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-03-16T17:47:18.711 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAG2/Vl4CMuMhAA9NdmGeYftVEVAbhCUJEidQ== 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAG2/VllOKCORAAagGjMzQ38qanc7gww2ypjA== 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAK2/VlkXDDLRAAZsQioGChlGJYXuY89ZhxgQ== 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAN2/Vl456ILBAA5SLwljrQp+Hge43FsLw4YQ== 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAQ2/VltJY0KhAATV2W2h7iHcLZzGl+nbhmQg== 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAT2/VlV0KzKBAAYzKEfhcEEtzwjsGllQpH9w== 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAG2/VldSPJLhAAjCTDFBzvptOviE7g+oKXyw== 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2024-03-16T17:47:18.712 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAH2/Vl9pbpAhAAa6NQnLmbmJIvZPf4jn1sLg== 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAH2/Vlr9pWChAAqXDm8Tb9n2kZ/Dg/OzN3CQ== 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAZ2/VlcJBaMRAAAdupT2n2z53jLy+zmzaJ6Q== 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAc2/Vla03nLxAAMgPqF1hNrj9lwVDvG2IbAA== 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAf2/VlVtT8LRAA7RAWt4BbJMSu+hJzHG/X2w== 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAi2/VlnSwlLBAAn1wtfnD32HpNiEnauLgsqg== 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAH2/VlI+SXDhAAVkJdiLaLBWETaZXg7PjHcA== 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout:[client.2] 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAH2/VlGStpFBAAMVVAIc0oS3PA+J8JDjOrHQ== 2024-03-16T17:47:18.713 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2024-03-16T17:47:18.714 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAH2/Vl2EzeFxAA7n8FBuJF7nyUn+tUcScuVA== 2024-03-16T17:47:18.714 INFO:teuthology.orchestra.run.smithi132.stdout:[client.3] 2024-03-16T17:47:18.714 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAH2/VlKz3HHRAAwpGVMTcNVWyLF7Ns40dIZQ== 2024-03-16T17:47:18.733 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2024-03-16T17:47:18.733 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAG2/Vl3wfpKhAACbfV/dKzpQddP7WTLy72NQ== 2024-03-16T17:47:18.733 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAG2/Vl4CMuMhAA9NdmGeYftVEVAbhCUJEidQ== 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAG2/VllOKCORAAagGjMzQ38qanc7gww2ypjA== 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAK2/VlkXDDLRAAZsQioGChlGJYXuY89ZhxgQ== 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAN2/Vl456ILBAA5SLwljrQp+Hge43FsLw4YQ== 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAQ2/VltJY0KhAATV2W2h7iHcLZzGl+nbhmQg== 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAT2/VlV0KzKBAAYzKEfhcEEtzwjsGllQpH9w== 2024-03-16T17:47:18.734 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAG2/VldSPJLhAAjCTDFBzvptOviE7g+oKXyw== 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAH2/Vl9pbpAhAAa6NQnLmbmJIvZPf4jn1sLg== 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAH2/Vlr9pWChAAqXDm8Tb9n2kZ/Dg/OzN3CQ== 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAZ2/VlcJBaMRAAAdupT2n2z53jLy+zmzaJ6Q== 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAc2/Vla03nLxAAMgPqF1hNrj9lwVDvG2IbAA== 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAf2/VlVtT8LRAA7RAWt4BbJMSu+hJzHG/X2w== 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAi2/VlnSwlLBAAn1wtfnD32HpNiEnauLgsqg== 2024-03-16T17:47:18.735 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2024-03-16T17:47:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAH2/VlI+SXDhAAVkJdiLaLBWETaZXg7PjHcA== 2024-03-16T17:47:18.736 INFO:teuthology.orchestra.run.smithi194.stdout:[client.2] 2024-03-16T17:47:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAH2/VlGStpFBAAMVVAIc0oS3PA+J8JDjOrHQ== 2024-03-16T17:47:18.736 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2024-03-16T17:47:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAH2/Vl2EzeFxAA7n8FBuJF7nyUn+tUcScuVA== 2024-03-16T17:47:18.736 INFO:teuthology.orchestra.run.smithi194.stdout:[client.3] 2024-03-16T17:47:18.736 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAH2/VlKz3HHRAAwpGVMTcNVWyLF7Ns40dIZQ== 2024-03-16T17:47:18.737 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-16T17:47:18.758 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-16T17:47:18.828 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T17:47:18.831 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T17:47:18.885 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T17:47:18.887 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T17:47:18.941 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:18.943 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:18.995 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:18.998 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.049 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.103 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.105 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.156 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-16T17:47:19.158 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-16T17:47:19.210 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T17:47:19.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T17:47:19.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T17:47:19.269 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-16T17:47:19.323 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.326 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.377 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.379 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.434 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.485 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.488 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-16T17:47:19.539 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T17:47:19.544 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T17:47:19.598 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T17:47:19.600 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T17:47:19.655 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T17:47:19.657 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T17:47:19.711 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T17:47:19.714 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-16T17:47:19.768 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-16T17:47:19.768 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-16T17:47:19.795 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-16T17:47:19.892 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-16T17:47:19.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-16T17:47:19.946 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-16T17:47:20.043 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-16T17:47:20.070 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-16T17:47:20.137 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-16T17:47:20.234 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-16T17:47:20.260 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:47:20.262 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-16T17:47:20.315 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-16T17:47:20.315 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-16T17:47:20.315 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-16T17:47:20.317 INFO:tasks.ceph.mon.a:Started 2024-03-16T17:47:20.317 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-16T17:47:20.317 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-16T17:47:20.357 INFO:tasks.ceph.mon.b:Started 2024-03-16T17:47:20.358 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-16T17:47:20.358 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-16T17:47:20.360 INFO:tasks.ceph.mon.c:Started 2024-03-16T17:47:20.360 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-16T17:47:20.360 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-16T17:47:20.360 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-16T17:47:20.362 INFO:tasks.ceph.mgr.y:Started 2024-03-16T17:47:20.362 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-16T17:47:20.362 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-16T17:47:20.364 INFO:tasks.ceph.mgr.x:Started 2024-03-16T17:47:20.364 INFO:tasks.ceph:Setting crush tunables to default 2024-03-16T17:47:20.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd crush tunables default 2024-03-16T17:47:20.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.460+0000 7f0d966d4640 1 Processor -- start 2024-03-16T17:47:20.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.460+0000 7f0d966d4640 1 -- start start 2024-03-16T17:47:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d966d4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d966d4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d966d4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d90162820 con 0x7f0d900b4180 2024-03-16T17:47:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d966d4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9006b890 con 0x7f0d9006aee0 2024-03-16T17:47:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d966d4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d901668b0 con 0x7f0d90165e10 2024-03-16T17:47:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d94c71640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d94c71640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:32966/0 (socket says 172.21.15.132:32966) 2024-03-16T17:47:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d94c71640 1 -- 172.21.15.132:0/156926570 learned_addr learned my addr 172.21.15.132:0/156926570 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d94c71640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 msgr2=0x7f0d9006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-16T17:47:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d94c71640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 msgr2=0x7f0d9006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T17:47:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.461+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.462+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 msgr2=0x7f0d90166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-16T17:47:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.462+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 msgr2=0x7f0d90166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.462+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.462+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T17:47:20.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.663+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:20.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.663+0000 7f0d94c71640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 msgr2=0x7f0d9006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-16T17:47:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.663+0000 7f0d94c71640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 msgr2=0x7f0d9006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.663+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.663+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T17:47:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.663+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.663+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 msgr2=0x7f0d90166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-16T17:47:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.663+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 msgr2=0x7f0d90166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.663+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:20.663+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T17:47:21.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.064+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:21.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.064+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:21.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.064+0000 7f0d94c71640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 msgr2=0x7f0d9006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-16T17:47:21.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.064+0000 7f0d94c71640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 msgr2=0x7f0d9006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:21.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.064+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:21.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.064+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-16T17:47:21.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.064+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 msgr2=0x7f0d90166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-16T17:47:21.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.064+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 msgr2=0x7f0d90166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:21.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.064+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:21.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.064+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-16T17:47:21.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.866+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:21.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.866+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:21.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.866+0000 7f0d94c71640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 msgr2=0x7f0d9006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-16T17:47:21.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.866+0000 7f0d94c71640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 msgr2=0x7f0d9006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:21.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.866+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:21.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.866+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-16T17:47:21.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.866+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 msgr2=0x7f0d90166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-16T17:47:21.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.866+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 msgr2=0x7f0d90166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:21.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.866+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:21.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:21.866+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-16T17:47:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.461+0000 7f0d8dffb640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 msgr2=0x7f0d90166290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T17:47:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.461+0000 7f0d8dffb640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d90166290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.461+0000 7f0d8dffb640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 msgr2=0x7f0d9006b350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T17:47:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.461+0000 7f0d8dffb640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.132:3300/0 conn(0x7f0d9006aee0 0x7f0d9006b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.461+0000 7f0d8dffb640 1 -- 172.21.15.132:0/156926570 >> v1:172.21.15.194:6789/0 conn(0x7f0d900b4180 legacy=0x7f0d901632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.461+0000 7f0d8dffb640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.461+0000 7f0d8dffb640 1 -- 172.21.15.132:0/156926570 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d90166b90 con 0x7f0d7c0036a0 2024-03-16T17:47:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.461+0000 7f0d8dffb640 1 -- 172.21.15.132:0/156926570 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9006b890 con 0x7f0d7c007350 2024-03-16T17:47:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.462+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.462+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 msgr2=0x7f0d7c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-16T17:47:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.462+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 msgr2=0x7f0d7c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.462+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.462+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-16T17:47:23.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.663+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:23.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.663+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 msgr2=0x7f0d7c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-16T17:47:23.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.663+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 msgr2=0x7f0d7c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:23.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.663+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:23.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:23.663+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-16T17:47:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:24.064+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:24.064+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 msgr2=0x7f0d7c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-16T17:47:24.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:24.064+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 msgr2=0x7f0d7c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:24.064+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:24.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:24.064+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-16T17:47:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:24.866+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:24.866+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 msgr2=0x7f0d7c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-16T17:47:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:24.866+0000 7f0d8f7fe640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 msgr2=0x7f0d7c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-16T17:47:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:24.866+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-16T17:47:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:24.866+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-16T17:47:25.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.678+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586440731 0 0) 0x7f0d90166b90 con 0x7f0d7c0036a0 2024-03-16T17:47:25.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.678+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d78003520 con 0x7f0d7c0036a0 2024-03-16T17:47:25.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3887864684 0 0) 0x7f0d78003520 con 0x7f0d7c0036a0 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 msgr2=0x7f0d7c009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 --2- 172.21.15.132:0/156926570 >> v2:172.21.15.194:3300/0 conn(0x7f0d7c007350 0x7f0d7c009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c00af10 con 0x7f0d7c0036a0 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f0d80001710 con 0x7f0d7c0036a0 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 >> v1:172.21.15.132:6789/0 conn(0x7f0d7c0036a0 legacy=0x7f0d7c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d94c71640 1 -- 172.21.15.132:0/156926570 reap_dead start 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d78003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d78003fd0 0x7f0d780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78004d50 0x7f0d780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9006b890 con 0x7f0d78003fd0 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7800bc60 con 0x7f0d78004d50 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7800be20 con 0x7f0d90165e10 2024-03-16T17:47:25.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8ffff640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d78003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:25.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d8f7fe640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d78003fd0 0x7f0d780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:25.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.679+0000 7f0d94c71640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78004d50 0x7f0d780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:25.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.680+0000 7f0d8ffff640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78004d50 msgr2=0x7f0d780051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:25.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.680+0000 7f0d8ffff640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78004d50 0x7f0d780051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.680+0000 7f0d8ffff640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d78003fd0 msgr2=0x7f0d780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:25.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.680+0000 7f0d8ffff640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d78003fd0 0x7f0d780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.680+0000 7f0d8ffff640 1 -- 172.21.15.132:0/156926570 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d78003520 con 0x7f0d90165e10 2024-03-16T17:47:25.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.681+0000 7f0d8ffff640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d78003970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d80001eb0 tx=0x7f0d780057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=328006db9c85050c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:25.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.684+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80005270 con 0x7f0d90165e10 2024-03-16T17:47:25.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.685+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d800053d0 con 0x7f0d90165e10 2024-03-16T17:47:25.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.685+0000 7f0d8effd640 1 -- 172.21.15.132:0/156926570 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8002c990 con 0x7f0d90165e10 2024-03-16T17:47:25.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.686+0000 7f0d966d4640 1 -- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 msgr2=0x7f0d78003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:25.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.686+0000 7f0d966d4640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d78003970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d80001eb0 tx=0x7f0d780057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.686+0000 7f0d966d4640 1 -- 172.21.15.132:0/156926570 shutdown_connections 2024-03-16T17:47:25.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.686+0000 7f0d966d4640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78004d50 0x7f0d780051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.686+0000 7f0d966d4640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d78003fd0 0x7f0d780047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.686+0000 7f0d966d4640 1 --2- 172.21.15.132:0/156926570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d90165e10 0x7f0d78003970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.686+0000 7f0d966d4640 1 -- 172.21.15.132:0/156926570 >> 172.21.15.132:0/156926570 conn(0x7f0d9006bff0 msgr2=0x7f0d9006c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:25.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.686+0000 7f0d966d4640 1 -- 172.21.15.132:0/156926570 shutdown_connections 2024-03-16T17:47:25.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.686+0000 7f0d966d4640 1 -- 172.21.15.132:0/156926570 wait complete. 2024-03-16T17:47:25.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.687+0000 7f0d966d4640 1 Processor -- start 2024-03-16T17:47:25.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.688+0000 7f0d966d4640 1 -- start start 2024-03-16T17:47:25.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d966d4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78003fd0 0x7f0d90139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:25.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d966d4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d78004d50 0x7f0d9014a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:25.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d966d4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d90165e10 0x7f0d900b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:25.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d966d4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900b0630 con 0x7f0d90165e10 2024-03-16T17:47:25.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d966d4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900b3560 con 0x7f0d78003fd0 2024-03-16T17:47:25.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d966d4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900b08f0 con 0x7f0d78004d50 2024-03-16T17:47:25.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d94c71640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d90165e10 0x7f0d900b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:25.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d8f7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d78004d50 0x7f0d9014a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:25.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d8ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78003fd0 0x7f0d90139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:25.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d94c71640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d90165e10 0x7f0d900b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33074/0 (socket says 172.21.15.132:33074) 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d94c71640 1 -- 172.21.15.132:0/1996640573 learned_addr learned my addr 172.21.15.132:0/1996640573 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d94c71640 1 -- 172.21.15.132:0/1996640573 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d78004d50 msgr2=0x7f0d9014a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d94c71640 1 --2- 172.21.15.132:0/1996640573 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d78004d50 0x7f0d9014a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d94c71640 1 -- 172.21.15.132:0/1996640573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78003fd0 msgr2=0x7f0d90139bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d94c71640 1 --2- 172.21.15.132:0/1996640573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78003fd0 0x7f0d90139bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d94c71640 1 -- 172.21.15.132:0/1996640573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d900b0bd0 con 0x7f0d90165e10 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.689+0000 7f0d8ffff640 1 --2- 172.21.15.132:0/1996640573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78003fd0 0x7f0d90139bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.690+0000 7f0d94c71640 1 --2- 172.21.15.132:0/1996640573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d90165e10 0x7f0d900b2c50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009440 tx=0x7f0d88015de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.690+0000 7f0d8cff9640 1 -- 172.21.15.132:0/1996640573 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88003ba0 con 0x7f0d90165e10 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.690+0000 7f0d8cff9640 1 -- 172.21.15.132:0/1996640573 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8800f040 con 0x7f0d90165e10 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.690+0000 7f0d966d4640 1 -- 172.21.15.132:0/1996640573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d900b0eb0 con 0x7f0d90165e10 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.690+0000 7f0d8cff9640 1 -- 172.21.15.132:0/1996640573 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88013920 con 0x7f0d90165e10 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.690+0000 7f0d966d4640 1 -- 172.21.15.132:0/1996640573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d900b3190 con 0x7f0d90165e10 2024-03-16T17:47:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.690+0000 7f0d8cff9640 1 -- 172.21.15.132:0/1996640573 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0d88013a80 con 0x7f0d90165e10 2024-03-16T17:47:25.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.690+0000 7f0d8cff9640 1 -- 172.21.15.132:0/1996640573 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0d880218c0 con 0x7f0d90165e10 2024-03-16T17:47:25.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.691+0000 7f0d966d4640 1 -- 172.21.15.132:0/1996640573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d900b10d0 con 0x7f0d90165e10 2024-03-16T17:47:25.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.695+0000 7f0d8cff9640 1 -- 172.21.15.132:0/1996640573 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0d8801c070 con 0x7f0d90165e10 2024-03-16T17:47:25.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.761+0000 7f0d966d4640 1 -- 172.21.15.132:0/1996640573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0d9004f2c0 con 0x7f0d90165e10 2024-03-16T17:47:25.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.763+0000 7f0d8cff9640 1 -- 172.21.15.132:0/1996640573 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0d8802f090 con 0x7f0d90165e10 2024-03-16T17:47:25.767 INFO:teuthology.orchestra.run.smithi132.stderr:adjusted tunables profile to default 2024-03-16T17:47:25.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.764+0000 7f0d966d4640 1 -- 172.21.15.132:0/1996640573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d90165e10 msgr2=0x7f0d900b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:25.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.764+0000 7f0d966d4640 1 --2- 172.21.15.132:0/1996640573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d90165e10 0x7f0d900b2c50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009440 tx=0x7f0d88015de0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.764+0000 7f0d966d4640 1 -- 172.21.15.132:0/1996640573 shutdown_connections 2024-03-16T17:47:25.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.764+0000 7f0d966d4640 1 --2- 172.21.15.132:0/1996640573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d90165e10 0x7f0d900b2c50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.764+0000 7f0d966d4640 1 --2- 172.21.15.132:0/1996640573 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d78004d50 0x7f0d9014a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.764+0000 7f0d966d4640 1 --2- 172.21.15.132:0/1996640573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d78003fd0 0x7f0d90139bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:25.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.764+0000 7f0d966d4640 1 -- 172.21.15.132:0/1996640573 >> 172.21.15.132:0/1996640573 conn(0x7f0d9006bff0 msgr2=0x7f0d900d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:25.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.765+0000 7f0d966d4640 1 -- 172.21.15.132:0/1996640573 shutdown_connections 2024-03-16T17:47:25.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:25.765+0000 7f0d966d4640 1 -- 172.21.15.132:0/1996640573 wait complete. 2024-03-16T17:47:25.780 INFO:tasks.ceph:check_enable_crimson: False 2024-03-16T17:47:25.780 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-16T17:47:25.781 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:25.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-16T17:47:25.810 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:25.810 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-16T17:47:25.877 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:25.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-16T17:47:25.944 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:47:25.944 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-16T17:47:26.012 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:26.012 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-16T17:47:26.039 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:26.039 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-16T17:47:26.106 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:26.106 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-16T17:47:26.173 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:47:26.173 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-16T17:47:26.176 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:26.174+0000 7f611ee4c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T17:47:26.182 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:26.178+0000 7f97a1232040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-16T17:47:26.208 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new dc3dbe63-eadb-4a7b-bb62-4659f908734c 0 2024-03-16T17:47:26.230 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:26.227+0000 7f611ee4c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T17:47:26.238 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:26.235+0000 7f97a1232040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-16T17:47:26.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.335+0000 7f22d1afa640 1 Processor -- start 2024-03-16T17:47:26.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.335+0000 7f22d1afa640 1 -- start start 2024-03-16T17:47:26.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.335+0000 7f22d1afa640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc15ba80 0x7f22cc15eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.335+0000 7f22d1afa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc162460 con 0x7f22cc0b4160 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.335+0000 7f22d1afa640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc162740 con 0x7f22cc161a10 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.335+0000 7f22d1afa640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc15be60 con 0x7f22cc15ba80 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.335+0000 7f22cb7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc15ba80 0x7f22cc15eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.335+0000 7f22caffd640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f22cc161a10 0x7f22cc0b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:46094/0 (socket says 172.21.15.194:46094) 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.336+0000 7f22caffd640 1 -- 172.21.15.194:0/2032212691 learned_addr learned my addr 172.21.15.194:0/2032212691 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.336+0000 7f22ca7fc640 1 -- 172.21.15.194:0/2032212691 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420031094 0 0) 0x7f22cc162740 con 0x7f22cc161a10 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.336+0000 7f22ca7fc640 1 -- 172.21.15.194:0/2032212691 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b4003520 con 0x7f22cc161a10 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.336+0000 7f22cb7fe640 1 -- 172.21.15.194:0/2032212691 >> v1:172.21.15.194:6789/0 conn(0x7f22cc161a10 legacy=0x7f22cc0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.336+0000 7f22cb7fe640 1 -- 172.21.15.194:0/2032212691 >> v1:172.21.15.132:6789/0 conn(0x7f22cc0b4160 legacy=0x7f22cc06ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.336+0000 7f22cb7fe640 1 -- 172.21.15.194:0/2032212691 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc15e6e0 con 0x7f22cc15ba80 2024-03-16T17:47:26.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22cb7fe640 1 --2- 172.21.15.194:0/2032212691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc15ba80 0x7f22cc15eee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0097d0 tx=0x7f22bc02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=361844860e159ee server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:26.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22ca7fc640 1 -- 172.21.15.194:0/2032212691 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc031800 con 0x7f22cc15ba80 2024-03-16T17:47:26.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22ca7fc640 1 -- 172.21.15.194:0/2032212691 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc031960 con 0x7f22cc15ba80 2024-03-16T17:47:26.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22ca7fc640 1 -- 172.21.15.194:0/2032212691 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc031cf0 con 0x7f22cc15ba80 2024-03-16T17:47:26.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22d1afa640 1 -- 172.21.15.194:0/2032212691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc15ba80 msgr2=0x7f22cc15eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22d1afa640 1 --2- 172.21.15.194:0/2032212691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc15ba80 0x7f22cc15eee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0097d0 tx=0x7f22bc02b8a0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22d1afa640 1 -- 172.21.15.194:0/2032212691 shutdown_connections 2024-03-16T17:47:26.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22d1afa640 1 --2- 172.21.15.194:0/2032212691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc15ba80 0x7f22cc15eee0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22d1afa640 1 -- 172.21.15.194:0/2032212691 >> 172.21.15.194:0/2032212691 conn(0x7f22cc06bff0 msgr2=0x7f22cc06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:26.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22d1afa640 1 -- 172.21.15.194:0/2032212691 shutdown_connections 2024-03-16T17:47:26.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.337+0000 7f22d1afa640 1 -- 172.21.15.194:0/2032212691 wait complete. 2024-03-16T17:47:26.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.338+0000 7f22d1afa640 1 Processor -- start 2024-03-16T17:47:26.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22d1afa640 1 -- start start 2024-03-16T17:47:26.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22d1afa640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc0b4160 0x7f22cc15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22d1afa640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22cc15ba80 0x7f22cc14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22d1afa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22cc161a10 0x7f22cc0b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22d1afa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc15c800 con 0x7f22cc161a10 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22d1afa640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc15cae0 con 0x7f22cc15ba80 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22d1afa640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc15cdc0 con 0x7f22cc0b4160 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22caffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22cc15ba80 0x7f22cc14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22cb7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc0b4160 0x7f22cc15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22cb7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc0b4160 0x7f22cc15bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:37114/0 (socket says 172.21.15.194:37114) 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22caffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22cc15ba80 0x7f22cc14b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59828/0 (socket says 172.21.15.194:59828) 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.339+0000 7f22cb7fe640 1 -- 172.21.15.194:0/851015957 learned_addr learned my addr 172.21.15.194:0/851015957 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22cbfff640 1 --2- 172.21.15.194:0/851015957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22cc161a10 0x7f22cc0b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22caffd640 1 -- 172.21.15.194:0/851015957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc0b4160 msgr2=0x7f22cc15bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22caffd640 1 --2- 172.21.15.194:0/851015957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc0b4160 0x7f22cc15bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22caffd640 1 -- 172.21.15.194:0/851015957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22cc161a10 msgr2=0x7f22cc0b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22caffd640 1 --2- 172.21.15.194:0/851015957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22cc161a10 0x7f22cc0b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22caffd640 1 -- 172.21.15.194:0/851015957 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc009400 con 0x7f22cc15ba80 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22cb7fe640 1 --2- 172.21.15.194:0/851015957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc0b4160 0x7f22cc15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22caffd640 1 --2- 172.21.15.194:0/851015957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22cc15ba80 0x7f22cc14b560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f22c000c430 tx=0x7f22c000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22b3fff640 1 -- 172.21.15.194:0/851015957 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0005ce0 con 0x7f22cc15ba80 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22b3fff640 1 -- 172.21.15.194:0/851015957 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c0005e40 con 0x7f22cc15ba80 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22b3fff640 1 -- 172.21.15.194:0/851015957 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c00072d0 con 0x7f22cc15ba80 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22d1afa640 1 -- 172.21.15.194:0/851015957 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc15d0a0 con 0x7f22cc15ba80 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22d1afa640 1 -- 172.21.15.194:0/851015957 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc15c4f0 con 0x7f22cc15ba80 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22b3fff640 1 -- 172.21.15.194:0/851015957 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f22c0007430 con 0x7f22cc15ba80 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.340+0000 7f22b3fff640 1 -- 172.21.15.194:0/851015957 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f22c0012810 con 0x7f22cc15ba80 2024-03-16T17:47:26.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.341+0000 7f22d1afa640 1 -- 172.21.15.194:0/851015957 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc0734e0 con 0x7f22cc15ba80 2024-03-16T17:47:26.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.343+0000 7f22b3fff640 1 -- 172.21.15.194:0/851015957 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f22c0021060 con 0x7f22cc15ba80 2024-03-16T17:47:26.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.415+0000 7f22d1afa640 1 -- 172.21.15.194:0/851015957 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dc3dbe63-eadb-4a7b-bb62-4659f908734c", "id": 0} v 0) v1 -- 0x7f22cc06f840 con 0x7f22cc15ba80 2024-03-16T17:47:26.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.419+0000 7f22b3fff640 1 -- 172.21.15.194:0/851015957 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc3dbe63-eadb-4a7b-bb62-4659f908734c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f22c0017070 con 0x7f22cc15ba80 2024-03-16T17:47:26.423 INFO:teuthology.orchestra.run.smithi194.stdout:0 2024-03-16T17:47:26.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.420+0000 7f22d1afa640 1 -- 172.21.15.194:0/851015957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22cc15ba80 msgr2=0x7f22cc14b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.420+0000 7f22d1afa640 1 --2- 172.21.15.194:0/851015957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22cc15ba80 0x7f22cc14b560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f22c000c430 tx=0x7f22c000c8f0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.420+0000 7f22d1afa640 1 -- 172.21.15.194:0/851015957 shutdown_connections 2024-03-16T17:47:26.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.420+0000 7f22d1afa640 1 --2- 172.21.15.194:0/851015957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22cc161a10 0x7f22cc0b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.420+0000 7f22d1afa640 1 --2- 172.21.15.194:0/851015957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22cc15ba80 0x7f22cc14b560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.420+0000 7f22d1afa640 1 --2- 172.21.15.194:0/851015957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22cc0b4160 0x7f22cc15bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.420+0000 7f22d1afa640 1 -- 172.21.15.194:0/851015957 >> 172.21.15.194:0/851015957 conn(0x7f22cc06bff0 msgr2=0x7f22cc0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:26.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.420+0000 7f22d1afa640 1 -- 172.21.15.194:0/851015957 shutdown_connections 2024-03-16T17:47:26.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.420+0000 7f22d1afa640 1 -- 172.21.15.194:0/851015957 wait complete. 2024-03-16T17:47:26.434 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new e9e236e1-da95-470c-862f-21ec1b3a2cfb 1 2024-03-16T17:47:26.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.530+0000 7fddd66ae640 1 Processor -- start 2024-03-16T17:47:26.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.530+0000 7fddd66ae640 1 -- start start 2024-03-16T17:47:26.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.531+0000 7fddd66ae640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015bce0 0x7fddd015c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.531+0000 7fddd66ae640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd015c140 con 0x7fddd015c8d0 2024-03-16T17:47:26.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.531+0000 7fddd66ae640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd015f0c0 con 0x7fddd015b900 2024-03-16T17:47:26.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.531+0000 7fddd66ae640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd015eed0 con 0x7fddd015bce0 2024-03-16T17:47:26.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.531+0000 7fddcf7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015bce0 0x7fddd015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.531+0000 7fddcffff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fddd015b900 0x7fddd015e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:46104/0 (socket says 172.21.15.194:46104) 2024-03-16T17:47:26.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.531+0000 7fddcffff640 1 -- 172.21.15.194:0/600504511 learned_addr learned my addr 172.21.15.194:0/600504511 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-16T17:47:26.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.531+0000 7fddcf7fe640 1 -- 172.21.15.194:0/600504511 >> v1:172.21.15.194:6789/0 conn(0x7fddd015b900 legacy=0x7fddd015e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.531+0000 7fddcf7fe640 1 -- 172.21.15.194:0/600504511 >> v1:172.21.15.132:6789/0 conn(0x7fddd015c8d0 legacy=0x7fddd006f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:26.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.531+0000 7fddcf7fe640 1 -- 172.21.15.194:0/600504511 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd015f3a0 con 0x7fddd015bce0 2024-03-16T17:47:26.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.532+0000 7fddcf7fe640 1 --2- 172.21.15.194:0/600504511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015bce0 0x7fddd015c390 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fddc00097d0 tx=0x7fddc002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82c6680354cd0e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:26.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.532+0000 7fddceffd640 1 -- 172.21.15.194:0/600504511 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0031800 con 0x7fddd015bce0 2024-03-16T17:47:26.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.532+0000 7fddceffd640 1 -- 172.21.15.194:0/600504511 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc0031960 con 0x7fddd015bce0 2024-03-16T17:47:26.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.532+0000 7fddceffd640 1 -- 172.21.15.194:0/600504511 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0031cf0 con 0x7fddd015bce0 2024-03-16T17:47:26.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.533+0000 7fddd66ae640 1 -- 172.21.15.194:0/600504511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015bce0 msgr2=0x7fddd015c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.533+0000 7fddd66ae640 1 --2- 172.21.15.194:0/600504511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015bce0 0x7fddd015c390 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fddc00097d0 tx=0x7fddc002b8a0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.533+0000 7fddd66ae640 1 -- 172.21.15.194:0/600504511 shutdown_connections 2024-03-16T17:47:26.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.533+0000 7fddd66ae640 1 --2- 172.21.15.194:0/600504511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015bce0 0x7fddd015c390 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.533+0000 7fddd66ae640 1 -- 172.21.15.194:0/600504511 >> 172.21.15.194:0/600504511 conn(0x7fddd006bff0 msgr2=0x7fddd006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:26.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.533+0000 7fddd66ae640 1 -- 172.21.15.194:0/600504511 shutdown_connections 2024-03-16T17:47:26.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.533+0000 7fddd66ae640 1 -- 172.21.15.194:0/600504511 wait complete. 2024-03-16T17:47:26.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.534+0000 7fddd66ae640 1 Processor -- start 2024-03-16T17:47:26.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.534+0000 7fddd66ae640 1 -- start start 2024-03-16T17:47:26.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd66ae640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd015b900 0x7fddd013d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd66ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd015bce0 0x7fddd0155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd66ae640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015c8d0 0x7fddd0155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd66ae640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00d0750 con 0x7fddd015bce0 2024-03-16T17:47:26.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd66ae640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd013db90 con 0x7fddd015b900 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd66ae640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00cfb40 con 0x7fddd015c8d0 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddcffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd015b900 0x7fddd013d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd4c4b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015c8d0 0x7fddd0155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd4c4b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015c8d0 0x7fddd0155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:37136/0 (socket says 172.21.15.194:37136) 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd4c4b640 1 -- 172.21.15.194:0/2152885066 learned_addr learned my addr 172.21.15.194:0/2152885066 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddcffff640 1 --2- 172.21.15.194:0/2152885066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd015b900 0x7fddd013d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59830/0 (socket says 172.21.15.194:59830) 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddcf7fe640 1 --2- 172.21.15.194:0/2152885066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd015bce0 0x7fddd0155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd4c4b640 1 -- 172.21.15.194:0/2152885066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd015b900 msgr2=0x7fddd013d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd4c4b640 1 --2- 172.21.15.194:0/2152885066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd015b900 0x7fddd013d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd4c4b640 1 -- 172.21.15.194:0/2152885066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd015bce0 msgr2=0x7fddd0155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd4c4b640 1 --2- 172.21.15.194:0/2152885066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd015bce0 0x7fddd0155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd4c4b640 1 -- 172.21.15.194:0/2152885066 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc0009400 con 0x7fddd015c8d0 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd4c4b640 1 --2- 172.21.15.194:0/2152885066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015c8d0 0x7fddd0155dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fddc800ca50 tx=0x7fddc800cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:26.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddccff9640 1 -- 172.21.15.194:0/2152885066 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc80088c0 con 0x7fddd015c8d0 2024-03-16T17:47:26.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddccff9640 1 -- 172.21.15.194:0/2152885066 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc8008a40 con 0x7fddd015c8d0 2024-03-16T17:47:26.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddd66ae640 1 -- 172.21.15.194:0/2152885066 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd00cfe20 con 0x7fddd015c8d0 2024-03-16T17:47:26.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.535+0000 7fddccff9640 1 -- 172.21.15.194:0/2152885066 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8008df0 con 0x7fddd015c8d0 2024-03-16T17:47:26.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.536+0000 7fddd66ae640 1 -- 172.21.15.194:0/2152885066 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd00d03e0 con 0x7fddd015c8d0 2024-03-16T17:47:26.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.536+0000 7fddccff9640 1 -- 172.21.15.194:0/2152885066 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fddc8008f50 con 0x7fddd015c8d0 2024-03-16T17:47:26.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.536+0000 7fddccff9640 1 -- 172.21.15.194:0/2152885066 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fddc8014780 con 0x7fddd015c8d0 2024-03-16T17:47:26.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.536+0000 7fddd66ae640 1 -- 172.21.15.194:0/2152885066 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd0073580 con 0x7fddd015c8d0 2024-03-16T17:47:26.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.539+0000 7fddccff9640 1 -- 172.21.15.194:0/2152885066 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fddc8019070 con 0x7fddd015c8d0 2024-03-16T17:47:26.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.611+0000 7fddd66ae640 1 -- 172.21.15.194:0/2152885066 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e9e236e1-da95-470c-862f-21ec1b3a2cfb", "id": 1} v 0) v1 -- 0x7fddd004f330 con 0x7fddd015c8d0 2024-03-16T17:47:26.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.614+0000 7fddccff9640 1 -- 172.21.15.194:0/2152885066 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9e236e1-da95-470c-862f-21ec1b3a2cfb", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fddc8014b40 con 0x7fddd015c8d0 2024-03-16T17:47:26.618 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-03-16T17:47:26.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.615+0000 7fddd66ae640 1 -- 172.21.15.194:0/2152885066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015c8d0 msgr2=0x7fddd0155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.615+0000 7fddd66ae640 1 --2- 172.21.15.194:0/2152885066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015c8d0 0x7fddd0155dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fddc800ca50 tx=0x7fddc800cf10 comp rx=0 tx=0).stop 2024-03-16T17:47:26.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.615+0000 7fddd66ae640 1 -- 172.21.15.194:0/2152885066 shutdown_connections 2024-03-16T17:47:26.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.615+0000 7fddd66ae640 1 --2- 172.21.15.194:0/2152885066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddd015c8d0 0x7fddd0155dd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.615+0000 7fddd66ae640 1 --2- 172.21.15.194:0/2152885066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd015bce0 0x7fddd0155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.615+0000 7fddd66ae640 1 --2- 172.21.15.194:0/2152885066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd015b900 0x7fddd013d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.615+0000 7fddd66ae640 1 -- 172.21.15.194:0/2152885066 >> 172.21.15.194:0/2152885066 conn(0x7fddd006bff0 msgr2=0x7fddd006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:26.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.615+0000 7fddd66ae640 1 -- 172.21.15.194:0/2152885066 shutdown_connections 2024-03-16T17:47:26.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.615+0000 7fddd66ae640 1 -- 172.21.15.194:0/2152885066 wait complete. 2024-03-16T17:47:26.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new e6420efd-1107-484f-84ff-ab3d44709bf5 2 2024-03-16T17:47:26.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.727+0000 7faa74f8c640 1 Processor -- start 2024-03-16T17:47:26.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.727+0000 7faa74f8c640 1 -- start start 2024-03-16T17:47:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.728+0000 7faa74f8c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faa7015e190 0x7faa7006b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.728+0000 7faa74f8c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7006baf0 con 0x7faa70072ec0 2024-03-16T17:47:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.728+0000 7faa74f8c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7006bd40 con 0x7faa700ad270 2024-03-16T17:47:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.728+0000 7faa74f8c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7006c020 con 0x7faa7015e190 2024-03-16T17:47:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.728+0000 7faa6e59c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faa7015e190 0x7faa7006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.728+0000 7faa6dd9b640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7faa700ad270 0x7faa700727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:46108/0 (socket says 172.21.15.194:46108) 2024-03-16T17:47:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.728+0000 7faa6dd9b640 1 -- 172.21.15.194:0/1342770347 learned_addr learned my addr 172.21.15.194:0/1342770347 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-16T17:47:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.728+0000 7faa6e59c640 1 -- 172.21.15.194:0/1342770347 >> v1:172.21.15.194:6789/0 conn(0x7faa700ad270 legacy=0x7faa700727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.728+0000 7faa6e59c640 1 -- 172.21.15.194:0/1342770347 >> v1:172.21.15.132:6789/0 conn(0x7faa70072ec0 legacy=0x7faa70161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.728+0000 7faa6e59c640 1 -- 172.21.15.194:0/1342770347 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7006c300 con 0x7faa7015e190 2024-03-16T17:47:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.729+0000 7faa6e59c640 1 --2- 172.21.15.194:0/1342770347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa7015e190 0x7faa7006b410 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faa600097a0 tx=0x7faa6002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84dc075e7f61d0a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.729+0000 7faa6d59a640 1 -- 172.21.15.194:0/1342770347 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60030610 con 0x7faa7015e190 2024-03-16T17:47:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.729+0000 7faa6d59a640 1 -- 172.21.15.194:0/1342770347 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa60030770 con 0x7faa7015e190 2024-03-16T17:47:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.729+0000 7faa6d59a640 1 -- 172.21.15.194:0/1342770347 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60030b00 con 0x7faa7015e190 2024-03-16T17:47:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.729+0000 7faa74f8c640 1 -- 172.21.15.194:0/1342770347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa7015e190 msgr2=0x7faa7006b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.730+0000 7faa74f8c640 1 --2- 172.21.15.194:0/1342770347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa7015e190 0x7faa7006b410 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faa600097a0 tx=0x7faa6002b960 comp rx=0 tx=0).stop 2024-03-16T17:47:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.730+0000 7faa74f8c640 1 -- 172.21.15.194:0/1342770347 shutdown_connections 2024-03-16T17:47:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.730+0000 7faa74f8c640 1 --2- 172.21.15.194:0/1342770347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa7015e190 0x7faa7006b410 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.730+0000 7faa74f8c640 1 -- 172.21.15.194:0/1342770347 >> 172.21.15.194:0/1342770347 conn(0x7faa70071900 msgr2=0x7faa700b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.730+0000 7faa74f8c640 1 -- 172.21.15.194:0/1342770347 shutdown_connections 2024-03-16T17:47:26.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.730+0000 7faa74f8c640 1 -- 172.21.15.194:0/1342770347 wait complete. 2024-03-16T17:47:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.731+0000 7faa74f8c640 1 Processor -- start 2024-03-16T17:47:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.731+0000 7faa74f8c640 1 -- start start 2024-03-16T17:47:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa74f8c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa70072ec0 0x7faa7009dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa74f8c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa700ad270 0x7faa70157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa74f8c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa7015e190 0x7faa70157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa74f8c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa70156970 con 0x7faa7015e190 2024-03-16T17:47:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa74f8c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7009e150 con 0x7faa70072ec0 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa74f8c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa70155cf0 con 0x7faa700ad270 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6e59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa70072ec0 0x7faa7009dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6dd9b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa700ad270 0x7faa70157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6e59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa70072ec0 0x7faa7009dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59848/0 (socket says 172.21.15.194:59848) 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6dd9b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa700ad270 0x7faa70157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:37144/0 (socket says 172.21.15.194:37144) 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6e59c640 1 -- 172.21.15.194:0/360049094 learned_addr learned my addr 172.21.15.194:0/360049094 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6ed9d640 1 --2- 172.21.15.194:0/360049094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa7015e190 0x7faa70157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6dd9b640 1 -- 172.21.15.194:0/360049094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa70072ec0 msgr2=0x7faa7009dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6dd9b640 1 --2- 172.21.15.194:0/360049094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa70072ec0 0x7faa7009dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6dd9b640 1 -- 172.21.15.194:0/360049094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa7015e190 msgr2=0x7faa70157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6dd9b640 1 --2- 172.21.15.194:0/360049094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa7015e190 0x7faa70157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6dd9b640 1 -- 172.21.15.194:0/360049094 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60009400 con 0x7faa700ad270 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6e59c640 1 --2- 172.21.15.194:0/360049094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa70072ec0 0x7faa7009dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa6dd9b640 1 --2- 172.21.15.194:0/360049094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa700ad270 0x7faa70157960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c410 tx=0x7faa64001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa5effd640 1 -- 172.21.15.194:0/360049094 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64005ce0 con 0x7faa700ad270 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa5effd640 1 -- 172.21.15.194:0/360049094 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa64005e40 con 0x7faa700ad270 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa5effd640 1 -- 172.21.15.194:0/360049094 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa640072d0 con 0x7faa700ad270 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.732+0000 7faa74f8c640 1 -- 172.21.15.194:0/360049094 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa70155fd0 con 0x7faa700ad270 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.733+0000 7faa74f8c640 1 -- 172.21.15.194:0/360049094 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa70156590 con 0x7faa700ad270 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.733+0000 7faa5effd640 1 -- 172.21.15.194:0/360049094 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7faa640074f0 con 0x7faa700ad270 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.733+0000 7faa5effd640 1 -- 172.21.15.194:0/360049094 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7faa64012820 con 0x7faa700ad270 2024-03-16T17:47:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.733+0000 7faa74f8c640 1 -- 172.21.15.194:0/360049094 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa70156ab0 con 0x7faa700ad270 2024-03-16T17:47:26.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.736+0000 7faa5effd640 1 -- 172.21.15.194:0/360049094 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7faa70156ab0 con 0x7faa700ad270 2024-03-16T17:47:26.764 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:26.761+0000 7f611ee4c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T17:47:26.793 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:26.790+0000 7f97a1232040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-16T17:47:26.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.808+0000 7faa74f8c640 1 -- 172.21.15.194:0/360049094 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e6420efd-1107-484f-84ff-ab3d44709bf5", "id": 2} v 0) v1 -- 0x7faa7006afe0 con 0x7faa700ad270 2024-03-16T17:47:26.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.814+0000 7faa5effd640 1 -- 172.21.15.194:0/360049094 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6420efd-1107-484f-84ff-ab3d44709bf5", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa64021060 con 0x7faa700ad270 2024-03-16T17:47:26.817 INFO:teuthology.orchestra.run.smithi194.stdout:2 2024-03-16T17:47:26.818 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:26.814+0000 7f611ee4c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T17:47:26.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.814+0000 7faa74f8c640 1 -- 172.21.15.194:0/360049094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa700ad270 msgr2=0x7faa70157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.814+0000 7faa74f8c640 1 --2- 172.21.15.194:0/360049094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa700ad270 0x7faa70157960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c410 tx=0x7faa64001e70 comp rx=0 tx=0).stop 2024-03-16T17:47:26.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.814+0000 7faa74f8c640 1 -- 172.21.15.194:0/360049094 shutdown_connections 2024-03-16T17:47:26.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.814+0000 7faa74f8c640 1 --2- 172.21.15.194:0/360049094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa7015e190 0x7faa70157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.814+0000 7faa74f8c640 1 --2- 172.21.15.194:0/360049094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faa700ad270 0x7faa70157960 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.814+0000 7faa74f8c640 1 --2- 172.21.15.194:0/360049094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faa70072ec0 0x7faa7009dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.814+0000 7faa74f8c640 1 -- 172.21.15.194:0/360049094 >> 172.21.15.194:0/360049094 conn(0x7faa70071900 msgr2=0x7faa7006d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:26.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.815+0000 7faa74f8c640 1 -- 172.21.15.194:0/360049094 shutdown_connections 2024-03-16T17:47:26.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.815+0000 7faa74f8c640 1 -- 172.21.15.194:0/360049094 wait complete. 2024-03-16T17:47:26.829 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 2975ccf1-a247-4348-809d-8314e9f2fe8e 3 2024-03-16T17:47:26.852 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:26.848+0000 7f97a1232040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-16T17:47:26.862 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:26.859+0000 7f611ee4c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T17:47:26.899 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:26.896+0000 7f97a1232040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-16T17:47:26.915 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:26.912+0000 7f611ee4c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T17:47:26.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.926+0000 7f4de99e2640 1 Processor -- start 2024-03-16T17:47:26.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.926+0000 7f4de99e2640 1 -- start start 2024-03-16T17:47:26.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.927+0000 7f4de99e2640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4de415e040 0x7f4de406e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.927+0000 7f4de99e2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4de406aee0 0x7f4de406b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.927+0000 7f4de99e2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de406b880 con 0x7f4de4161cd0 2024-03-16T17:47:26.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.927+0000 7f4de99e2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de4070560 con 0x7f4de406aee0 2024-03-16T17:47:26.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.927+0000 7f4de99e2640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de406dd70 con 0x7f4de415e040 2024-03-16T17:47:26.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.927+0000 7f4de2ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4de415e040 0x7f4de406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.927+0000 7f4de2ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4de415e040 0x7f4de406e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59862/0 (socket says 172.21.15.194:59862) 2024-03-16T17:47:26.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.927+0000 7f4de2ffd640 1 -- 172.21.15.194:0/1137930818 learned_addr learned my addr 172.21.15.194:0/1137930818 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:26.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.927+0000 7f4ddbfff640 1 --2- 172.21.15.194:0/1137930818 >> v2:172.21.15.132:3300/0 conn(0x7f4de406aee0 0x7f4de406b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.928+0000 7f4de2ffd640 1 -- 172.21.15.194:0/1137930818 >> v2:172.21.15.132:3300/0 conn(0x7f4de406aee0 msgr2=0x7f4de406b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:26.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.928+0000 7f4de2ffd640 1 --2- 172.21.15.194:0/1137930818 >> v2:172.21.15.132:3300/0 conn(0x7f4de406aee0 0x7f4de406b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.928+0000 7f4de2ffd640 1 -- 172.21.15.194:0/1137930818 >> v1:172.21.15.132:6789/0 conn(0x7f4de4161cd0 legacy=0x7f4de4162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.928+0000 7f4de2ffd640 1 -- 172.21.15.194:0/1137930818 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40b5d80 con 0x7f4de415e040 2024-03-16T17:47:26.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.928+0000 7f4de2ffd640 1 --2- 172.21.15.194:0/1137930818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 0x7f4de406e550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4de4075540 tx=0x7f4dd402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5854fadf0527dce server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:26.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.928+0000 7f4de27fc640 1 -- 172.21.15.194:0/1137930818 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4030860 con 0x7f4de415e040 2024-03-16T17:47:26.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.929+0000 7f4de27fc640 1 -- 172.21.15.194:0/1137930818 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd40309c0 con 0x7f4de415e040 2024-03-16T17:47:26.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.929+0000 7f4de27fc640 1 -- 172.21.15.194:0/1137930818 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4030d50 con 0x7f4de415e040 2024-03-16T17:47:26.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.929+0000 7f4de99e2640 1 -- 172.21.15.194:0/1137930818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 msgr2=0x7f4de406e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.929+0000 7f4de99e2640 1 --2- 172.21.15.194:0/1137930818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 0x7f4de406e550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4de4075540 tx=0x7f4dd402b9a0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.929+0000 7f4de99e2640 1 -- 172.21.15.194:0/1137930818 shutdown_connections 2024-03-16T17:47:26.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.929+0000 7f4de99e2640 1 --2- 172.21.15.194:0/1137930818 >> v2:172.21.15.132:3300/0 conn(0x7f4de406aee0 0x7f4de406b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.929+0000 7f4de99e2640 1 --2- 172.21.15.194:0/1137930818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 0x7f4de406e550 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.929+0000 7f4de99e2640 1 -- 172.21.15.194:0/1137930818 >> 172.21.15.194:0/1137930818 conn(0x7f4de40d0a40 msgr2=0x7f4de40d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:26.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.929+0000 7f4de99e2640 1 -- 172.21.15.194:0/1137930818 shutdown_connections 2024-03-16T17:47:26.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.929+0000 7f4de99e2640 1 -- 172.21.15.194:0/1137930818 wait complete. 2024-03-16T17:47:26.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.930+0000 7f4de99e2640 1 Processor -- start 2024-03-16T17:47:26.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.930+0000 7f4de99e2640 1 -- start start 2024-03-16T17:47:26.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4de99e2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4de406aee0 0x7f4de4152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4de99e2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 0x7f4de4148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4de99e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4de4161cd0 0x7f4de4154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:26.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4de99e2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4156000 con 0x7f4de4161cd0 2024-03-16T17:47:26.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4de99e2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4155660 con 0x7f4de415e040 2024-03-16T17:47:26.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4de99e2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4155940 con 0x7f4de406aee0 2024-03-16T17:47:26.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4ddbfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 0x7f4de4148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4de2ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4de406aee0 0x7f4de4152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4ddbfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 0x7f4de4148320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59878/0 (socket says 172.21.15.194:59878) 2024-03-16T17:47:26.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4ddbfff640 1 -- 172.21.15.194:0/1306086111 learned_addr learned my addr 172.21.15.194:0/1306086111 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4de37fe640 1 --2- 172.21.15.194:0/1306086111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4de4161cd0 0x7f4de4154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4ddbfff640 1 -- 172.21.15.194:0/1306086111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4de406aee0 msgr2=0x7f4de4152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.931+0000 7f4ddbfff640 1 --2- 172.21.15.194:0/1306086111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4de406aee0 0x7f4de4152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4ddbfff640 1 -- 172.21.15.194:0/1306086111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4de4161cd0 msgr2=0x7f4de4154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4ddbfff640 1 --2- 172.21.15.194:0/1306086111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4de4161cd0 0x7f4de4154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4ddbfff640 1 -- 172.21.15.194:0/1306086111 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40094d0 con 0x7f4de415e040 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4ddbfff640 1 --2- 172.21.15.194:0/1306086111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 0x7f4de4148320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00e9b0 tx=0x7f4dcc00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4de0ff9640 1 -- 172.21.15.194:0/1306086111 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc009670 con 0x7f4de415e040 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4de0ff9640 1 -- 172.21.15.194:0/1306086111 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc00c9a0 con 0x7f4de415e040 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4de99e2640 1 -- 172.21.15.194:0/1306086111 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de4155c20 con 0x7f4de415e040 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4de0ff9640 1 -- 172.21.15.194:0/1306086111 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00cd50 con 0x7f4de415e040 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4de99e2640 1 -- 172.21.15.194:0/1306086111 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de4153430 con 0x7f4de415e040 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4de0ff9640 1 -- 172.21.15.194:0/1306086111 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4dcc005990 con 0x7f4de415e040 2024-03-16T17:47:26.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.932+0000 7f4de0ff9640 1 -- 172.21.15.194:0/1306086111 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4dcc013900 con 0x7f4de415e040 2024-03-16T17:47:26.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.933+0000 7f4de99e2640 1 -- 172.21.15.194:0/1306086111 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de406e1e0 con 0x7f4de415e040 2024-03-16T17:47:26.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:26.935+0000 7f4de0ff9640 1 -- 172.21.15.194:0/1306086111 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4de406e1e0 con 0x7f4de415e040 2024-03-16T17:47:26.958 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:26.954+0000 7f97a1232040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-16T17:47:26.958 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:26.955+0000 7f611ee4c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T17:47:27.001 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:26.998+0000 7f97a1232040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-16T17:47:27.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.008+0000 7f4de99e2640 1 -- 172.21.15.194:0/1306086111 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2975ccf1-a247-4348-809d-8314e9f2fe8e", "id": 3} v 0) v1 -- 0x7f4de4156140 con 0x7f4de415e040 2024-03-16T17:47:27.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.013+0000 7f4de0ff9640 1 -- 172.21.15.194:0/1306086111 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2975ccf1-a247-4348-809d-8314e9f2fe8e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4dcc021060 con 0x7f4de415e040 2024-03-16T17:47:27.017 INFO:teuthology.orchestra.run.smithi194.stdout:3 2024-03-16T17:47:27.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.014+0000 7f4de99e2640 1 -- 172.21.15.194:0/1306086111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 msgr2=0x7f4de4148320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.014+0000 7f4de99e2640 1 --2- 172.21.15.194:0/1306086111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 0x7f4de4148320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00e9b0 tx=0x7f4dcc00ee70 comp rx=0 tx=0).stop 2024-03-16T17:47:27.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.014+0000 7f4de99e2640 1 -- 172.21.15.194:0/1306086111 shutdown_connections 2024-03-16T17:47:27.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.014+0000 7f4de99e2640 1 --2- 172.21.15.194:0/1306086111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4de4161cd0 0x7f4de4154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.014+0000 7f4de99e2640 1 --2- 172.21.15.194:0/1306086111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4de415e040 0x7f4de4148320 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.014+0000 7f4de99e2640 1 --2- 172.21.15.194:0/1306086111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4de406aee0 0x7f4de4152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.014+0000 7f4de99e2640 1 -- 172.21.15.194:0/1306086111 >> 172.21.15.194:0/1306086111 conn(0x7f4de40d0a40 msgr2=0x7f4de4071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:27.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.014+0000 7f4de99e2640 1 -- 172.21.15.194:0/1306086111 shutdown_connections 2024-03-16T17:47:27.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.014+0000 7f4de99e2640 1 -- 172.21.15.194:0/1306086111 wait complete. 2024-03-16T17:47:27.028 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new e48a444e-983d-4fe7-9da6-a9a081315525 4 2024-03-16T17:47:27.072 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:27.068+0000 7f611ee4c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T17:47:27.124 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:27.120+0000 7f97a1232040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-16T17:47:27.141 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:27.136+0000 7f611ee4c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T17:47:27.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.165+0000 7ff778c64640 1 Processor -- start 2024-03-16T17:47:27.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.165+0000 7ff778c64640 1 -- start start 2024-03-16T17:47:27.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.166+0000 7ff778c64640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff77406fe40 0x7ff7740cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.166+0000 7ff778c64640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.166+0000 7ff778c64640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7740cc860 con 0x7ff7741617d0 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.166+0000 7ff778c64640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7740cc250 con 0x7ff77406fe40 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.166+0000 7ff778c64640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7740d0df0 con 0x7ff7740d0870 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.166+0000 7ff772d9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.166+0000 7ff76bfff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff77406fe40 0x7ff7740cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.166+0000 7ff772d9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:37154/0 (socket says 172.21.15.194:37154) 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.166+0000 7ff772d9d640 1 -- 172.21.15.194:0/2163640612 learned_addr learned my addr 172.21.15.194:0/2163640612 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.166+0000 7ff77259c640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff7741617d0 0x7ff77406f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:46122/0 (socket says 172.21.15.194:46122) 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.167+0000 7ff76bfff640 1 -- 172.21.15.194:0/2163640612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 msgr2=0x7ff7740cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.167+0000 7ff76bfff640 1 --2- 172.21.15.194:0/2163640612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.167+0000 7ff76bfff640 1 -- 172.21.15.194:0/2163640612 >> v1:172.21.15.194:6789/0 conn(0x7ff7741617d0 legacy=0x7ff77406f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.167+0000 7ff771d9b640 1 -- 172.21.15.194:0/2163640612 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457162660 0 0) 0x7ff7740cc860 con 0x7ff7741617d0 2024-03-16T17:47:27.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.167+0000 7ff76bfff640 1 -- 172.21.15.194:0/2163640612 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7740cc4f0 con 0x7ff77406fe40 2024-03-16T17:47:27.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.167+0000 7ff772d9d640 1 --2- 172.21.15.194:0/2163640612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:27.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.168+0000 7ff76bfff640 1 --2- 172.21.15.194:0/2163640612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff77406fe40 0x7ff7740cccf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0097a0 tx=0x7ff75c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60423209b2f86f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:27.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.168+0000 7ff771d9b640 1 -- 172.21.15.194:0/2163640612 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c02e070 con 0x7ff77406fe40 2024-03-16T17:47:27.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.168+0000 7ff771d9b640 1 -- 172.21.15.194:0/2163640612 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c0315a0 con 0x7ff77406fe40 2024-03-16T17:47:27.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.168+0000 7ff771d9b640 1 -- 172.21.15.194:0/2163640612 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c031930 con 0x7ff77406fe40 2024-03-16T17:47:27.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.169+0000 7ff778c64640 1 -- 172.21.15.194:0/2163640612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff77406fe40 msgr2=0x7ff7740cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.169+0000 7ff778c64640 1 --2- 172.21.15.194:0/2163640612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff77406fe40 0x7ff7740cccf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0097a0 tx=0x7ff75c02b840 comp rx=0 tx=0).stop 2024-03-16T17:47:27.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.169+0000 7ff778c64640 1 -- 172.21.15.194:0/2163640612 shutdown_connections 2024-03-16T17:47:27.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.169+0000 7ff778c64640 1 --2- 172.21.15.194:0/2163640612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.169+0000 7ff778c64640 1 --2- 172.21.15.194:0/2163640612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff77406fe40 0x7ff7740cccf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.169+0000 7ff778c64640 1 -- 172.21.15.194:0/2163640612 >> 172.21.15.194:0/2163640612 conn(0x7ff7740b3710 msgr2=0x7ff7740b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:27.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.169+0000 7ff778c64640 1 -- 172.21.15.194:0/2163640612 shutdown_connections 2024-03-16T17:47:27.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.169+0000 7ff778c64640 1 -- 172.21.15.194:0/2163640612 wait complete. 2024-03-16T17:47:27.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.170+0000 7ff778c64640 1 Processor -- start 2024-03-16T17:47:27.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.170+0000 7ff778c64640 1 -- start start 2024-03-16T17:47:27.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff778c64640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77406fe40 0x7ff7740b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff778c64640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff778c64640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7741617d0 0x7ff77415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff778c64640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7740b6400 con 0x7ff77406fe40 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff778c64640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7740b6890 con 0x7ff7741617d0 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff778c64640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7740b57f0 con 0x7ff7740d0870 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff76bfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff772d9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7741617d0 0x7ff77415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff772d9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7741617d0 0x7ff77415fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59904/0 (socket says 172.21.15.194:59904) 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff772d9d640 1 -- 172.21.15.194:0/3125193491 learned_addr learned my addr 172.21.15.194:0/3125193491 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff77259c640 1 --2- 172.21.15.194:0/3125193491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77406fe40 0x7ff7740b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff772d9d640 1 -- 172.21.15.194:0/3125193491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 msgr2=0x7ff7740b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff772d9d640 1 --2- 172.21.15.194:0/3125193491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff772d9d640 1 -- 172.21.15.194:0/3125193491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77406fe40 msgr2=0x7ff7740b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff772d9d640 1 --2- 172.21.15.194:0/3125193491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77406fe40 0x7ff7740b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff772d9d640 1 -- 172.21.15.194:0/3125193491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c009b30 con 0x7ff7741617d0 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff76bfff640 1 --2- 172.21.15.194:0/3125193491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff77259c640 1 --2- 172.21.15.194:0/3125193491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77406fe40 0x7ff7740b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff772d9d640 1 --2- 172.21.15.194:0/3125193491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7741617d0 0x7ff77415fbe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00efc0 tx=0x7ff76c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff76affd640 1 -- 172.21.15.194:0/3125193491 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c018070 con 0x7ff7741617d0 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff76affd640 1 -- 172.21.15.194:0/3125193491 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c00f040 con 0x7ff7741617d0 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff76affd640 1 -- 172.21.15.194:0/3125193491 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c00ce00 con 0x7ff7741617d0 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff778c64640 1 -- 172.21.15.194:0/3125193491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c009400 con 0x7ff7741617d0 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.171+0000 7ff778c64640 1 -- 172.21.15.194:0/3125193491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7740b5db0 con 0x7ff7741617d0 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.172+0000 7ff76affd640 1 -- 172.21.15.194:0/3125193491 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff76c003d20 con 0x7ff7741617d0 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.172+0000 7ff76affd640 1 -- 172.21.15.194:0/3125193491 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff76c014c10 con 0x7ff7741617d0 2024-03-16T17:47:27.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.172+0000 7ff778c64640 1 -- 172.21.15.194:0/3125193491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff774070a10 con 0x7ff7741617d0 2024-03-16T17:47:27.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.176+0000 7ff76affd640 1 -- 172.21.15.194:0/3125193491 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff76c014700 con 0x7ff7741617d0 2024-03-16T17:47:27.185 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:27.181+0000 7f611ee4c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T17:47:27.200 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:27.197+0000 7f97a1232040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-16T17:47:27.236 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:27.233+0000 7f611ee4c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T17:47:27.248 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:27.245+0000 7f97a1232040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-16T17:47:27.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.249+0000 7ff778c64640 1 -- 172.21.15.194:0/3125193491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e48a444e-983d-4fe7-9da6-a9a081315525", "id": 4} v 0) v1 -- 0x7ff774068450 con 0x7ff7741617d0 2024-03-16T17:47:27.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.254+0000 7ff76affd640 1 -- 172.21.15.194:0/3125193491 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e48a444e-983d-4fe7-9da6-a9a081315525", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff76c02b0b0 con 0x7ff7741617d0 2024-03-16T17:47:27.258 INFO:teuthology.orchestra.run.smithi194.stdout:4 2024-03-16T17:47:27.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.255+0000 7ff778c64640 1 -- 172.21.15.194:0/3125193491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7741617d0 msgr2=0x7ff77415fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.255+0000 7ff778c64640 1 --2- 172.21.15.194:0/3125193491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7741617d0 0x7ff77415fbe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00efc0 tx=0x7ff76c00c490 comp rx=0 tx=0).stop 2024-03-16T17:47:27.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.255+0000 7ff778c64640 1 -- 172.21.15.194:0/3125193491 shutdown_connections 2024-03-16T17:47:27.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.255+0000 7ff778c64640 1 --2- 172.21.15.194:0/3125193491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7741617d0 0x7ff77415fbe0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.255+0000 7ff778c64640 1 --2- 172.21.15.194:0/3125193491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7740d0870 0x7ff7740b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.255+0000 7ff778c64640 1 --2- 172.21.15.194:0/3125193491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff77406fe40 0x7ff7740b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.255+0000 7ff778c64640 1 -- 172.21.15.194:0/3125193491 >> 172.21.15.194:0/3125193491 conn(0x7ff7740b3710 msgr2=0x7ff7740cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:27.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.255+0000 7ff778c64640 1 -- 172.21.15.194:0/3125193491 shutdown_connections 2024-03-16T17:47:27.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.255+0000 7ff778c64640 1 -- 172.21.15.194:0/3125193491 wait complete. 2024-03-16T17:47:27.269 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new ffcf4e7d-62d0-4243-99ff-50559022359a 5 2024-03-16T17:47:27.283 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:27.279+0000 7f611ee4c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T17:47:27.305 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:27.302+0000 7f97a1232040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-16T17:47:27.355 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:27.351+0000 7f97a1232040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-16T17:47:27.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.366+0000 7f94dc72c640 1 Processor -- start 2024-03-16T17:47:27.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.366+0000 7f94dc72c640 1 -- start start 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dc72c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94d4144510 0x7f94d40b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dc72c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dc72c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d41448f0 con 0x7f94d406f5d0 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dc72c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d415f200 con 0x7f94d4144510 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dc72c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40ce470 con 0x7f94d415e830 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dacc9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dacc9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d415ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:37170/0 (socket says 172.21.15.194:37170) 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dacc9640 1 -- 172.21.15.194:0/1560574450 learned_addr learned my addr 172.21.15.194:0/1560574450 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94da4c8640 1 --2- 172.21.15.194:0/1560574450 >> v2:172.21.15.132:3300/0 conn(0x7f94d4144510 0x7f94d40b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dacc9640 1 -- 172.21.15.194:0/1560574450 >> v2:172.21.15.132:3300/0 conn(0x7f94d4144510 msgr2=0x7f94d40b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dacc9640 1 --2- 172.21.15.194:0/1560574450 >> v2:172.21.15.132:3300/0 conn(0x7f94d4144510 0x7f94d40b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dacc9640 1 -- 172.21.15.194:0/1560574450 >> v1:172.21.15.132:6789/0 conn(0x7f94d406f5d0 legacy=0x7f94d40cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.367+0000 7f94dacc9640 1 -- 172.21.15.194:0/1560574450 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d40b4110 con 0x7f94d415e830 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.368+0000 7f94dacc9640 1 --2- 172.21.15.194:0/1560574450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d415ecc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009e50 tx=0x7f94cc02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284438668c956dbb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.368+0000 7f94d94c6640 1 -- 172.21.15.194:0/1560574450 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc02ca70 con 0x7f94d415e830 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.368+0000 7f94d94c6640 1 -- 172.21.15.194:0/1560574450 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc02cbd0 con 0x7f94d415e830 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.368+0000 7f94d94c6640 1 -- 172.21.15.194:0/1560574450 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc0343f0 con 0x7f94d415e830 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.368+0000 7f94dc72c640 1 -- 172.21.15.194:0/1560574450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 msgr2=0x7f94d415ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.368+0000 7f94dc72c640 1 --2- 172.21.15.194:0/1560574450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d415ecc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009e50 tx=0x7f94cc02bed0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.369+0000 7f94dc72c640 1 -- 172.21.15.194:0/1560574450 shutdown_connections 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.369+0000 7f94dc72c640 1 --2- 172.21.15.194:0/1560574450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d415ecc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.369+0000 7f94dc72c640 1 --2- 172.21.15.194:0/1560574450 >> v2:172.21.15.132:3300/0 conn(0x7f94d4144510 0x7f94d40b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.369+0000 7f94dc72c640 1 -- 172.21.15.194:0/1560574450 >> 172.21.15.194:0/1560574450 conn(0x7f94d40d0a40 msgr2=0x7f94d40d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.369+0000 7f94dc72c640 1 -- 172.21.15.194:0/1560574450 shutdown_connections 2024-03-16T17:47:27.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.369+0000 7f94dc72c640 1 -- 172.21.15.194:0/1560574450 wait complete. 2024-03-16T17:47:27.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.370+0000 7f94dc72c640 1 Processor -- start 2024-03-16T17:47:27.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.370+0000 7f94dc72c640 1 -- start start 2024-03-16T17:47:27.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.370+0000 7f94dc72c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d406f5d0 0x7f94d4140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.370+0000 7f94dc72c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94d4144510 0x7f94d4132ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.370+0000 7f94dc72c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d4133530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.370+0000 7f94dc72c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4155eb0 con 0x7f94d4144510 2024-03-16T17:47:27.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.370+0000 7f94dc72c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40b1800 con 0x7f94d406f5d0 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.370+0000 7f94dc72c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40b1ae0 con 0x7f94d415e830 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dacc9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d4133530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94da4c8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d406f5d0 0x7f94d4140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dacc9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d4133530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:37174/0 (socket says 172.21.15.194:37174) 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dacc9640 1 -- 172.21.15.194:0/3891990951 learned_addr learned my addr 172.21.15.194:0/3891990951 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94d9cc7640 1 --2- 172.21.15.194:0/3891990951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94d4144510 0x7f94d4132ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dacc9640 1 -- 172.21.15.194:0/3891990951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d406f5d0 msgr2=0x7f94d4140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dacc9640 1 --2- 172.21.15.194:0/3891990951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d406f5d0 0x7f94d4140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dacc9640 1 -- 172.21.15.194:0/3891990951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94d4144510 msgr2=0x7f94d4132ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dacc9640 1 --2- 172.21.15.194:0/3891990951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94d4144510 0x7f94d4132ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dacc9640 1 -- 172.21.15.194:0/3891990951 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc009b30 con 0x7f94d415e830 2024-03-16T17:47:27.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94d9cc7640 1 --2- 172.21.15.194:0/3891990951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94d4144510 0x7f94d4132ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:27.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dacc9640 1 --2- 172.21.15.194:0/3891990951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d4133530 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009e50 tx=0x7f94cc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:27.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94caffd640 1 -- 172.21.15.194:0/3891990951 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc040670 con 0x7f94d415e830 2024-03-16T17:47:27.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94caffd640 1 -- 172.21.15.194:0/3891990951 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc040810 con 0x7f94d415e830 2024-03-16T17:47:27.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dc72c640 1 -- 172.21.15.194:0/3891990951 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d40b1dc0 con 0x7f94d415e830 2024-03-16T17:47:27.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94caffd640 1 -- 172.21.15.194:0/3891990951 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc040bc0 con 0x7f94d415e830 2024-03-16T17:47:27.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94dc72c640 1 -- 172.21.15.194:0/3891990951 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d40adbc0 con 0x7f94d415e830 2024-03-16T17:47:27.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94caffd640 1 -- 172.21.15.194:0/3891990951 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f94cc03e7b0 con 0x7f94d415e830 2024-03-16T17:47:27.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.371+0000 7f94caffd640 1 -- 172.21.15.194:0/3891990951 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f94cc049a70 con 0x7f94d415e830 2024-03-16T17:47:27.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.372+0000 7f94dc72c640 1 -- 172.21.15.194:0/3891990951 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d40addb0 con 0x7f94d415e830 2024-03-16T17:47:27.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.374+0000 7f94caffd640 1 -- 172.21.15.194:0/3891990951 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f94cc044020 con 0x7f94d415e830 2024-03-16T17:47:27.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.446+0000 7f94dc72c640 1 -- 172.21.15.194:0/3891990951 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ffcf4e7d-62d0-4243-99ff-50559022359a", "id": 5} v 0) v1 -- 0x7f94d40734d0 con 0x7f94d415e830 2024-03-16T17:47:27.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.452+0000 7f94caffd640 1 -- 172.21.15.194:0/3891990951 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ffcf4e7d-62d0-4243-99ff-50559022359a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f94cc03ec40 con 0x7f94d415e830 2024-03-16T17:47:27.455 INFO:teuthology.orchestra.run.smithi194.stdout:5 2024-03-16T17:47:27.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.452+0000 7f94dc72c640 1 -- 172.21.15.194:0/3891990951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 msgr2=0x7f94d4133530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.452+0000 7f94dc72c640 1 --2- 172.21.15.194:0/3891990951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d4133530 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009e50 tx=0x7f94cc004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:27.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.453+0000 7f94dc72c640 1 -- 172.21.15.194:0/3891990951 shutdown_connections 2024-03-16T17:47:27.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.453+0000 7f94dc72c640 1 --2- 172.21.15.194:0/3891990951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94d415e830 0x7f94d4133530 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.453+0000 7f94dc72c640 1 --2- 172.21.15.194:0/3891990951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94d4144510 0x7f94d4132ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.453+0000 7f94dc72c640 1 --2- 172.21.15.194:0/3891990951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d406f5d0 0x7f94d4140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.453+0000 7f94dc72c640 1 -- 172.21.15.194:0/3891990951 >> 172.21.15.194:0/3891990951 conn(0x7f94d40d0a40 msgr2=0x7f94d40b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:27.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.453+0000 7f94dc72c640 1 -- 172.21.15.194:0/3891990951 shutdown_connections 2024-03-16T17:47:27.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.453+0000 7f94dc72c640 1 -- 172.21.15.194:0/3891990951 wait complete. 2024-03-16T17:47:27.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 462fb4ec-dd63-4164-a5a4-68fbb7ab6521 6 2024-03-16T17:47:27.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.604+0000 7f5b54681640 1 Processor -- start 2024-03-16T17:47:27.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.604+0000 7f5b54681640 1 -- start start 2024-03-16T17:47:27.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b54681640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b4c15e0e0 0x7f5b4c0d2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b54681640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c0b2e20 0x7f5b4c0cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b54681640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4c0d4db0 con 0x7f5b4c15e4c0 2024-03-16T17:47:27.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b54681640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4c0b0db0 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b54681640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0d1d50 con 0x7f5b4c0b2e20 2024-03-16T17:47:27.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b52c1e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c0b2e20 0x7f5b4c0cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b51c1c640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f5b4c15e4c0 0x7f5b4c0b11d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:46130/0 (socket says 172.21.15.194:46130) 2024-03-16T17:47:27.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b51c1c640 1 -- 172.21.15.194:0/251506258 learned_addr learned my addr 172.21.15.194:0/251506258 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-16T17:47:27.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b5241d640 1 --2- 172.21.15.194:0/251506258 >> v2:172.21.15.132:3300/0 conn(0x7f5b4c15e0e0 0x7f5b4c0d2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b52c1e640 1 -- 172.21.15.194:0/251506258 >> v2:172.21.15.132:3300/0 conn(0x7f5b4c15e0e0 msgr2=0x7f5b4c0d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:27.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b52c1e640 1 --2- 172.21.15.194:0/251506258 >> v2:172.21.15.132:3300/0 conn(0x7f5b4c15e0e0 0x7f5b4c0d2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b5141b640 1 -- 172.21.15.194:0/251506258 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917303925 0 0) 0x7f5b4c0d4db0 con 0x7f5b4c15e4c0 2024-03-16T17:47:27.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b52c1e640 1 -- 172.21.15.194:0/251506258 >> v1:172.21.15.194:6789/0 conn(0x7f5b4c15e4c0 legacy=0x7f5b4c0b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.605+0000 7f5b52c1e640 1 -- 172.21.15.194:0/251506258 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c0d2030 con 0x7f5b4c0b2e20 2024-03-16T17:47:27.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.606+0000 7f5b52c1e640 1 --2- 172.21.15.194:0/251506258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c0b2e20 0x7f5b4c0cfaf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5b480097a0 tx=0x7f5b4802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=712bd0592249810e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:27.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.606+0000 7f5b5141b640 1 -- 172.21.15.194:0/251506258 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48031830 con 0x7f5b4c0b2e20 2024-03-16T17:47:27.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.606+0000 7f5b5141b640 1 -- 172.21.15.194:0/251506258 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b48031990 con 0x7f5b4c0b2e20 2024-03-16T17:47:27.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.606+0000 7f5b5141b640 1 -- 172.21.15.194:0/251506258 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48031d20 con 0x7f5b4c0b2e20 2024-03-16T17:47:27.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.607+0000 7f5b54681640 1 -- 172.21.15.194:0/251506258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c0b2e20 msgr2=0x7f5b4c0cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.607+0000 7f5b54681640 1 --2- 172.21.15.194:0/251506258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c0b2e20 0x7f5b4c0cfaf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5b480097a0 tx=0x7f5b4802b8d0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.607+0000 7f5b54681640 1 -- 172.21.15.194:0/251506258 shutdown_connections 2024-03-16T17:47:27.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.607+0000 7f5b54681640 1 --2- 172.21.15.194:0/251506258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c0b2e20 0x7f5b4c0cfaf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.607+0000 7f5b54681640 1 --2- 172.21.15.194:0/251506258 >> v2:172.21.15.132:3300/0 conn(0x7f5b4c15e0e0 0x7f5b4c0d2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.607+0000 7f5b54681640 1 -- 172.21.15.194:0/251506258 >> 172.21.15.194:0/251506258 conn(0x7f5b4c0d3ed0 msgr2=0x7f5b4c0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:27.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.607+0000 7f5b54681640 1 -- 172.21.15.194:0/251506258 shutdown_connections 2024-03-16T17:47:27.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.607+0000 7f5b54681640 1 -- 172.21.15.194:0/251506258 wait complete. 2024-03-16T17:47:27.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.608+0000 7f5b54681640 1 Processor -- start 2024-03-16T17:47:27.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.608+0000 7f5b54681640 1 -- start start 2024-03-16T17:47:27.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b54681640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b4c0b2e20 0x7f5b4c0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b54681640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c15e0e0 0x7f5b4c0ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b54681640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b4c15e4c0 0x7f5b4c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b54681640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0cc900 con 0x7f5b4c0b2e20 2024-03-16T17:47:27.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b54681640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0cb320 con 0x7f5b4c15e4c0 2024-03-16T17:47:27.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b54681640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0cb600 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b52c1e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b4c15e4c0 0x7f5b4c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b51c1c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c15e0e0 0x7f5b4c0ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b51c1c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c15e0e0 0x7f5b4c0ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:37194/0 (socket says 172.21.15.194:37194) 2024-03-16T17:47:27.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b51c1c640 1 -- 172.21.15.194:0/2860728562 learned_addr learned my addr 172.21.15.194:0/2860728562 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b5241d640 1 --2- 172.21.15.194:0/2860728562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b4c0b2e20 0x7f5b4c0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b51c1c640 1 -- 172.21.15.194:0/2860728562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b4c15e4c0 msgr2=0x7f5b4c0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b51c1c640 1 --2- 172.21.15.194:0/2860728562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b4c15e4c0 0x7f5b4c0cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b51c1c640 1 -- 172.21.15.194:0/2860728562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b4c0b2e20 msgr2=0x7f5b4c0cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b51c1c640 1 --2- 172.21.15.194:0/2860728562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b4c0b2e20 0x7f5b4c0cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.609+0000 7f5b51c1c640 1 -- 172.21.15.194:0/2860728562 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48009400 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.610+0000 7f5b51c1c640 1 --2- 172.21.15.194:0/2860728562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c15e0e0 0x7f5b4c0ccc00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c430 tx=0x7f5b3c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.610+0000 7f5b42ffd640 1 -- 172.21.15.194:0/2860728562 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0074e0 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.610+0000 7f5b42ffd640 1 -- 172.21.15.194:0/2860728562 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c007660 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.610+0000 7f5b54681640 1 -- 172.21.15.194:0/2860728562 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c0cb8e0 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.610+0000 7f5b42ffd640 1 -- 172.21.15.194:0/2860728562 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c004a20 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.610+0000 7f5b54681640 1 -- 172.21.15.194:0/2860728562 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c0cbea0 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.610+0000 7f5b42ffd640 1 -- 172.21.15.194:0/2860728562 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5b3c004b80 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.610+0000 7f5b42ffd640 1 -- 172.21.15.194:0/2860728562 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f5b3c013a00 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.611+0000 7f5b54681640 1 -- 172.21.15.194:0/2860728562 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c068450 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.613+0000 7f5b42ffd640 1 -- 172.21.15.194:0/2860728562 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5b3c013c60 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.657 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:27.653+0000 7f611ee4c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T17:47:27.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.686+0000 7f5b54681640 1 -- 172.21.15.194:0/2860728562 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "462fb4ec-dd63-4164-a5a4-68fbb7ab6521", "id": 6} v 0) v1 -- 0x7f5b4c0cc090 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.691+0000 7f5b42ffd640 1 -- 172.21.15.194:0/2860728562 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "462fb4ec-dd63-4164-a5a4-68fbb7ab6521", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5b3c013410 con 0x7f5b4c15e0e0 2024-03-16T17:47:27.695 INFO:teuthology.orchestra.run.smithi194.stdout:6 2024-03-16T17:47:27.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.692+0000 7f5b54681640 1 -- 172.21.15.194:0/2860728562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c15e0e0 msgr2=0x7f5b4c0ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.692+0000 7f5b54681640 1 --2- 172.21.15.194:0/2860728562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c15e0e0 0x7f5b4c0ccc00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c430 tx=0x7f5b3c00c8f0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.692+0000 7f5b54681640 1 -- 172.21.15.194:0/2860728562 shutdown_connections 2024-03-16T17:47:27.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.692+0000 7f5b54681640 1 --2- 172.21.15.194:0/2860728562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b4c15e4c0 0x7f5b4c0cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.692+0000 7f5b54681640 1 --2- 172.21.15.194:0/2860728562 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b4c15e0e0 0x7f5b4c0ccc00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.692+0000 7f5b54681640 1 --2- 172.21.15.194:0/2860728562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b4c0b2e20 0x7f5b4c0cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.692+0000 7f5b54681640 1 -- 172.21.15.194:0/2860728562 >> 172.21.15.194:0/2860728562 conn(0x7f5b4c0d3ed0 msgr2=0x7f5b4c06c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:27.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.692+0000 7f5b54681640 1 -- 172.21.15.194:0/2860728562 shutdown_connections 2024-03-16T17:47:27.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.692+0000 7f5b54681640 1 -- 172.21.15.194:0/2860728562 wait complete. 2024-03-16T17:47:27.706 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 5dc8cefe-aa4b-498b-bddc-2959061dfefa 7 2024-03-16T17:47:27.754 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:27.750+0000 7f97a1232040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-16T17:47:27.791 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:27.787+0000 7f611ee4c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T17:47:27.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.805+0000 7f52ad96c640 1 Processor -- start 2024-03-16T17:47:27.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.805+0000 7f52ad96c640 1 -- start start 2024-03-16T17:47:27.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.805+0000 7f52ad96c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f52a80d2aa0 0x7f52a80ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.805+0000 7f52ad96c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f52a815e4c0 0x7f52a80cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.805+0000 7f52ad96c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a80d4db0 con 0x7f52a815e0e0 2024-03-16T17:47:27.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.805+0000 7f52ad96c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a80b0db0 con 0x7f52a80d2aa0 2024-03-16T17:47:27.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.805+0000 7f52ad96c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a80d1d50 con 0x7f52a815e4c0 2024-03-16T17:47:27.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.806+0000 7f52a77fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f52a815e4c0 0x7f52a80cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.806+0000 7f52a77fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f52a815e4c0 0x7f52a80cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59944/0 (socket says 172.21.15.194:59944) 2024-03-16T17:47:27.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.806+0000 7f52a77fe640 1 -- 172.21.15.194:0/1200133591 learned_addr learned my addr 172.21.15.194:0/1200133591 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:27.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.806+0000 7f52a67fc640 1 --2- 172.21.15.194:0/1200133591 >> v2:172.21.15.132:3300/0 conn(0x7f52a80d2aa0 0x7f52a80ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.806+0000 7f52a77fe640 1 -- 172.21.15.194:0/1200133591 >> v2:172.21.15.132:3300/0 conn(0x7f52a80d2aa0 msgr2=0x7f52a80ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:27.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.806+0000 7f52a77fe640 1 --2- 172.21.15.194:0/1200133591 >> v2:172.21.15.132:3300/0 conn(0x7f52a80d2aa0 0x7f52a80ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.806+0000 7f52a77fe640 1 -- 172.21.15.194:0/1200133591 >> v1:172.21.15.132:6789/0 conn(0x7f52a815e0e0 legacy=0x7f52a80d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.806+0000 7f52a77fe640 1 -- 172.21.15.194:0/1200133591 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a80d2030 con 0x7f52a815e4c0 2024-03-16T17:47:27.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52a77fe640 1 --2- 172.21.15.194:0/1200133591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e4c0 0x7f52a80cf020 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f52a80b5970 tx=0x7f52a002bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9cc023dda21cfd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:27.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52a5ffb640 1 -- 172.21.15.194:0/1200133591 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a002cb20 con 0x7f52a815e4c0 2024-03-16T17:47:27.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52a5ffb640 1 -- 172.21.15.194:0/1200133591 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a002cc80 con 0x7f52a815e4c0 2024-03-16T17:47:27.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52a5ffb640 1 -- 172.21.15.194:0/1200133591 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a00343f0 con 0x7f52a815e4c0 2024-03-16T17:47:27.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52ad96c640 1 -- 172.21.15.194:0/1200133591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e4c0 msgr2=0x7f52a80cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52ad96c640 1 --2- 172.21.15.194:0/1200133591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e4c0 0x7f52a80cf020 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f52a80b5970 tx=0x7f52a002bf80 comp rx=0 tx=0).stop 2024-03-16T17:47:27.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52ad96c640 1 -- 172.21.15.194:0/1200133591 shutdown_connections 2024-03-16T17:47:27.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52ad96c640 1 --2- 172.21.15.194:0/1200133591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e4c0 0x7f52a80cf020 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52ad96c640 1 --2- 172.21.15.194:0/1200133591 >> v2:172.21.15.132:3300/0 conn(0x7f52a80d2aa0 0x7f52a80ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52ad96c640 1 -- 172.21.15.194:0/1200133591 >> 172.21.15.194:0/1200133591 conn(0x7f52a80d3ed0 msgr2=0x7f52a80d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:27.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52ad96c640 1 -- 172.21.15.194:0/1200133591 shutdown_connections 2024-03-16T17:47:27.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.807+0000 7f52ad96c640 1 -- 172.21.15.194:0/1200133591 wait complete. 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.808+0000 7f52ad96c640 1 Processor -- start 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52ad96c640 1 -- start start 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52ad96c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52a80d2aa0 0x7f52a81f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52ad96c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e0e0 0x7f52a80cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52ad96c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a815e4c0 0x7f52a806c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52ad96c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a81f37f0 con 0x7f52a80d2aa0 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52ad96c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a81606f0 con 0x7f52a815e0e0 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52ad96c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a8160260 con 0x7f52a815e4c0 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52a67fc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e0e0 0x7f52a80cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52a67fc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e0e0 0x7f52a80cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59958/0 (socket says 172.21.15.194:59958) 2024-03-16T17:47:27.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52a67fc640 1 -- 172.21.15.194:0/1882574592 learned_addr learned my addr 172.21.15.194:0/1882574592 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.809+0000 7f52a77fe640 1 --2- 172.21.15.194:0/1882574592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a815e4c0 0x7f52a806c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f52a6ffd640 1 --2- 172.21.15.194:0/1882574592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52a80d2aa0 0x7f52a81f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f52a67fc640 1 -- 172.21.15.194:0/1882574592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a815e4c0 msgr2=0x7f52a806c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f52a67fc640 1 --2- 172.21.15.194:0/1882574592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a815e4c0 0x7f52a806c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f52a67fc640 1 -- 172.21.15.194:0/1882574592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52a80d2aa0 msgr2=0x7f52a81f32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f52a67fc640 1 --2- 172.21.15.194:0/1882574592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52a80d2aa0 0x7f52a81f32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f52a67fc640 1 -- 172.21.15.194:0/1882574592 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a0009b30 con 0x7f52a815e0e0 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f52a77fe640 1 --2- 172.21.15.194:0/1882574592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a815e4c0 0x7f52a806c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f52a67fc640 1 --2- 172.21.15.194:0/1882574592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e0e0 0x7f52a80cca10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f529c00e9b0 tx=0x7f529c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f528ffff640 1 -- 172.21.15.194:0/1882574592 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c009670 con 0x7f52a815e0e0 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f528ffff640 1 -- 172.21.15.194:0/1882574592 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c00c9a0 con 0x7f52a815e0e0 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f528ffff640 1 -- 172.21.15.194:0/1882574592 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c00cd50 con 0x7f52a815e0e0 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f52ad96c640 1 -- 172.21.15.194:0/1882574592 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a80cd6d0 con 0x7f52a815e0e0 2024-03-16T17:47:27.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f52ad96c640 1 -- 172.21.15.194:0/1882574592 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a815f930 con 0x7f52a815e0e0 2024-03-16T17:47:27.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f528ffff640 1 -- 172.21.15.194:0/1882574592 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f529c005990 con 0x7f52a815e0e0 2024-03-16T17:47:27.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.810+0000 7f528ffff640 1 -- 172.21.15.194:0/1882574592 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f529c013ad0 con 0x7f52a815e0e0 2024-03-16T17:47:27.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.811+0000 7f52ad96c640 1 -- 172.21.15.194:0/1882574592 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a8068450 con 0x7f52a815e0e0 2024-03-16T17:47:27.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.813+0000 7f528ffff640 1 -- 172.21.15.194:0/1882574592 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f529c021060 con 0x7f52a815e0e0 2024-03-16T17:47:27.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.886+0000 7f52ad96c640 1 -- 172.21.15.194:0/1882574592 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5dc8cefe-aa4b-498b-bddc-2959061dfefa", "id": 7} v 0) v1 -- 0x7f52a80a1db0 con 0x7f52a815e0e0 2024-03-16T17:47:27.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.891+0000 7f528ffff640 1 -- 172.21.15.194:0/1882574592 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5dc8cefe-aa4b-498b-bddc-2959061dfefa", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f529c017070 con 0x7f52a815e0e0 2024-03-16T17:47:27.895 INFO:teuthology.orchestra.run.smithi194.stdout:7 2024-03-16T17:47:27.895 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:27.891+0000 7f97a1232040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-16T17:47:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.892+0000 7f52ad96c640 1 -- 172.21.15.194:0/1882574592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e0e0 msgr2=0x7f52a80cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.892+0000 7f52ad96c640 1 --2- 172.21.15.194:0/1882574592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e0e0 0x7f52a80cca10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f529c00e9b0 tx=0x7f529c00ee70 comp rx=0 tx=0).stop 2024-03-16T17:47:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.892+0000 7f52ad96c640 1 -- 172.21.15.194:0/1882574592 shutdown_connections 2024-03-16T17:47:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.892+0000 7f52ad96c640 1 --2- 172.21.15.194:0/1882574592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52a815e4c0 0x7f52a806c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.892+0000 7f52ad96c640 1 --2- 172.21.15.194:0/1882574592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52a815e0e0 0x7f52a80cca10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.892+0000 7f52ad96c640 1 --2- 172.21.15.194:0/1882574592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52a80d2aa0 0x7f52a81f32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.892+0000 7f52ad96c640 1 -- 172.21.15.194:0/1882574592 >> 172.21.15.194:0/1882574592 conn(0x7f52a80d3ed0 msgr2=0x7f52a80c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.892+0000 7f52ad96c640 1 -- 172.21.15.194:0/1882574592 shutdown_connections 2024-03-16T17:47:27.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-16T17:47:27.892+0000 7f52ad96c640 1 -- 172.21.15.194:0/1882574592 wait complete. 2024-03-16T17:47:27.898 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:27.895+0000 7f611ee4c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T17:47:27.906 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-16T17:47:27.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-16T17:47:27.908 INFO:tasks.ceph.osd.0:Started 2024-03-16T17:47:27.908 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-16T17:47:27.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-16T17:47:27.910 INFO:tasks.ceph.osd.1:Started 2024-03-16T17:47:27.910 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-16T17:47:27.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-16T17:47:27.913 INFO:tasks.ceph.osd.2:Started 2024-03-16T17:47:27.913 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-16T17:47:27.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-16T17:47:27.915 INFO:tasks.ceph.osd.3:Started 2024-03-16T17:47:27.915 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-16T17:47:27.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-16T17:47:27.917 INFO:tasks.ceph.osd.4:Started 2024-03-16T17:47:27.917 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-16T17:47:27.917 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-16T17:47:27.919 INFO:tasks.ceph.osd.5:Started 2024-03-16T17:47:27.919 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-16T17:47:27.920 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-16T17:47:27.921 INFO:tasks.ceph.osd.6:Started 2024-03-16T17:47:27.922 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-16T17:47:27.922 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-16T17:47:27.924 INFO:tasks.ceph.osd.7:Started 2024-03-16T17:47:27.924 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:27.955 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:27.951+0000 7f611ee4c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T17:47:28.035 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:28.032+0000 7f97a1232040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-16T17:47:28.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.043+0000 7fcb60ff4640 1 Processor -- start 2024-03-16T17:47:28.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.043+0000 7fcb60ff4640 1 -- start start 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.044+0000 7fcb60ff4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 0x7fcb5c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.044+0000 7fcb60ff4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcb5c0d1980 0x7fcb5c0d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.044+0000 7fcb60ff4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5c0d0680 con 0x7fcb5c161540 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.044+0000 7fcb60ff4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5c0b4f30 con 0x7fcb5c0d1980 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.044+0000 7fcb60ff4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0d08d0 con 0x7fcb5c0b3560 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.044+0000 7fcb5a59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcb5c161540 0x7fcb5c0cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41370/0 (socket says 172.21.15.132:41370) 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.044+0000 7fcb5a59c640 1 -- 172.21.15.132:0/1889303431 learned_addr learned my addr 172.21.15.132:0/1889303431 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.045+0000 7fcb5ad9d640 1 --2- 172.21.15.132:0/1889303431 >> v2:172.21.15.194:3300/0 conn(0x7fcb5c0d1980 0x7fcb5c0d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.045+0000 7fcb59d9b640 1 --2- 172.21.15.132:0/1889303431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 0x7fcb5c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.045+0000 7fcb5959a640 1 -- 172.21.15.132:0/1889303431 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936875229 0 0) 0x7fcb5c0d0680 con 0x7fcb5c161540 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.045+0000 7fcb5959a640 1 -- 172.21.15.132:0/1889303431 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb44003520 con 0x7fcb5c161540 2024-03-16T17:47:28.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.045+0000 7fcb59d9b640 1 -- 172.21.15.132:0/1889303431 >> v2:172.21.15.194:3300/0 conn(0x7fcb5c0d1980 msgr2=0x7fcb5c0d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:28.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.045+0000 7fcb59d9b640 1 --2- 172.21.15.132:0/1889303431 >> v2:172.21.15.194:3300/0 conn(0x7fcb5c0d1980 0x7fcb5c0d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:28.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.045+0000 7fcb59d9b640 1 -- 172.21.15.132:0/1889303431 >> v1:172.21.15.132:6789/0 conn(0x7fcb5c161540 legacy=0x7fcb5c0cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:28.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.045+0000 7fcb59d9b640 1 -- 172.21.15.132:0/1889303431 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c0d0bb0 con 0x7fcb5c0b3560 2024-03-16T17:47:28.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.045+0000 7fcb5ad9d640 1 --2- 172.21.15.132:0/1889303431 >> v2:172.21.15.194:3300/0 conn(0x7fcb5c0d1980 0x7fcb5c0d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:28.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.046+0000 7fcb59d9b640 1 --2- 172.21.15.132:0/1889303431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 0x7fcb5c0cf790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0097a0 tx=0x7fcb4c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a80c8d3f7feb0c6c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:28.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.046+0000 7fcb5959a640 1 -- 172.21.15.132:0/1889303431 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c02d040 con 0x7fcb5c0b3560 2024-03-16T17:47:28.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.046+0000 7fcb5959a640 1 -- 172.21.15.132:0/1889303431 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c031810 con 0x7fcb5c0b3560 2024-03-16T17:47:28.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.046+0000 7fcb5959a640 1 -- 172.21.15.132:0/1889303431 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c031ba0 con 0x7fcb5c0b3560 2024-03-16T17:47:28.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.046+0000 7fcb60ff4640 1 -- 172.21.15.132:0/1889303431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 msgr2=0x7fcb5c0cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:28.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.046+0000 7fcb60ff4640 1 --2- 172.21.15.132:0/1889303431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 0x7fcb5c0cf790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0097a0 tx=0x7fcb4c02b8b0 comp rx=0 tx=0).stop 2024-03-16T17:47:28.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.046+0000 7fcb60ff4640 1 -- 172.21.15.132:0/1889303431 shutdown_connections 2024-03-16T17:47:28.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.046+0000 7fcb60ff4640 1 --2- 172.21.15.132:0/1889303431 >> v2:172.21.15.194:3300/0 conn(0x7fcb5c0d1980 0x7fcb5c0d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:28.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.046+0000 7fcb60ff4640 1 --2- 172.21.15.132:0/1889303431 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 0x7fcb5c0cf790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:28.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.046+0000 7fcb60ff4640 1 -- 172.21.15.132:0/1889303431 >> 172.21.15.132:0/1889303431 conn(0x7fcb5c09d120 msgr2=0x7fcb5c0d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:28.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.047+0000 7fcb60ff4640 1 -- 172.21.15.132:0/1889303431 shutdown_connections 2024-03-16T17:47:28.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.047+0000 7fcb60ff4640 1 -- 172.21.15.132:0/1889303431 wait complete. 2024-03-16T17:47:28.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.048+0000 7fcb60ff4640 1 Processor -- start 2024-03-16T17:47:28.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.048+0000 7fcb60ff4640 1 -- start start 2024-03-16T17:47:28.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb60ff4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 0x7fcb5c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:28.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb60ff4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb5c0d1980 0x7fcb5c0c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:28.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb60ff4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb5c161540 0x7fcb5c154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb60ff4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0cba60 con 0x7fcb5c0d1980 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb60ff4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0cc020 con 0x7fcb5c161540 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb60ff4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0ca480 con 0x7fcb5c0b3560 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb5a59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 0x7fcb5c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb59d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb5c0d1980 0x7fcb5c0c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb5ad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb5c161540 0x7fcb5c154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb5a59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 0x7fcb5c0cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:40828/0 (socket says 172.21.15.132:40828) 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb59d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb5c0d1980 0x7fcb5c0c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35004/0 (socket says 172.21.15.132:35004) 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb5a59c640 1 -- 172.21.15.132:0/3946714616 learned_addr learned my addr 172.21.15.132:0/3946714616 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb59d9b640 1 -- 172.21.15.132:0/3946714616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 msgr2=0x7fcb5c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb59d9b640 1 --2- 172.21.15.132:0/3946714616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 0x7fcb5c0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb59d9b640 1 -- 172.21.15.132:0/3946714616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb5c161540 msgr2=0x7fcb5c154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:28.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb59d9b640 1 --2- 172.21.15.132:0/3946714616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb5c161540 0x7fcb5c154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:28.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb59d9b640 1 -- 172.21.15.132:0/3946714616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54009a70 con 0x7fcb5c0d1980 2024-03-16T17:47:28.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb59d9b640 1 --2- 172.21.15.132:0/3946714616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb5c0d1980 0x7fcb5c0c9f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0d0a10 tx=0x7fcb4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:28.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb4affd640 1 -- 172.21.15.132:0/3946714616 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c006e10 con 0x7fcb5c0d1980 2024-03-16T17:47:28.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb4affd640 1 -- 172.21.15.132:0/3946714616 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c03ad60 con 0x7fcb5c0d1980 2024-03-16T17:47:28.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb60ff4640 1 -- 172.21.15.132:0/3946714616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c009400 con 0x7fcb5c0d1980 2024-03-16T17:47:28.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb4affd640 1 -- 172.21.15.132:0/3946714616 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c042650 con 0x7fcb5c0d1980 2024-03-16T17:47:28.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.049+0000 7fcb60ff4640 1 -- 172.21.15.132:0/3946714616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c154560 con 0x7fcb5c0d1980 2024-03-16T17:47:28.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.050+0000 7fcb4affd640 1 -- 172.21.15.132:0/3946714616 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcb4c0427b0 con 0x7fcb5c0d1980 2024-03-16T17:47:28.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.050+0000 7fcb4affd640 1 -- 172.21.15.132:0/3946714616 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcb4c04b450 con 0x7fcb5c0d1980 2024-03-16T17:47:28.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.051+0000 7fcb60ff4640 1 -- 172.21.15.132:0/3946714616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5c161920 con 0x7fcb5c0d1980 2024-03-16T17:47:28.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.053+0000 7fcb4affd640 1 -- 172.21.15.132:0/3946714616 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fcb4c035020 con 0x7fcb5c0d1980 2024-03-16T17:47:28.082 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:28.079+0000 7f97a1232040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-16T17:47:28.089 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:28.085+0000 7f611ee4c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T17:47:28.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.113+0000 7fcb60ff4640 1 -- 172.21.15.132:0/3946714616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb5c04f2c0 con 0x7fcb5c0d1980 2024-03-16T17:47:28.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.114+0000 7fcb4affd640 1 -- 172.21.15.132:0/3946714616 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fcb4c04b9f0 con 0x7fcb5c0d1980 2024-03-16T17:47:28.118 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:28.118 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":10,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:27.888004+0000","last_up_change":"0.000000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:28.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.115+0000 7fcb60ff4640 1 -- 172.21.15.132:0/3946714616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb5c0d1980 msgr2=0x7fcb5c0c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:28.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.115+0000 7fcb60ff4640 1 --2- 172.21.15.132:0/3946714616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb5c0d1980 0x7fcb5c0c9f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0d0a10 tx=0x7fcb4c0046c0 comp rx=0 tx=0).stop 2024-03-16T17:47:28.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.115+0000 7fcb60ff4640 1 -- 172.21.15.132:0/3946714616 shutdown_connections 2024-03-16T17:47:28.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.115+0000 7fcb60ff4640 1 --2- 172.21.15.132:0/3946714616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb5c161540 0x7fcb5c154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:28.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.115+0000 7fcb60ff4640 1 --2- 172.21.15.132:0/3946714616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb5c0d1980 0x7fcb5c0c9f40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:28.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.115+0000 7fcb60ff4640 1 --2- 172.21.15.132:0/3946714616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb5c0b3560 0x7fcb5c0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:28.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.115+0000 7fcb60ff4640 1 -- 172.21.15.132:0/3946714616 >> 172.21.15.132:0/3946714616 conn(0x7fcb5c09d120 msgr2=0x7fcb5c06c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:28.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.115+0000 7fcb60ff4640 1 -- 172.21.15.132:0/3946714616 shutdown_connections 2024-03-16T17:47:28.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:28.115+0000 7fcb60ff4640 1 -- 172.21.15.132:0/3946714616 wait complete. 2024-03-16T17:47:28.129 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-16T17:47:28.129 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-16T17:47:28.188 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:28.184+0000 7f611ee4c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T17:47:28.193 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:28.190+0000 7f97a1232040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-16T17:47:28.289 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:28.286+0000 7f97a1232040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-16T17:47:28.343 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:28.339+0000 7f611ee4c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T17:47:28.384 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:28.381+0000 7f611ee4c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T17:47:28.443 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:28.439+0000 7f97a1232040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-16T17:47:28.484 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:28.481+0000 7f97a1232040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-16T17:47:28.521 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T17:47:28.518+0000 7fbaf7a0f640 -1 Falling back to public interface 2024-03-16T17:47:28.522 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T17:47:28.518+0000 7fdcc0020640 -1 Falling back to public interface 2024-03-16T17:47:28.522 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T17:47:28.518+0000 7fdcbe911640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-03-16T17:47:28.525 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T17:47:28.521+0000 7f9fd8c0d640 -1 Falling back to public interface 2024-03-16T17:47:28.538 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:28.535+0000 7f611ee4c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T17:47:28.542 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T17:47:28.538+0000 7ff304b16640 -1 Falling back to public interface 2024-03-16T17:47:28.542 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T17:47:28.538+0000 7fac01973640 -1 Falling back to public interface 2024-03-16T17:47:28.542 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T17:47:28.539+0000 7f94d8cf7640 -1 Falling back to public interface 2024-03-16T17:47:28.550 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T17:47:28.547+0000 7fca00b2a640 -1 Falling back to public interface 2024-03-16T17:47:28.555 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T17:47:28.552+0000 7f77b7549640 -1 Falling back to public interface 2024-03-16T17:47:28.645 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:28.642+0000 7f97a1232040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-16T17:47:28.934 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:29.025 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.021+0000 7fd04e73e640 1 Processor -- start 2024-03-16T17:47:29.025 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.021+0000 7fd04e73e640 1 -- start start 2024-03-16T17:47:29.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.022+0000 7fd04e73e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd04815df70 0x7fd0480c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.022+0000 7fd04e73e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd04806aee0 0x7fd04806b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.022+0000 7fd04e73e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04806b870 con 0x7fd04815e350 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.022+0000 7fd04e73e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0480ced20 con 0x7fd04815df70 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.022+0000 7fd04e73e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0480c6a70 con 0x7fd04806aee0 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.022+0000 7fd047fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd04815df70 0x7fd0480c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.022+0000 7fd047fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd04815df70 0x7fd0480c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35008/0 (socket says 172.21.15.132:35008) 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.022+0000 7fd047fff640 1 -- 172.21.15.132:0/3092289141 learned_addr learned my addr 172.21.15.132:0/3092289141 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.022+0000 7fd04ccdb640 1 --2- 172.21.15.132:0/3092289141 >> v2:172.21.15.194:3300/0 conn(0x7fd04806aee0 0x7fd04806b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.023+0000 7fd047fff640 1 -- 172.21.15.132:0/3092289141 >> v2:172.21.15.194:3300/0 conn(0x7fd04806aee0 msgr2=0x7fd04806b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.023+0000 7fd047fff640 1 --2- 172.21.15.132:0/3092289141 >> v2:172.21.15.194:3300/0 conn(0x7fd04806aee0 0x7fd04806b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.023+0000 7fd047fff640 1 -- 172.21.15.132:0/3092289141 >> v1:172.21.15.194:6789/0 conn(0x7fd04815e350 legacy=0x7fd0480cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:29.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.023+0000 7fd047fff640 1 -- 172.21.15.132:0/3092289141 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0480ce760 con 0x7fd04815df70 2024-03-16T17:47:29.028 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.023+0000 7fd047fff640 1 --2- 172.21.15.132:0/3092289141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04815df70 0x7fd0480c6f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0480623a0 tx=0x7fd03c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25813812f70c9843 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:29.029 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.023+0000 7fd046ffd640 1 -- 172.21.15.132:0/3092289141 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c030860 con 0x7fd04815df70 2024-03-16T17:47:29.029 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.024+0000 7fd046ffd640 1 -- 172.21.15.132:0/3092289141 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c0309c0 con 0x7fd04815df70 2024-03-16T17:47:29.029 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.024+0000 7fd046ffd640 1 -- 172.21.15.132:0/3092289141 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c030d50 con 0x7fd04815df70 2024-03-16T17:47:29.029 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.024+0000 7fd04e73e640 1 -- 172.21.15.132:0/3092289141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04815df70 msgr2=0x7fd0480c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:29.029 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.024+0000 7fd04e73e640 1 --2- 172.21.15.132:0/3092289141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04815df70 0x7fd0480c6f00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0480623a0 tx=0x7fd03c02b9a0 comp rx=0 tx=0).stop 2024-03-16T17:47:29.029 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.024+0000 7fd04e73e640 1 -- 172.21.15.132:0/3092289141 shutdown_connections 2024-03-16T17:47:29.029 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.024+0000 7fd04e73e640 1 --2- 172.21.15.132:0/3092289141 >> v2:172.21.15.194:3300/0 conn(0x7fd04806aee0 0x7fd04806b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:29.030 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.024+0000 7fd04e73e640 1 --2- 172.21.15.132:0/3092289141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04815df70 0x7fd0480c6f00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:29.030 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.024+0000 7fd04e73e640 1 -- 172.21.15.132:0/3092289141 >> 172.21.15.132:0/3092289141 conn(0x7fd04806bff0 msgr2=0x7fd04806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:29.030 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.024+0000 7fd04e73e640 1 -- 172.21.15.132:0/3092289141 shutdown_connections 2024-03-16T17:47:29.030 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.024+0000 7fd04e73e640 1 -- 172.21.15.132:0/3092289141 wait complete. 2024-03-16T17:47:29.030 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.025+0000 7fd04e73e640 1 Processor -- start 2024-03-16T17:47:29.030 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd04e73e640 1 -- start start 2024-03-16T17:47:29.032 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd04e73e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04806aee0 0x7fd0481f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:29.032 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd04e73e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd04815df70 0x7fd048158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:29.032 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd04e73e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd04815e350 0x7fd0480c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:29.032 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd04e73e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480c7ac0 con 0x7fd04806aee0 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd04e73e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481f43f0 con 0x7fd04815df70 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd04e73e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481f46d0 con 0x7fd04815e350 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd047fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04806aee0 0x7fd0481f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd047fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04806aee0 0x7fd0481f3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35010/0 (socket says 172.21.15.132:35010) 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd047fff640 1 -- 172.21.15.132:0/2585448653 learned_addr learned my addr 172.21.15.132:0/2585448653 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd0477fe640 1 --2- 172.21.15.132:0/2585448653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd04815df70 0x7fd048158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.026+0000 7fd04ccdb640 1 --2- 172.21.15.132:0/2585448653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd04815e350 0x7fd0480c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd047fff640 1 -- 172.21.15.132:0/2585448653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd04815e350 msgr2=0x7fd0480c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd047fff640 1 --2- 172.21.15.132:0/2585448653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd04815e350 0x7fd0480c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd047fff640 1 -- 172.21.15.132:0/2585448653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd04815df70 msgr2=0x7fd048158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd047fff640 1 --2- 172.21.15.132:0/2585448653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd04815df70 0x7fd048158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd047fff640 1 -- 172.21.15.132:0/2585448653 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c0094d0 con 0x7fd04806aee0 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd047fff640 1 --2- 172.21.15.132:0/2585448653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04806aee0 0x7fd0481f3b30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd03c02b9e0 tx=0x7fd03c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:29.033 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd044ff9640 1 -- 172.21.15.132:0/2585448653 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c039c90 con 0x7fd04806aee0 2024-03-16T17:47:29.034 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd044ff9640 1 -- 172.21.15.132:0/2585448653 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c039e10 con 0x7fd04806aee0 2024-03-16T17:47:29.034 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd044ff9640 1 -- 172.21.15.132:0/2585448653 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c043640 con 0x7fd04806aee0 2024-03-16T17:47:29.034 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd04e73e640 1 -- 172.21.15.132:0/2585448653 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0481f49b0 con 0x7fd04806aee0 2024-03-16T17:47:29.034 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd04e73e640 1 -- 172.21.15.132:0/2585448653 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0481f4070 con 0x7fd04806aee0 2024-03-16T17:47:29.034 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd044ff9640 1 -- 172.21.15.132:0/2585448653 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd03c0437a0 con 0x7fd04806aee0 2024-03-16T17:47:29.035 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.027+0000 7fd044ff9640 1 -- 172.21.15.132:0/2585448653 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd03c03e070 con 0x7fd04806aee0 2024-03-16T17:47:29.035 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.028+0000 7fd04e73e640 1 -- 172.21.15.132:0/2585448653 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0480c7fa0 con 0x7fd04806aee0 2024-03-16T17:47:29.035 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.030+0000 7fd044ff9640 1 -- 172.21.15.132:0/2585448653 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd0480c7fa0 con 0x7fd04806aee0 2024-03-16T17:47:29.095 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.091+0000 7fd04e73e640 1 -- 172.21.15.132:0/2585448653 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd048068400 con 0x7fd04806aee0 2024-03-16T17:47:29.095 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.092+0000 7fd044ff9640 1 -- 172.21.15.132:0/2585448653 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fd03c034070 con 0x7fd04806aee0 2024-03-16T17:47:29.095 INFO:teuthology.misc.health.smithi132.stdout: 2024-03-16T17:47:29.096 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":10,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:27.888004+0000","last_up_change":"0.000000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:29.096 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.092+0000 7fd04e73e640 1 -- 172.21.15.132:0/2585448653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04806aee0 msgr2=0x7fd0481f3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:29.097 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.092+0000 7fd04e73e640 1 --2- 172.21.15.132:0/2585448653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04806aee0 0x7fd0481f3b30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd03c02b9e0 tx=0x7fd03c004730 comp rx=0 tx=0).stop 2024-03-16T17:47:29.097 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.093+0000 7fd04e73e640 1 -- 172.21.15.132:0/2585448653 shutdown_connections 2024-03-16T17:47:29.097 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.093+0000 7fd04e73e640 1 --2- 172.21.15.132:0/2585448653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd04815e350 0x7fd0480c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:29.097 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.093+0000 7fd04e73e640 1 --2- 172.21.15.132:0/2585448653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd04815df70 0x7fd048158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:29.097 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.093+0000 7fd04e73e640 1 --2- 172.21.15.132:0/2585448653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04806aee0 0x7fd0481f3b30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:29.097 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.093+0000 7fd04e73e640 1 -- 172.21.15.132:0/2585448653 >> 172.21.15.132:0/2585448653 conn(0x7fd04806bff0 msgr2=0x7fd0480cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:29.097 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.093+0000 7fd04e73e640 1 -- 172.21.15.132:0/2585448653 shutdown_connections 2024-03-16T17:47:29.097 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:29.093+0000 7fd04e73e640 1 -- 172.21.15.132:0/2585448653 wait complete. 2024-03-16T17:47:29.107 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-16T17:47:29.382 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:29.379+0000 7f611ee4c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T17:47:29.462 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:29.458+0000 7f97a1232040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-16T17:47:29.659 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:29.656+0000 7f611ee4c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T17:47:29.712 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:29.708+0000 7f611ee4c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T17:47:29.738 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:29.735+0000 7f97a1232040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-16T17:47:29.789 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:29.785+0000 7f97a1232040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-16T17:47:29.824 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:29.821+0000 7f611ee4c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T17:47:29.909 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-03-16T17:47:29.905+0000 7f97a1232040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-16T17:47:30.850 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:30.847+0000 7f60bfa10640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-16T17:47:30.851 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-03-16T17:47:30.848+0000 7f60bfa10640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-16T17:47:31.986 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T17:47:31.982+0000 7fbaf7a0f640 -1 osd.4 0 log_to_monitors true 2024-03-16T17:47:32.007 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T17:47:32.003+0000 7f9fd8c0d640 -1 osd.2 0 log_to_monitors true 2024-03-16T17:47:32.018 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T17:47:32.014+0000 7fdcc0020640 -1 osd.5 0 log_to_monitors true 2024-03-16T17:47:32.044 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T17:47:32.040+0000 7ff304b16640 -1 osd.7 0 log_to_monitors true 2024-03-16T17:47:32.055 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T17:47:32.051+0000 7fca00b2a640 -1 osd.3 0 log_to_monitors true 2024-03-16T17:47:32.065 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T17:47:32.060+0000 7f77b7549640 -1 osd.6 0 log_to_monitors true 2024-03-16T17:47:32.088 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T17:47:32.085+0000 7f94d8cf7640 -1 osd.1 0 log_to_monitors true 2024-03-16T17:47:32.089 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T17:47:32.085+0000 7fac01973640 -1 osd.0 0 log_to_monitors true 2024-03-16T17:47:35.882 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T17:47:35.879+0000 7f77b2cbc640 -1 osd.6 0 waiting for initial osdmap 2024-03-16T17:47:35.897 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T17:47:35.894+0000 7f77ab2ee640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T17:47:35.914 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:35.927 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T17:47:35.923+0000 7fdcbb0d5640 -1 osd.5 0 waiting for initial osdmap 2024-03-16T17:47:35.934 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T17:47:35.930+0000 7f9fd3d5a640 -1 osd.2 0 waiting for initial osdmap 2024-03-16T17:47:35.939 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T17:47:35.936+0000 7fdcb3707640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T17:47:35.950 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T17:47:35.946+0000 7f9fcc38c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T17:47:35.951 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T17:47:35.947+0000 7fabfd0e6640 -1 osd.0 0 waiting for initial osdmap 2024-03-16T17:47:35.965 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T17:47:35.962+0000 7fabf5718640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T17:47:35.967 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T17:47:35.964+0000 7f94d446a640 -1 osd.1 0 waiting for initial osdmap 2024-03-16T17:47:35.979 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T17:47:35.976+0000 7ff300289640 -1 osd.7 0 waiting for initial osdmap 2024-03-16T17:47:35.980 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T17:47:35.976+0000 7f94cca9c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T17:47:35.981 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T17:47:35.978+0000 7fbaf3182640 -1 osd.4 0 waiting for initial osdmap 2024-03-16T17:47:35.990 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T17:47:35.986+0000 7fc9fc29d640 -1 osd.3 0 waiting for initial osdmap 2024-03-16T17:47:35.997 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T17:47:35.994+0000 7fbaeb7b4640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T17:47:35.997 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T17:47:35.994+0000 7ff2f88bb640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T17:47:36.000 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T17:47:35.997+0000 7fc9f48cf640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-16T17:47:36.017 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.014+0000 7fb8a082a640 1 Processor -- start 2024-03-16T17:47:36.017 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.014+0000 7fb8a082a640 1 -- start start 2024-03-16T17:47:36.019 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb8a082a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb89c161790 0x7fb89c0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:36.019 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb8a082a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb89c0d07f0 0x7fb89c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb8a082a640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89c0d1190 con 0x7fb89c0d19d0 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb8a082a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c0cecb0 con 0x7fb89c0d07f0 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb8a082a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c0d2e50 con 0x7fb89c161790 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb891d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb89c0d07f0 0x7fb89c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb891d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb89c0d07f0 0x7fb89c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35118/0 (socket says 172.21.15.132:35118) 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb891d9b640 1 -- 172.21.15.132:0/1838641110 learned_addr learned my addr 172.21.15.132:0/1838641110 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb89a59c640 1 --2- 172.21.15.132:0/1838641110 >> v2:172.21.15.194:3300/0 conn(0x7fb89c161790 0x7fb89c0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb891d9b640 1 -- 172.21.15.132:0/1838641110 >> v2:172.21.15.194:3300/0 conn(0x7fb89c161790 msgr2=0x7fb89c0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb891d9b640 1 --2- 172.21.15.132:0/1838641110 >> v2:172.21.15.194:3300/0 conn(0x7fb89c161790 0x7fb89c0b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb891d9b640 1 -- 172.21.15.132:0/1838641110 >> v1:172.21.15.194:6789/0 conn(0x7fb89c0d19d0 legacy=0x7fb89c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.015+0000 7fb891d9b640 1 -- 172.21.15.132:0/1838641110 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0ce9a0 con 0x7fb89c0d07f0 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb891d9b640 1 --2- 172.21.15.132:0/1838641110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 0x7fb89c0d0c50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb89c08c680 tx=0x7fb88402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a7093a0804b1f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb899d9b640 1 -- 172.21.15.132:0/1838641110 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884030860 con 0x7fb89c0d07f0 2024-03-16T17:47:36.020 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb899d9b640 1 -- 172.21.15.132:0/1838641110 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8840309c0 con 0x7fb89c0d07f0 2024-03-16T17:47:36.021 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb899d9b640 1 -- 172.21.15.132:0/1838641110 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb884030d50 con 0x7fb89c0d07f0 2024-03-16T17:47:36.022 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb8a082a640 1 -- 172.21.15.132:0/1838641110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 msgr2=0x7fb89c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:36.022 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb8a082a640 1 --2- 172.21.15.132:0/1838641110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 0x7fb89c0d0c50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb89c08c680 tx=0x7fb88402b9a0 comp rx=0 tx=0).stop 2024-03-16T17:47:36.022 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb8a082a640 1 -- 172.21.15.132:0/1838641110 shutdown_connections 2024-03-16T17:47:36.022 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb8a082a640 1 --2- 172.21.15.132:0/1838641110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 0x7fb89c0d0c50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:36.022 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb8a082a640 1 --2- 172.21.15.132:0/1838641110 >> v2:172.21.15.194:3300/0 conn(0x7fb89c161790 0x7fb89c0b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:36.022 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb8a082a640 1 -- 172.21.15.132:0/1838641110 >> 172.21.15.132:0/1838641110 conn(0x7fb89c09d0d0 msgr2=0x7fb89c0d3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:36.022 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.016+0000 7fb8a082a640 1 -- 172.21.15.132:0/1838641110 shutdown_connections 2024-03-16T17:47:36.022 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.017+0000 7fb8a082a640 1 -- 172.21.15.132:0/1838641110 wait complete. 2024-03-16T17:47:36.022 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.018+0000 7fb8a082a640 1 Processor -- start 2024-03-16T17:47:36.022 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.018+0000 7fb8a082a640 1 -- start start 2024-03-16T17:47:36.025 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8a082a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 0x7fb89c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:36.025 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8a082a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c0d19d0 0x7fb89c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:36.025 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8a082a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb89c161790 0x7fb89c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:36.025 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8a082a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c153630 con 0x7fb89c0d07f0 2024-03-16T17:47:36.025 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8a082a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c0cc920 con 0x7fb89c0d19d0 2024-03-16T17:47:36.025 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8a082a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c0ccc00 con 0x7fb89c161790 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 0x7fb89c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 0x7fb89c1550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35128/0 (socket says 172.21.15.132:35128) 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89a59c640 1 -- 172.21.15.132:0/119759943 learned_addr learned my addr 172.21.15.132:0/119759943 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb891d9b640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c0d19d0 0x7fb89c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89ad9d640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb89c161790 0x7fb89c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89a59c640 1 -- 172.21.15.132:0/119759943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb89c161790 msgr2=0x7fb89c0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89a59c640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb89c161790 0x7fb89c0cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89a59c640 1 -- 172.21.15.132:0/119759943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c0d19d0 msgr2=0x7fb89c1530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89a59c640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c0d19d0 0x7fb89c1530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89a59c640 1 -- 172.21.15.132:0/119759943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8840094d0 con 0x7fb89c0d07f0 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89ad9d640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb89c161790 0x7fb89c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:36.026 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb89a59c640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 0x7fb89c1550e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00e9b0 tx=0x7fb88c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8937fe640 1 -- 172.21.15.132:0/119759943 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c009670 con 0x7fb89c0d07f0 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8937fe640 1 -- 172.21.15.132:0/119759943 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c00c9a0 con 0x7fb89c0d07f0 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8a082a640 1 -- 172.21.15.132:0/119759943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89c0ccee0 con 0x7fb89c0d07f0 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8937fe640 1 -- 172.21.15.132:0/119759943 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00cd50 con 0x7fb89c0d07f0 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.019+0000 7fb8a082a640 1 -- 172.21.15.132:0/119759943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c0cd4a0 con 0x7fb89c0d07f0 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.020+0000 7fb8a082a640 1 -- 172.21.15.132:0/119759943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89c068440 con 0x7fb89c0d07f0 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.021+0000 7fb8937fe640 1 -- 172.21.15.132:0/119759943 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 4) v1 ==== 89406+0+0 (secure 0 0 0) 0x7fb88c013470 con 0x7fb89c0d07f0 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.021+0000 7fb8937fe640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb87c06b320 0x7fb87c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.021+0000 7fb891d9b640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb87c06b320 0x7fb87c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.021+0000 7fb8937fe640 1 -- 172.21.15.132:0/119759943 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fb88c088f00 con 0x7fb89c0d07f0 2024-03-16T17:47:36.027 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.022+0000 7fb891d9b640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb87c06b320 0x7fb87c06d7e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb884036000 tx=0x7fb884008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:36.029 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.026+0000 7fb8937fe640 1 -- 172.21.15.132:0/119759943 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb88c054a80 con 0x7fb89c0d07f0 2024-03-16T17:47:36.202 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.198+0000 7fb8a082a640 1 -- 172.21.15.132:0/119759943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb89c068130 con 0x7fb89c0d07f0 2024-03-16T17:47:36.203 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.199+0000 7fb8937fe640 1 -- 172.21.15.132:0/119759943 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fb88c021090 con 0x7fb89c0d07f0 2024-03-16T17:47:36.203 INFO:teuthology.misc.health.smithi132.stdout: 2024-03-16T17:47:36.203 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":12,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:33.849478+0000","last_up_change":"0.000000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:36.205 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 -- 172.21.15.132:0/119759943 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb87c06b320 msgr2=0x7fb87c06d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:36.205 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb87c06b320 0x7fb87c06d7e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb884036000 tx=0x7fb884008030 comp rx=0 tx=0).stop 2024-03-16T17:47:36.205 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 -- 172.21.15.132:0/119759943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 msgr2=0x7fb89c1550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:36.205 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 0x7fb89c1550e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00e9b0 tx=0x7fb88c00ee70 comp rx=0 tx=0).stop 2024-03-16T17:47:36.205 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 -- 172.21.15.132:0/119759943 shutdown_connections 2024-03-16T17:47:36.205 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb87c06b320 0x7fb87c06d7e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:36.206 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb89c161790 0x7fb89c0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:36.206 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c0d19d0 0x7fb89c1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:36.206 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 --2- 172.21.15.132:0/119759943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb89c0d07f0 0x7fb89c1550e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:36.206 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 -- 172.21.15.132:0/119759943 >> 172.21.15.132:0/119759943 conn(0x7fb89c09d0d0 msgr2=0x7fb89c0b7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:36.206 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 -- 172.21.15.132:0/119759943 shutdown_connections 2024-03-16T17:47:36.206 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:36.201+0000 7fb8a082a640 1 -- 172.21.15.132:0/119759943 wait complete. 2024-03-16T17:47:36.215 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-16T17:47:43.022 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:43.122 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.119+0000 7f25b4447640 1 Processor -- start 2024-03-16T17:47:43.123 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.119+0000 7f25b4447640 1 -- start start 2024-03-16T17:47:43.124 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b4447640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f25ac0d0f00 0x7f25ac0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.124 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b4447640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25ac0d19d0 0x7f25ac0d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.124 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b4447640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ac0cecb0 con 0x7f25ac161790 2024-03-16T17:47:43.124 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b4447640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ac0d2e50 con 0x7f25ac0d19d0 2024-03-16T17:47:43.124 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b4447640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25ac0d2340 con 0x7f25ac0d0f00 2024-03-16T17:47:43.124 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b29e4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25ac0d19d0 0x7f25ac0d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.124 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b29e4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25ac0d19d0 0x7f25ac0d1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38094/0 (socket says 172.21.15.132:38094) 2024-03-16T17:47:43.124 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b29e4640 1 -- 172.21.15.132:0/1038223474 learned_addr learned my addr 172.21.15.132:0/1038223474 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:43.125 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b19e2640 1 --2- 172.21.15.132:0/1038223474 >> v2:172.21.15.194:3300/0 conn(0x7f25ac0d0f00 0x7f25ac0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.125 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b29e4640 1 -- 172.21.15.132:0/1038223474 >> v2:172.21.15.194:3300/0 conn(0x7f25ac0d0f00 msgr2=0x7f25ac0b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:43.125 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b29e4640 1 --2- 172.21.15.132:0/1038223474 >> v2:172.21.15.194:3300/0 conn(0x7f25ac0d0f00 0x7f25ac0b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.125 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b29e4640 1 -- 172.21.15.132:0/1038223474 >> v1:172.21.15.194:6789/0 conn(0x7f25ac161790 legacy=0x7f25ac0d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.125 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.120+0000 7f25b29e4640 1 -- 172.21.15.132:0/1038223474 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac0ce9a0 con 0x7f25ac0d19d0 2024-03-16T17:47:43.126 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.121+0000 7f25b29e4640 1 --2- 172.21.15.132:0/1038223474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac0d19d0 0x7f25ac0d1e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0d4f00 tx=0x7f25a402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2ebdb66e9aafac server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:43.126 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.121+0000 7f25b11e1640 1 -- 172.21.15.132:0/1038223474 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a402cb20 con 0x7f25ac0d19d0 2024-03-16T17:47:43.126 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.121+0000 7f25b11e1640 1 -- 172.21.15.132:0/1038223474 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a402cc80 con 0x7f25ac0d19d0 2024-03-16T17:47:43.126 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.121+0000 7f25b11e1640 1 -- 172.21.15.132:0/1038223474 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40343f0 con 0x7f25ac0d19d0 2024-03-16T17:47:43.126 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.122+0000 7f25b4447640 1 -- 172.21.15.132:0/1038223474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac0d19d0 msgr2=0x7f25ac0d1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.126 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.122+0000 7f25b4447640 1 --2- 172.21.15.132:0/1038223474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac0d19d0 0x7f25ac0d1e00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0d4f00 tx=0x7f25a402bf80 comp rx=0 tx=0).stop 2024-03-16T17:47:43.126 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.122+0000 7f25b4447640 1 -- 172.21.15.132:0/1038223474 shutdown_connections 2024-03-16T17:47:43.127 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.122+0000 7f25b4447640 1 --2- 172.21.15.132:0/1038223474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac0d19d0 0x7f25ac0d1e00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.127 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.122+0000 7f25b4447640 1 --2- 172.21.15.132:0/1038223474 >> v2:172.21.15.194:3300/0 conn(0x7f25ac0d0f00 0x7f25ac0b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.127 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.122+0000 7f25b4447640 1 -- 172.21.15.132:0/1038223474 >> 172.21.15.132:0/1038223474 conn(0x7f25ac09d0d0 msgr2=0x7f25ac0d3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:43.127 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.122+0000 7f25b4447640 1 -- 172.21.15.132:0/1038223474 shutdown_connections 2024-03-16T17:47:43.127 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.122+0000 7f25b4447640 1 -- 172.21.15.132:0/1038223474 wait complete. 2024-03-16T17:47:43.129 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.123+0000 7f25b4447640 1 Processor -- start 2024-03-16T17:47:43.129 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.123+0000 7f25b4447640 1 -- start start 2024-03-16T17:47:43.129 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b4447640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25ac0d0f00 0x7f25ac1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.129 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b4447640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25ac0d19d0 0x7f25ac15fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.129 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b4447640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac161790 0x7f25ac0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.129 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b4447640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac154710 con 0x7f25ac161790 2024-03-16T17:47:43.129 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b4447640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac1540c0 con 0x7f25ac0d19d0 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b4447640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac153af0 con 0x7f25ac0d0f00 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b29e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac161790 0x7f25ac0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b29e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac161790 0x7f25ac0cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38102/0 (socket says 172.21.15.132:38102) 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b29e4640 1 -- 172.21.15.132:0/2251818656 learned_addr learned my addr 172.21.15.132:0/2251818656 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b19e2640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25ac0d19d0 0x7f25ac15fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b21e3640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25ac0d0f00 0x7f25ac1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b29e4640 1 -- 172.21.15.132:0/2251818656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25ac0d0f00 msgr2=0x7f25ac1535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b29e4640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25ac0d0f00 0x7f25ac1535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b29e4640 1 -- 172.21.15.132:0/2251818656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25ac0d19d0 msgr2=0x7f25ac15fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b29e4640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25ac0d19d0 0x7f25ac15fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b29e4640 1 -- 172.21.15.132:0/2251818656 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4009b30 con 0x7f25ac161790 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b19e2640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25ac0d19d0 0x7f25ac15fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.124+0000 7f25b21e3640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25ac0d0f00 0x7f25ac1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:43.130 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.125+0000 7f25b29e4640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac161790 0x7f25ac0cc4c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009f40 tx=0x7f25a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:43.131 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.125+0000 7f25a2ffd640 1 -- 172.21.15.132:0/2251818656 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4007e70 con 0x7f25ac161790 2024-03-16T17:47:43.131 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.125+0000 7f25a2ffd640 1 -- 172.21.15.132:0/2251818656 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4009510 con 0x7f25ac161790 2024-03-16T17:47:43.131 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.125+0000 7f25b4447640 1 -- 172.21.15.132:0/2251818656 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac160590 con 0x7f25ac161790 2024-03-16T17:47:43.131 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.125+0000 7f25a2ffd640 1 -- 172.21.15.132:0/2251818656 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a403e690 con 0x7f25ac161790 2024-03-16T17:47:43.131 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.125+0000 7f25b4447640 1 -- 172.21.15.132:0/2251818656 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ac160870 con 0x7f25ac161790 2024-03-16T17:47:43.131 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.126+0000 7f25b4447640 1 -- 172.21.15.132:0/2251818656 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ac068440 con 0x7f25ac161790 2024-03-16T17:47:43.132 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.126+0000 7f25a2ffd640 1 -- 172.21.15.132:0/2251818656 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f25a403e7f0 con 0x7f25ac161790 2024-03-16T17:47:43.132 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.126+0000 7f25a2ffd640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f259006b3b0 0x7f259006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.132 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.127+0000 7f25a2ffd640 1 -- 172.21.15.132:0/2251818656 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f25a40ac7b0 con 0x7f25ac161790 2024-03-16T17:47:43.132 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.127+0000 7f25b21e3640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f259006b3b0 0x7f259006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.132 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.127+0000 7f25b21e3640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f259006b3b0 0x7f259006d870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f25a8001680 tx=0x7f25a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:43.134 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.131+0000 7f25a2ffd640 1 -- 172.21.15.132:0/2251818656 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f25a4077880 con 0x7f25ac161790 2024-03-16T17:47:43.311 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.307+0000 7f25b4447640 1 -- 172.21.15.132:0/2251818656 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25ac154850 con 0x7f25ac161790 2024-03-16T17:47:43.311 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.308+0000 7f25a2ffd640 1 -- 172.21.15.132:0/2251818656 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12920 (secure 0 0 0) 0x7f25ac154850 con 0x7f25ac161790 2024-03-16T17:47:43.312 INFO:teuthology.misc.health.smithi132.stdout: 2024-03-16T17:47:43.312 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":16,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:40.069720+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:43.314 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 -- 172.21.15.132:0/2251818656 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f259006b3b0 msgr2=0x7f259006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.314 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f259006b3b0 0x7f259006d870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f25a8001680 tx=0x7f25a8009040 comp rx=0 tx=0).stop 2024-03-16T17:47:43.314 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 -- 172.21.15.132:0/2251818656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac161790 msgr2=0x7f25ac0cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.315 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac161790 0x7f25ac0cc4c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009f40 tx=0x7f25a4004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:43.315 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 -- 172.21.15.132:0/2251818656 shutdown_connections 2024-03-16T17:47:43.315 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f259006b3b0 0x7f259006d870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.315 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25ac161790 0x7f25ac0cc4c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.315 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25ac0d19d0 0x7f25ac15fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.315 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 --2- 172.21.15.132:0/2251818656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25ac0d0f00 0x7f25ac1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.315 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 -- 172.21.15.132:0/2251818656 >> 172.21.15.132:0/2251818656 conn(0x7f25ac09d0d0 msgr2=0x7f25ac0b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:43.315 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 -- 172.21.15.132:0/2251818656 shutdown_connections 2024-03-16T17:47:43.315 INFO:teuthology.misc.health.smithi132.stderr:2024-03-16T17:47:43.310+0000 7f25b4447640 1 -- 172.21.15.132:0/2251818656 wait complete. 2024-03-16T17:47:43.324 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-16T17:47:43.324 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-16T17:47:43.324 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-16T17:47:43.324 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-16T17:47:43.327 INFO:tasks.ceph.mds.a:Started 2024-03-16T17:47:43.327 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-16T17:47:43.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-16T17:47:43.329 INFO:tasks.ceph.mds.c:Started 2024-03-16T17:47:43.329 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-16T17:47:43.329 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-16T17:47:43.332 INFO:tasks.ceph.mds.b:Started 2024-03-16T17:47:43.332 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-16T17:47:43.332 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-16T17:47:43.334 INFO:tasks.ceph.mds.d:Started 2024-03-16T17:47:43.334 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-16T17:47:43.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:43.402 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2024-03-16T17:47:43.403 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2024-03-16T17:47:43.417 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-03-16T17:47:43.417 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-03-16T17:47:43.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.440+0000 7f5690678640 1 Processor -- start 2024-03-16T17:47:43.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.440+0000 7f5690678640 1 -- start start 2024-03-16T17:47:43.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f5690678640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5688161540 0x7f56880b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f5690678640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56880cf080 0x7f56880cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f5690678640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56880d0680 con 0x7f56880cfa70 2024-03-16T17:47:43.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f5690678640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56880b4f30 con 0x7f56880cf080 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f5690678640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56880d08d0 con 0x7f5688161540 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f568dc13640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56880cf080 0x7f56880cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f568dc13640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56880cf080 0x7f56880cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38148/0 (socket says 172.21.15.132:38148) 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f568dc13640 1 -- 172.21.15.132:0/1706556574 learned_addr learned my addr 172.21.15.132:0/1706556574 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f568e414640 1 --2- 172.21.15.132:0/1706556574 >> v2:172.21.15.194:3300/0 conn(0x7f5688161540 0x7f56880b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f568dc13640 1 -- 172.21.15.132:0/1706556574 >> v2:172.21.15.194:3300/0 conn(0x7f5688161540 msgr2=0x7f56880b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f568dc13640 1 --2- 172.21.15.132:0/1706556574 >> v2:172.21.15.194:3300/0 conn(0x7f5688161540 0x7f56880b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f568dc13640 1 -- 172.21.15.132:0/1706556574 >> v1:172.21.15.194:6789/0 conn(0x7f56880cfa70 legacy=0x7f5688161d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.441+0000 7f568dc13640 1 -- 172.21.15.132:0/1706556574 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880d0bb0 con 0x7f56880cf080 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.442+0000 7f568dc13640 1 --2- 172.21.15.132:0/1706556574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 0x7f56880cf530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f568809d850 tx=0x7f567802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfea26c98b92b57 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:43.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.442+0000 7f568d412640 1 -- 172.21.15.132:0/1706556574 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678030860 con 0x7f56880cf080 2024-03-16T17:47:43.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.446+0000 7f568d412640 1 -- 172.21.15.132:0/1706556574 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56780309c0 con 0x7f56880cf080 2024-03-16T17:47:43.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.446+0000 7f568d412640 1 -- 172.21.15.132:0/1706556574 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678030d50 con 0x7f56880cf080 2024-03-16T17:47:43.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.447+0000 7f5690678640 1 -- 172.21.15.132:0/1706556574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 msgr2=0x7f56880cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.447+0000 7f5690678640 1 --2- 172.21.15.132:0/1706556574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 0x7f56880cf530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f568809d850 tx=0x7f567802b9a0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.447+0000 7f5690678640 1 -- 172.21.15.132:0/1706556574 shutdown_connections 2024-03-16T17:47:43.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.447+0000 7f5690678640 1 --2- 172.21.15.132:0/1706556574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 0x7f56880cf530 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.447+0000 7f5690678640 1 --2- 172.21.15.132:0/1706556574 >> v2:172.21.15.194:3300/0 conn(0x7f5688161540 0x7f56880b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.447+0000 7f5690678640 1 -- 172.21.15.132:0/1706556574 >> 172.21.15.132:0/1706556574 conn(0x7f568809d120 msgr2=0x7f56880d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:43.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.447+0000 7f5690678640 1 -- 172.21.15.132:0/1706556574 shutdown_connections 2024-03-16T17:47:43.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.447+0000 7f5690678640 1 -- 172.21.15.132:0/1706556574 wait complete. 2024-03-16T17:47:43.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.448+0000 7f5690678640 1 Processor -- start 2024-03-16T17:47:43.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.448+0000 7f5690678640 1 -- start start 2024-03-16T17:47:43.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f5690678640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 0x7f56881506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f5690678640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56880cfa70 0x7f56880cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f5690678640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688161540 0x7f56880cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f5690678640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56880cddf0 con 0x7f56880cf080 2024-03-16T17:47:43.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f5690678640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56880b77b0 con 0x7f5688161540 2024-03-16T17:47:43.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f5690678640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5688150c10 con 0x7f56880cfa70 2024-03-16T17:47:43.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f568e414640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 0x7f56881506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f568e414640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 0x7f56881506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38152/0 (socket says 172.21.15.132:38152) 2024-03-16T17:47:43.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f568e414640 1 -- 172.21.15.132:0/875507891 learned_addr learned my addr 172.21.15.132:0/875507891 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f568ec15640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688161540 0x7f56880cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f568dc13640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56880cfa70 0x7f56880cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f568e414640 1 -- 172.21.15.132:0/875507891 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56880cfa70 msgr2=0x7f56880cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f568e414640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56880cfa70 0x7f56880cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f568e414640 1 -- 172.21.15.132:0/875507891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688161540 msgr2=0x7f56880cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f568e414640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688161540 0x7f56880cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.449+0000 7f568e414640 1 -- 172.21.15.132:0/875507891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780094d0 con 0x7f56880cf080 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.450+0000 7f568e414640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 0x7f56881506d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f568400e870 tx=0x7f568400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.450+0000 7f567effd640 1 -- 172.21.15.132:0/875507891 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56840094f0 con 0x7f56880cf080 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.450+0000 7f567effd640 1 -- 172.21.15.132:0/875507891 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568400c940 con 0x7f56880cf080 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.450+0000 7f5690678640 1 -- 172.21.15.132:0/875507891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56880cd550 con 0x7f56880cf080 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.450+0000 7f567effd640 1 -- 172.21.15.132:0/875507891 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400ccf0 con 0x7f56880cf080 2024-03-16T17:47:43.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.450+0000 7f5690678640 1 -- 172.21.15.132:0/875507891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56880cdb10 con 0x7f56880cf080 2024-03-16T17:47:43.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.451+0000 7f5690678640 1 -- 172.21.15.132:0/875507891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568804f2c0 con 0x7f56880cf080 2024-03-16T17:47:43.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.451+0000 7f567effd640 1 -- 172.21.15.132:0/875507891 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f5684013470 con 0x7f56880cf080 2024-03-16T17:47:43.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.451+0000 7f567effd640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f566c06b3b0 0x7f566c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.451+0000 7f567effd640 1 -- 172.21.15.132:0/875507891 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f56840898c0 con 0x7f56880cf080 2024-03-16T17:47:43.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.451+0000 7f568dc13640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f566c06b3b0 0x7f566c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.452+0000 7f568dc13640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f566c06b3b0 0x7f566c06d870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5678036000 tx=0x7f5678008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:43.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.456+0000 7f567effd640 1 -- 172.21.15.132:0/875507891 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5684054920 con 0x7f56880cf080 2024-03-16T17:47:43.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.627+0000 7f5690678640 1 -- 172.21.15.132:0/875507891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56880d1430 con 0x7f56880cf080 2024-03-16T17:47:43.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.627+0000 7f567effd640 1 -- 172.21.15.132:0/875507891 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12920 (secure 0 0 0) 0x7f5684057fe0 con 0x7f56880cf080 2024-03-16T17:47:43.631 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:43.631 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":16,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:40.069720+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 -- 172.21.15.132:0/875507891 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f566c06b3b0 msgr2=0x7f566c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f566c06b3b0 0x7f566c06d870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5678036000 tx=0x7f5678008030 comp rx=0 tx=0).stop 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 -- 172.21.15.132:0/875507891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 msgr2=0x7f56881506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 0x7f56881506d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f568400e870 tx=0x7f568400ed30 comp rx=0 tx=0).stop 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 -- 172.21.15.132:0/875507891 shutdown_connections 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f566c06b3b0 0x7f566c06d870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688161540 0x7f56880cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56880cfa70 0x7f56880cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 --2- 172.21.15.132:0/875507891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880cf080 0x7f56881506d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 -- 172.21.15.132:0/875507891 >> 172.21.15.132:0/875507891 conn(0x7f568809d120 msgr2=0x7f56880d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 -- 172.21.15.132:0/875507891 shutdown_connections 2024-03-16T17:47:43.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.630+0000 7f5690678640 1 -- 172.21.15.132:0/875507891 wait complete. 2024-03-16T17:47:43.644 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:47:43.644 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:47:43.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.744+0000 7f463ccc2640 1 Processor -- start 2024-03-16T17:47:43.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.744+0000 7f463ccc2640 1 -- start start 2024-03-16T17:47:43.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.744+0000 7f463ccc2640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f463806efa0 0x7f46380d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.744+0000 7f463ccc2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46380d07e0 con 0x7f46380d21e0 2024-03-16T17:47:43.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.744+0000 7f463ccc2640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46380d2610 con 0x7f4638161540 2024-03-16T17:47:43.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.744+0000 7f463ccc2640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46380d0a30 con 0x7f463806efa0 2024-03-16T17:47:43.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.745+0000 7f4636d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f46380d21e0 0x7f46380cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39876/0 (socket says 172.21.15.132:39876) 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.745+0000 7f4636d9d640 1 -- 172.21.15.132:0/898635230 learned_addr learned my addr 172.21.15.132:0/898635230 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.745+0000 7f462dd9b640 1 --2- 172.21.15.132:0/898635230 >> v2:172.21.15.194:3300/0 conn(0x7f463806efa0 0x7f46380d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.745+0000 7f4635d9b640 1 -- 172.21.15.132:0/898635230 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771643579 0 0) 0x7f46380d07e0 con 0x7f46380d21e0 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.745+0000 7f4635d9b640 1 -- 172.21.15.132:0/898635230 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4624003520 con 0x7f46380d21e0 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.745+0000 7f462dd9b640 1 -- 172.21.15.132:0/898635230 >> v1:172.21.15.194:6789/0 conn(0x7f4638161540 legacy=0x7f463806f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.745+0000 7f462dd9b640 1 -- 172.21.15.132:0/898635230 >> v1:172.21.15.132:6789/0 conn(0x7f46380d21e0 legacy=0x7f46380cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.745+0000 7f462dd9b640 1 -- 172.21.15.132:0/898635230 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380d0d10 con 0x7f463806efa0 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f462dd9b640 1 --2- 172.21.15.132:0/898635230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f463806efa0 0x7f46380d1ca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46200097a0 tx=0x7f462002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75e7aab421533537 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f4635d9b640 1 -- 172.21.15.132:0/898635230 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620030610 con 0x7f463806efa0 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f4635d9b640 1 -- 172.21.15.132:0/898635230 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4620030770 con 0x7f463806efa0 2024-03-16T17:47:43.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f4635d9b640 1 -- 172.21.15.132:0/898635230 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620030b00 con 0x7f463806efa0 2024-03-16T17:47:43.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f463ccc2640 1 -- 172.21.15.132:0/898635230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f463806efa0 msgr2=0x7f46380d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f463ccc2640 1 --2- 172.21.15.132:0/898635230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f463806efa0 0x7f46380d1ca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46200097a0 tx=0x7f462002b960 comp rx=0 tx=0).stop 2024-03-16T17:47:43.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f463ccc2640 1 -- 172.21.15.132:0/898635230 shutdown_connections 2024-03-16T17:47:43.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f463ccc2640 1 --2- 172.21.15.132:0/898635230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f463806efa0 0x7f46380d1ca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f463ccc2640 1 -- 172.21.15.132:0/898635230 >> 172.21.15.132:0/898635230 conn(0x7f463809aa70 msgr2=0x7f463809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:43.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f463ccc2640 1 -- 172.21.15.132:0/898635230 shutdown_connections 2024-03-16T17:47:43.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.746+0000 7f463ccc2640 1 -- 172.21.15.132:0/898635230 wait complete. 2024-03-16T17:47:43.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.748+0000 7f463ccc2640 1 Processor -- start 2024-03-16T17:47:43.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.748+0000 7f463ccc2640 1 -- start start 2024-03-16T17:47:43.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f463ccc2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f463806efa0 0x7f46381561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f463ccc2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46380d21e0 0x7f46380b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f463ccc2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4638161540 0x7f46380cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f463ccc2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380ca510 con 0x7f4638161540 2024-03-16T17:47:43.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f463ccc2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380c5890 con 0x7f46380d21e0 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f463ccc2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46380c5b70 con 0x7f463806efa0 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f4636d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4638161540 0x7f46380cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f4636d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4638161540 0x7f46380cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38160/0 (socket says 172.21.15.132:38160) 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f4636d9d640 1 -- 172.21.15.132:0/404369558 learned_addr learned my addr 172.21.15.132:0/404369558 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f462dd9b640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46380d21e0 0x7f46380b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f463659c640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f463806efa0 0x7f46381561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f4636d9d640 1 -- 172.21.15.132:0/404369558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f463806efa0 msgr2=0x7f46381561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f4636d9d640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f463806efa0 0x7f46381561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f4636d9d640 1 -- 172.21.15.132:0/404369558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46380d21e0 msgr2=0x7f46380b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f4636d9d640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46380d21e0 0x7f46380b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f4636d9d640 1 -- 172.21.15.132:0/404369558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620009400 con 0x7f4638161540 2024-03-16T17:47:43.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f4636d9d640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4638161540 0x7f46380cad20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f463000cb40 tx=0x7f463000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:43.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f462f7fe640 1 -- 172.21.15.132:0/404369558 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000aca0 con 0x7f4638161540 2024-03-16T17:47:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f462f7fe640 1 -- 172.21.15.132:0/404369558 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463000ae00 con 0x7f4638161540 2024-03-16T17:47:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f462f7fe640 1 -- 172.21.15.132:0/404369558 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630012620 con 0x7f4638161540 2024-03-16T17:47:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f463ccc2640 1 -- 172.21.15.132:0/404369558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46380c5e50 con 0x7f4638161540 2024-03-16T17:47:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.749+0000 7f463ccc2640 1 -- 172.21.15.132:0/404369558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4638156720 con 0x7f4638161540 2024-03-16T17:47:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.750+0000 7f463ccc2640 1 -- 172.21.15.132:0/404369558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46380c6370 con 0x7f4638161540 2024-03-16T17:47:43.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.751+0000 7f462f7fe640 1 -- 172.21.15.132:0/404369558 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4630007070 con 0x7f4638161540 2024-03-16T17:47:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.751+0000 7f462f7fe640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f461806b3b0 0x7f461806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.751+0000 7f463659c640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f461806b3b0 0x7f461806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.751+0000 7f462f7fe640 1 -- 172.21.15.132:0/404369558 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4630089840 con 0x7f4638161540 2024-03-16T17:47:43.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.752+0000 7f463659c640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f461806b3b0 0x7f461806d870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4638160860 tx=0x7f4628009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:43.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.756+0000 7f462f7fe640 1 -- 172.21.15.132:0/404369558 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f46380c6370 con 0x7f4638161540 2024-03-16T17:47:43.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.927+0000 7f463ccc2640 1 -- 172.21.15.132:0/404369558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46380c6370 con 0x7f4638161540 2024-03-16T17:47:43.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.927+0000 7f462f7fe640 1 -- 172.21.15.132:0/404369558 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46380c6370 con 0x7f4638161540 2024-03-16T17:47:43.931 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:47:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 -- 172.21.15.132:0/404369558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f461806b3b0 msgr2=0x7f461806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f461806b3b0 0x7f461806d870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4638160860 tx=0x7f4628009040 comp rx=0 tx=0).stop 2024-03-16T17:47:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 -- 172.21.15.132:0/404369558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4638161540 msgr2=0x7f46380cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4638161540 0x7f46380cad20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f463000cb40 tx=0x7f463000a060 comp rx=0 tx=0).stop 2024-03-16T17:47:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 -- 172.21.15.132:0/404369558 shutdown_connections 2024-03-16T17:47:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f461806b3b0 0x7f461806d870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4638161540 0x7f46380cad20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46380d21e0 0x7f46380b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 --2- 172.21.15.132:0/404369558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f463806efa0 0x7f46381561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 -- 172.21.15.132:0/404369558 >> 172.21.15.132:0/404369558 conn(0x7f463809aa70 msgr2=0x7f46380b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 -- 172.21.15.132:0/404369558 shutdown_connections 2024-03-16T17:47:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:43.929+0000 7f463ccc2640 1 -- 172.21.15.132:0/404369558 wait complete. 2024-03-16T17:47:43.944 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:47:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.041+0000 7f9c9c12c640 1 Processor -- start 2024-03-16T17:47:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.041+0000 7f9c9c12c640 1 -- start start 2024-03-16T17:47:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9c12c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9c9415e040 0x7f9c940b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9c12c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9406dad0 0x7f9c9406f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9c12c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9c9406fe20 0x7f9c940aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9c12c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c94070290 con 0x7f9c9406fe20 2024-03-16T17:47:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9c12c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9406d640 con 0x7f9c9415e040 2024-03-16T17:47:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9c12c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9406caa0 con 0x7f9c9406dad0 2024-03-16T17:47:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9a6c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9c9406fe20 0x7f9c940aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9a6c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9c9406fe20 0x7f9c940aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38162/0 (socket says 172.21.15.132:38162) 2024-03-16T17:47:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9a6c9640 1 -- 172.21.15.132:0/3976710442 learned_addr learned my addr 172.21.15.132:0/3976710442 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:44.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c996c7640 1 --2- 172.21.15.132:0/3976710442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9406dad0 0x7f9c9406f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:44.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c99ec8640 1 --2- 172.21.15.132:0/3976710442 >> v2:172.21.15.194:3300/0 conn(0x7f9c9415e040 0x7f9c940b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:44.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9a6c9640 1 -- 172.21.15.132:0/3976710442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9406dad0 msgr2=0x7f9c9406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:44.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9a6c9640 1 --2- 172.21.15.132:0/3976710442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9406dad0 0x7f9c9406f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9a6c9640 1 -- 172.21.15.132:0/3976710442 >> v2:172.21.15.194:3300/0 conn(0x7f9c9415e040 msgr2=0x7f9c940b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:44.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9a6c9640 1 --2- 172.21.15.132:0/3976710442 >> v2:172.21.15.194:3300/0 conn(0x7f9c9415e040 0x7f9c940b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.042+0000 7f9c9a6c9640 1 -- 172.21.15.132:0/3976710442 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9406cd10 con 0x7f9c9406fe20 2024-03-16T17:47:44.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.043+0000 7f9c9a6c9640 1 --2- 172.21.15.132:0/3976710442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9406fe20 0x7f9c940aeaf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c94072310 tx=0x7f9c8c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25efe750bab7b8fb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:44.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.043+0000 7f9c98ec6640 1 -- 172.21.15.132:0/3976710442 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c02ca70 con 0x7f9c9406fe20 2024-03-16T17:47:44.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.043+0000 7f9c98ec6640 1 -- 172.21.15.132:0/3976710442 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c02cbd0 con 0x7f9c9406fe20 2024-03-16T17:47:44.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.043+0000 7f9c98ec6640 1 -- 172.21.15.132:0/3976710442 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0343f0 con 0x7f9c9406fe20 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.043+0000 7f9c9c12c640 1 -- 172.21.15.132:0/3976710442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9406fe20 msgr2=0x7f9c940aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.043+0000 7f9c9c12c640 1 --2- 172.21.15.132:0/3976710442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9406fe20 0x7f9c940aeaf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c94072310 tx=0x7f9c8c02bed0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.044+0000 7f9c9c12c640 1 -- 172.21.15.132:0/3976710442 shutdown_connections 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.044+0000 7f9c9c12c640 1 --2- 172.21.15.132:0/3976710442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9406fe20 0x7f9c940aeaf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.044+0000 7f9c9c12c640 1 --2- 172.21.15.132:0/3976710442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9406dad0 0x7f9c9406f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.044+0000 7f9c9c12c640 1 --2- 172.21.15.132:0/3976710442 >> v2:172.21.15.194:3300/0 conn(0x7f9c9415e040 0x7f9c940b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.044+0000 7f9c9c12c640 1 -- 172.21.15.132:0/3976710442 >> 172.21.15.132:0/3976710442 conn(0x7f9c9409aa70 msgr2=0x7f9c9409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.044+0000 7f9c9c12c640 1 -- 172.21.15.132:0/3976710442 shutdown_connections 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.044+0000 7f9c9c12c640 1 -- 172.21.15.132:0/3976710442 wait complete. 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.045+0000 7f9c9c12c640 1 Processor -- start 2024-03-16T17:47:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.045+0000 7f9c9c12c640 1 -- start start 2024-03-16T17:47:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.045+0000 7f9c9c12c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9406dad0 0x7f9c94153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.045+0000 7f9c9c12c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9406fe20 0x7f9c941599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.045+0000 7f9c9c12c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9415e040 0x7f9c94159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.045+0000 7f9c9c12c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c941f3ac0 con 0x7f9c9415e040 2024-03-16T17:47:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.045+0000 7f9c9c12c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c941f3da0 con 0x7f9c9406fe20 2024-03-16T17:47:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.045+0000 7f9c9c12c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c941f4080 con 0x7f9c9406dad0 2024-03-16T17:47:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.045+0000 7f9c9a6c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9415e040 0x7f9c94159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c9a6c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9415e040 0x7f9c94159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38166/0 (socket says 172.21.15.132:38166) 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c9a6c9640 1 -- 172.21.15.132:0/531952689 learned_addr learned my addr 172.21.15.132:0/531952689 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c996c7640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9406fe20 0x7f9c941599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c9a6c9640 1 -- 172.21.15.132:0/531952689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9406dad0 msgr2=0x7f9c94153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c99ec8640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9406dad0 0x7f9c94153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c9a6c9640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9406dad0 0x7f9c94153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c9a6c9640 1 -- 172.21.15.132:0/531952689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9406fe20 msgr2=0x7f9c941599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c9a6c9640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9406fe20 0x7f9c941599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c9a6c9640 1 -- 172.21.15.132:0/531952689 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c009b30 con 0x7f9c9415e040 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c996c7640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9406fe20 0x7f9c941599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c9a6c9640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9415e040 0x7f9c94159f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c036040 tx=0x7f9c8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c8a7fc640 1 -- 172.21.15.132:0/531952689 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c009510 con 0x7f9c9415e040 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c8a7fc640 1 -- 172.21.15.132:0/531952689 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c03e450 con 0x7f9c9415e040 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c9c12c640 1 -- 172.21.15.132:0/531952689 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c941f4360 con 0x7f9c9415e040 2024-03-16T17:47:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c8a7fc640 1 -- 172.21.15.132:0/531952689 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c03e800 con 0x7f9c9415e040 2024-03-16T17:47:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.046+0000 7f9c9c12c640 1 -- 172.21.15.132:0/531952689 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c94153d70 con 0x7f9c9415e040 2024-03-16T17:47:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.047+0000 7f9c9c12c640 1 -- 172.21.15.132:0/531952689 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9404f2c0 con 0x7f9c9415e040 2024-03-16T17:47:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.047+0000 7f9c8a7fc640 1 -- 172.21.15.132:0/531952689 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f9c8c03e960 con 0x7f9c9415e040 2024-03-16T17:47:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.048+0000 7f9c8a7fc640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9c7806b3b0 0x7f9c7806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.048+0000 7f9c8a7fc640 1 -- 172.21.15.132:0/531952689 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c8c0ac530 con 0x7f9c9415e040 2024-03-16T17:47:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.048+0000 7f9c99ec8640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9c7806b3b0 0x7f9c7806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.048+0000 7f9c99ec8640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9c7806b3b0 0x7f9c7806d870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009970 tx=0x7f9c90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.052+0000 7f9c8a7fc640 1 -- 172.21.15.132:0/531952689 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9c8c077570 con 0x7f9c9415e040 2024-03-16T17:47:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.258+0000 7f9c9c12c640 1 -- 172.21.15.132:0/531952689 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c940b1aa0 con 0x7f9c9415e040 2024-03-16T17:47:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.259+0000 7f9c8a7fc640 1 -- 172.21.15.132:0/531952689 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f9c8c043540 con 0x7f9c9415e040 2024-03-16T17:47:44.262 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:44.263 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2008777747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2008777747},{"type":"v1","addr":"172.21.15.132:6835","nonce":2008777747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-16T17:47:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 2 2024-03-16T17:47:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.260+0000 7f9c9c12c640 1 -- 172.21.15.132:0/531952689 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9c7806b3b0 msgr2=0x7f9c7806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.260+0000 7f9c9c12c640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9c7806b3b0 0x7f9c7806d870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009970 tx=0x7f9c90008040 comp rx=0 tx=0).stop 2024-03-16T17:47:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.260+0000 7f9c9c12c640 1 -- 172.21.15.132:0/531952689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9415e040 msgr2=0x7f9c94159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.260+0000 7f9c9c12c640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9415e040 0x7f9c94159f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c036040 tx=0x7f9c8c004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.261+0000 7f9c9c12c640 1 -- 172.21.15.132:0/531952689 shutdown_connections 2024-03-16T17:47:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.261+0000 7f9c9c12c640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9c7806b3b0 0x7f9c7806d870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.261+0000 7f9c9c12c640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c9415e040 0x7f9c94159f10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.261+0000 7f9c9c12c640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9406fe20 0x7f9c941599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.261+0000 7f9c9c12c640 1 --2- 172.21.15.132:0/531952689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9406dad0 0x7f9c94153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.261+0000 7f9c9c12c640 1 -- 172.21.15.132:0/531952689 >> 172.21.15.132:0/531952689 conn(0x7f9c9409aa70 msgr2=0x7f9c94154170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.261+0000 7f9c9c12c640 1 -- 172.21.15.132:0/531952689 shutdown_connections 2024-03-16T17:47:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:44.261+0000 7f9c9c12c640 1 -- 172.21.15.132:0/531952689 wait complete. 2024-03-16T17:47:44.340 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:47:44.343 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:47:46.275 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:47:46.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.382+0000 7f3d48a81640 1 Processor -- start 2024-03-16T17:47:46.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.382+0000 7f3d48a81640 1 -- start start 2024-03-16T17:47:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d48a81640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3d4415bbc0 0x7f3d440cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d48a81640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d4406aee0 0x7f3d4406b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d48a81640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d440b48e0 con 0x7f3d440cdc60 2024-03-16T17:47:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d48a81640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d440b54d0 con 0x7f3d4406aee0 2024-03-16T17:47:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d48a81640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4406b890 con 0x7f3d4415bbc0 2024-03-16T17:47:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d42d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d4406aee0 0x7f3d4406b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d42d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d4406aee0 0x7f3d4406b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38172/0 (socket says 172.21.15.132:38172) 2024-03-16T17:47:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d42d9d640 1 -- 172.21.15.132:0/2292679092 learned_addr learned my addr 172.21.15.132:0/2292679092 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d4259c640 1 --2- 172.21.15.132:0/2292679092 >> v2:172.21.15.194:3300/0 conn(0x7f3d4415bbc0 0x7f3d440cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d42d9d640 1 -- 172.21.15.132:0/2292679092 >> v2:172.21.15.194:3300/0 conn(0x7f3d4415bbc0 msgr2=0x7f3d440cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d42d9d640 1 --2- 172.21.15.132:0/2292679092 >> v2:172.21.15.194:3300/0 conn(0x7f3d4415bbc0 0x7f3d440cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.383+0000 7f3d42d9d640 1 -- 172.21.15.132:0/2292679092 >> v1:172.21.15.194:6789/0 conn(0x7f3d440cdc60 legacy=0x7f3d440b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.384+0000 7f3d42d9d640 1 -- 172.21.15.132:0/2292679092 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440b4b30 con 0x7f3d4406aee0 2024-03-16T17:47:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.384+0000 7f3d42d9d640 1 --2- 172.21.15.132:0/2292679092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d4406aee0 0x7f3d4406b350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d4406cfd0 tx=0x7f3d3c02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e515bb4957223b38 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.384+0000 7f3d4159a640 1 -- 172.21.15.132:0/2292679092 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c02c960 con 0x7f3d4406aee0 2024-03-16T17:47:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.384+0000 7f3d4159a640 1 -- 172.21.15.132:0/2292679092 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c02cac0 con 0x7f3d4406aee0 2024-03-16T17:47:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.384+0000 7f3d4159a640 1 -- 172.21.15.132:0/2292679092 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c02ce50 con 0x7f3d4406aee0 2024-03-16T17:47:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.385+0000 7f3d48a81640 1 -- 172.21.15.132:0/2292679092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d4406aee0 msgr2=0x7f3d4406b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.385+0000 7f3d48a81640 1 --2- 172.21.15.132:0/2292679092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d4406aee0 0x7f3d4406b350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d4406cfd0 tx=0x7f3d3c02bdc0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.385+0000 7f3d48a81640 1 -- 172.21.15.132:0/2292679092 shutdown_connections 2024-03-16T17:47:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.385+0000 7f3d48a81640 1 --2- 172.21.15.132:0/2292679092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d4406aee0 0x7f3d4406b350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.385+0000 7f3d48a81640 1 --2- 172.21.15.132:0/2292679092 >> v2:172.21.15.194:3300/0 conn(0x7f3d4415bbc0 0x7f3d440cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.385+0000 7f3d48a81640 1 -- 172.21.15.132:0/2292679092 >> 172.21.15.132:0/2292679092 conn(0x7f3d4406bff0 msgr2=0x7f3d4406c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.385+0000 7f3d48a81640 1 -- 172.21.15.132:0/2292679092 shutdown_connections 2024-03-16T17:47:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.385+0000 7f3d48a81640 1 -- 172.21.15.132:0/2292679092 wait complete. 2024-03-16T17:47:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.386+0000 7f3d48a81640 1 Processor -- start 2024-03-16T17:47:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.386+0000 7f3d48a81640 1 -- start start 2024-03-16T17:47:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d48a81640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d4406aee0 0x7f3d4415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d48a81640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d440cdc60 0x7f3d4406f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d48a81640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4415bbc0 0x7f3d44154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d48a81640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d441fbb30 con 0x7f3d440cdc60 2024-03-16T17:47:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d48a81640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d441fbe10 con 0x7f3d4415bbc0 2024-03-16T17:47:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d48a81640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d441fc0f0 con 0x7f3d4406aee0 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d41d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d440cdc60 0x7f3d4406f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d41d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d440cdc60 0x7f3d4406f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38182/0 (socket says 172.21.15.132:38182) 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d41d9b640 1 -- 172.21.15.132:0/1575523420 learned_addr learned my addr 172.21.15.132:0/1575523420 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d42d9d640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4415bbc0 0x7f3d44154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d4259c640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d4406aee0 0x7f3d4415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d41d9b640 1 -- 172.21.15.132:0/1575523420 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d4406aee0 msgr2=0x7f3d4415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d41d9b640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d4406aee0 0x7f3d4415e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d41d9b640 1 -- 172.21.15.132:0/1575523420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4415bbc0 msgr2=0x7f3d44154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.387+0000 7f3d41d9b640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4415bbc0 0x7f3d44154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.388+0000 7f3d41d9b640 1 -- 172.21.15.132:0/1575523420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c009b30 con 0x7f3d440cdc60 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.388+0000 7f3d4259c640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d4406aee0 0x7f3d4415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.388+0000 7f3d41d9b640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d440cdc60 0x7f3d4406f3d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400c430 tx=0x7f3d3400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.388+0000 7f3d32ffd640 1 -- 172.21.15.132:0/1575523420 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34011790 con 0x7f3d440cdc60 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.388+0000 7f3d32ffd640 1 -- 172.21.15.132:0/1575523420 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d340118f0 con 0x7f3d440cdc60 2024-03-16T17:47:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.388+0000 7f3d48a81640 1 -- 172.21.15.132:0/1575523420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d441fc3d0 con 0x7f3d440cdc60 2024-03-16T17:47:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.388+0000 7f3d32ffd640 1 -- 172.21.15.132:0/1575523420 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34011ce0 con 0x7f3d440cdc60 2024-03-16T17:47:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.388+0000 7f3d48a81640 1 -- 172.21.15.132:0/1575523420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4415e760 con 0x7f3d440cdc60 2024-03-16T17:47:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.389+0000 7f3d48a81640 1 -- 172.21.15.132:0/1575523420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d44068450 con 0x7f3d440cdc60 2024-03-16T17:47:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.389+0000 7f3d32ffd640 1 -- 172.21.15.132:0/1575523420 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f3d3401c460 con 0x7f3d440cdc60 2024-03-16T17:47:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.390+0000 7f3d32ffd640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3d2406b3b0 0x7f3d2406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.390+0000 7f3d32ffd640 1 -- 172.21.15.132:0/1575523420 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3d34089710 con 0x7f3d440cdc60 2024-03-16T17:47:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.390+0000 7f3d4259c640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3d2406b3b0 0x7f3d2406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.390+0000 7f3d4259c640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3d2406b3b0 0x7f3d2406d870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d38006fd0 tx=0x7f3d38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:46.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.394+0000 7f3d32ffd640 1 -- 172.21.15.132:0/1575523420 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3d34054750 con 0x7f3d440cdc60 2024-03-16T17:47:46.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.601+0000 7f3d48a81640 1 -- 172.21.15.132:0/1575523420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d4404f2c0 con 0x7f3d440cdc60 2024-03-16T17:47:46.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.602+0000 7f3d32ffd640 1 -- 172.21.15.132:0/1575523420 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7f3d34057e10 con 0x7f3d440cdc60 2024-03-16T17:47:46.606 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:46.606 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/481194427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":481194427},{"type":"v1","addr":"172.21.15.194:6834","nonce":481194427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1590172463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1590172463},{"type":"v1","addr":"172.21.15.194:6835","nonce":1590172463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2008777747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2008777747},{"type":"v1","addr":"172.21.15.132:6835","nonce":2008777747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1367984600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1367984600},{"type":"v1","addr":"172.21.15.132:6837","nonce":1367984600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-16T17:47:46.606 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 3 2024-03-16T17:47:46.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 -- 172.21.15.132:0/1575523420 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3d2406b3b0 msgr2=0x7f3d2406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3d2406b3b0 0x7f3d2406d870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d38006fd0 tx=0x7f3d38008040 comp rx=0 tx=0).stop 2024-03-16T17:47:46.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 -- 172.21.15.132:0/1575523420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d440cdc60 msgr2=0x7f3d4406f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d440cdc60 0x7f3d4406f3d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400c430 tx=0x7f3d3400c8f0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 -- 172.21.15.132:0/1575523420 shutdown_connections 2024-03-16T17:47:46.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3d2406b3b0 0x7f3d2406d870 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d4415bbc0 0x7f3d44154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d440cdc60 0x7f3d4406f3d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 --2- 172.21.15.132:0/1575523420 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d4406aee0 0x7f3d4415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 -- 172.21.15.132:0/1575523420 >> 172.21.15.132:0/1575523420 conn(0x7f3d4406bff0 msgr2=0x7f3d440b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:46.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 -- 172.21.15.132:0/1575523420 shutdown_connections 2024-03-16T17:47:46.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.604+0000 7f3d48a81640 1 -- 172.21.15.132:0/1575523420 wait complete. 2024-03-16T17:47:46.618 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:46.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.715+0000 7fef5efac640 1 Processor -- start 2024-03-16T17:47:46.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.715+0000 7fef5efac640 1 -- start start 2024-03-16T17:47:46.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.716+0000 7fef5efac640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fef58161540 0x7fef580b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.716+0000 7fef5efac640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cf080 0x7fef580cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.716+0000 7fef5efac640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef580d0680 con 0x7fef580cfa40 2024-03-16T17:47:46.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.716+0000 7fef5efac640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef580b4f30 con 0x7fef58161540 2024-03-16T17:47:46.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.716+0000 7fef5efac640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580d08d0 con 0x7fef580cf080 2024-03-16T17:47:46.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.717+0000 7fef57fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cf080 0x7fef580cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.717+0000 7fef5cd48640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fef58161540 0x7fef580b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.717+0000 7fef57fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cf080 0x7fef580cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:53656/0 (socket says 172.21.15.132:53656) 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.717+0000 7fef57fff640 1 -- 172.21.15.132:0/943777663 learned_addr learned my addr 172.21.15.132:0/943777663 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.717+0000 7fef5cd48640 1 -- 172.21.15.132:0/943777663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cf080 msgr2=0x7fef580cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.717+0000 7fef5cd48640 1 --2- 172.21.15.132:0/943777663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cf080 0x7fef580cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.717+0000 7fef5cd48640 1 -- 172.21.15.132:0/943777663 >> v1:172.21.15.194:6789/0 conn(0x7fef580cfa40 legacy=0x7fef58161d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.717+0000 7fef5cd48640 1 -- 172.21.15.132:0/943777663 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580d0bb0 con 0x7fef58161540 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef5cd48640 1 --2- 172.21.15.132:0/943777663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef58161540 0x7fef580b3560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fef480097a0 tx=0x7fef4802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8602bf9224d6b38 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef577fe640 1 -- 172.21.15.132:0/943777663 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4802e070 con 0x7fef58161540 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef577fe640 1 -- 172.21.15.132:0/943777663 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef480315a0 con 0x7fef58161540 2024-03-16T17:47:46.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef577fe640 1 -- 172.21.15.132:0/943777663 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48031930 con 0x7fef58161540 2024-03-16T17:47:46.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef5efac640 1 -- 172.21.15.132:0/943777663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef58161540 msgr2=0x7fef580b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef5efac640 1 --2- 172.21.15.132:0/943777663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef58161540 0x7fef580b3560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fef480097a0 tx=0x7fef4802b840 comp rx=0 tx=0).stop 2024-03-16T17:47:46.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef5efac640 1 -- 172.21.15.132:0/943777663 shutdown_connections 2024-03-16T17:47:46.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef5efac640 1 --2- 172.21.15.132:0/943777663 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cf080 0x7fef580cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef5efac640 1 --2- 172.21.15.132:0/943777663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef58161540 0x7fef580b3560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef5efac640 1 -- 172.21.15.132:0/943777663 >> 172.21.15.132:0/943777663 conn(0x7fef5809d120 msgr2=0x7fef580d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:46.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef5efac640 1 -- 172.21.15.132:0/943777663 shutdown_connections 2024-03-16T17:47:46.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.718+0000 7fef5efac640 1 -- 172.21.15.132:0/943777663 wait complete. 2024-03-16T17:47:46.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.719+0000 7fef5efac640 1 Processor -- start 2024-03-16T17:47:46.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.719+0000 7fef5efac640 1 -- start start 2024-03-16T17:47:46.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.720+0000 7fef5efac640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef580cf080 0x7fef5815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.720+0000 7fef5efac640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cfa40 0x7fef581f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.720+0000 7fef5efac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef58161540 0x7fef581585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.720+0000 7fef5efac640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580cae80 con 0x7fef58161540 2024-03-16T17:47:46.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.720+0000 7fef5efac640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef581f78e0 con 0x7fef580cf080 2024-03-16T17:47:46.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.720+0000 7fef5efac640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef581f7b80 con 0x7fef580cfa40 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.720+0000 7fef5d549640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef58161540 0x7fef581585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.720+0000 7fef5d549640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef58161540 0x7fef581585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53368/0 (socket says 172.21.15.132:53368) 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.720+0000 7fef5d549640 1 -- 172.21.15.132:0/3499759595 learned_addr learned my addr 172.21.15.132:0/3499759595 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef5cd48640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef580cf080 0x7fef5815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef57fff640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cfa40 0x7fef581f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef5d549640 1 -- 172.21.15.132:0/3499759595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cfa40 msgr2=0x7fef581f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef5d549640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cfa40 0x7fef581f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef5d549640 1 -- 172.21.15.132:0/3499759595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef580cf080 msgr2=0x7fef5815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef5d549640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef580cf080 0x7fef5815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef5d549640 1 -- 172.21.15.132:0/3499759595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009400 con 0x7fef58161540 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef5d549640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef58161540 0x7fef581585b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fef5000c6b0 tx=0x7fef5000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef557fa640 1 -- 172.21.15.132:0/3499759595 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50003b70 con 0x7fef58161540 2024-03-16T17:47:46.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef557fa640 1 -- 172.21.15.132:0/3499759595 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef50003cf0 con 0x7fef58161540 2024-03-16T17:47:46.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef557fa640 1 -- 172.21.15.132:0/3499759595 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50003ea0 con 0x7fef58161540 2024-03-16T17:47:46.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef5efac640 1 -- 172.21.15.132:0/3499759595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef581f7e60 con 0x7fef58161540 2024-03-16T17:47:46.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.721+0000 7fef5efac640 1 -- 172.21.15.132:0/3499759595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef580cb120 con 0x7fef58161540 2024-03-16T17:47:46.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.722+0000 7fef5efac640 1 -- 172.21.15.132:0/3499759595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef580b2a30 con 0x7fef58161540 2024-03-16T17:47:46.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.723+0000 7fef557fa640 1 -- 172.21.15.132:0/3499759595 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fef50005310 con 0x7fef58161540 2024-03-16T17:47:46.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.723+0000 7fef557fa640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fef4406b3b0 0x7fef4406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:46.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.723+0000 7fef557fa640 1 -- 172.21.15.132:0/3499759595 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fef50089580 con 0x7fef58161540 2024-03-16T17:47:46.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.723+0000 7fef5cd48640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fef4406b3b0 0x7fef4406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:46.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.723+0000 7fef5cd48640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fef4406b3b0 0x7fef4406d870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef48036000 tx=0x7fef4803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:46.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.727+0000 7fef557fa640 1 -- 172.21.15.132:0/3499759595 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fef50054560 con 0x7fef58161540 2024-03-16T17:47:46.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.899+0000 7fef5efac640 1 -- 172.21.15.132:0/3499759595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef5804f2c0 con 0x7fef58161540 2024-03-16T17:47:46.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.900+0000 7fef557fa640 1 -- 172.21.15.132:0/3499759595 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12920 (secure 0 0 0) 0x7fef50057c20 con 0x7fef58161540 2024-03-16T17:47:46.904 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:46.904 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":16,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:40.069720+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 -- 172.21.15.132:0/3499759595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fef4406b3b0 msgr2=0x7fef4406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fef4406b3b0 0x7fef4406d870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef48036000 tx=0x7fef4803d040 comp rx=0 tx=0).stop 2024-03-16T17:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 -- 172.21.15.132:0/3499759595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef58161540 msgr2=0x7fef581585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef58161540 0x7fef581585b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fef5000c6b0 tx=0x7fef5000cb70 comp rx=0 tx=0).stop 2024-03-16T17:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 -- 172.21.15.132:0/3499759595 shutdown_connections 2024-03-16T17:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fef4406b3b0 0x7fef4406d870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fef58161540 0x7fef581585b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef580cfa40 0x7fef581f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 --2- 172.21.15.132:0/3499759595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef580cf080 0x7fef5815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 -- 172.21.15.132:0/3499759595 >> 172.21.15.132:0/3499759595 conn(0x7fef5809d120 msgr2=0x7fef5806c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 -- 172.21.15.132:0/3499759595 shutdown_connections 2024-03-16T17:47:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:46.902+0000 7fef5efac640 1 -- 172.21.15.132:0/3499759595 wait complete. 2024-03-16T17:47:46.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:47:46.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:47:47.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.015+0000 7f4c2ccce640 1 Processor -- start 2024-03-16T17:47:47.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.015+0000 7f4c2ccce640 1 -- start start 2024-03-16T17:47:47.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c2ccce640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c2813ef90 0x7f4c281421e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c2ccce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c280727f0 0x7f4c2815fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c2ccce640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4c28072c50 0x7f4c28160000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c2ccce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2806d080 con 0x7f4c280727f0 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c2ccce640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2813f370 con 0x7f4c28072c50 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c2ccce640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28070c40 con 0x7f4c2813ef90 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c1ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c280727f0 0x7f4c2815fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c1ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c280727f0 0x7f4c2815fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53378/0 (socket says 172.21.15.132:53378) 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c1ffff640 1 -- 172.21.15.132:0/3920596923 learned_addr learned my addr 172.21.15.132:0/3920596923 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c26d9d640 1 --2- 172.21.15.132:0/3920596923 >> v2:172.21.15.194:3300/0 conn(0x7f4c28072c50 0x7f4c28160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c2659c640 1 --2- 172.21.15.132:0/3920596923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c2813ef90 0x7f4c281421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c1ffff640 1 -- 172.21.15.132:0/3920596923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c2813ef90 msgr2=0x7f4c281421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c1ffff640 1 --2- 172.21.15.132:0/3920596923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c2813ef90 0x7f4c281421e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c1ffff640 1 -- 172.21.15.132:0/3920596923 >> v2:172.21.15.194:3300/0 conn(0x7f4c28072c50 msgr2=0x7f4c28160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:47.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c1ffff640 1 --2- 172.21.15.132:0/3920596923 >> v2:172.21.15.194:3300/0 conn(0x7f4c28072c50 0x7f4c28160000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c1ffff640 1 -- 172.21.15.132:0/3920596923 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c28070f20 con 0x7f4c280727f0 2024-03-16T17:47:47.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.016+0000 7f4c26d9d640 1 --2- 172.21.15.132:0/3920596923 >> v2:172.21.15.194:3300/0 conn(0x7f4c28072c50 0x7f4c28160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:47.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.017+0000 7f4c1ffff640 1 --2- 172.21.15.132:0/3920596923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c280727f0 0x7f4c2815fac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c2806bf70 tx=0x7f4c1002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec5660ec84c91ec server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:47.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.017+0000 7f4c25d9b640 1 -- 172.21.15.132:0/3920596923 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100317e0 con 0x7f4c280727f0 2024-03-16T17:47:47.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.017+0000 7f4c25d9b640 1 -- 172.21.15.132:0/3920596923 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c10031940 con 0x7f4c280727f0 2024-03-16T17:47:47.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.017+0000 7f4c25d9b640 1 -- 172.21.15.132:0/3920596923 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10031cd0 con 0x7f4c280727f0 2024-03-16T17:47:47.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.018+0000 7f4c2ccce640 1 -- 172.21.15.132:0/3920596923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c280727f0 msgr2=0x7f4c2815fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.018+0000 7f4c2ccce640 1 --2- 172.21.15.132:0/3920596923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c280727f0 0x7f4c2815fac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c2806bf70 tx=0x7f4c1002b880 comp rx=0 tx=0).stop 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.018+0000 7f4c2ccce640 1 -- 172.21.15.132:0/3920596923 shutdown_connections 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.018+0000 7f4c2ccce640 1 --2- 172.21.15.132:0/3920596923 >> v2:172.21.15.194:3300/0 conn(0x7f4c28072c50 0x7f4c28160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.018+0000 7f4c2ccce640 1 --2- 172.21.15.132:0/3920596923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c280727f0 0x7f4c2815fac0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.018+0000 7f4c2ccce640 1 --2- 172.21.15.132:0/3920596923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c2813ef90 0x7f4c281421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.018+0000 7f4c2ccce640 1 -- 172.21.15.132:0/3920596923 >> 172.21.15.132:0/3920596923 conn(0x7f4c2806aee0 msgr2=0x7f4c2806b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.018+0000 7f4c2ccce640 1 -- 172.21.15.132:0/3920596923 shutdown_connections 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.018+0000 7f4c2ccce640 1 -- 172.21.15.132:0/3920596923 wait complete. 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.019+0000 7f4c2ccce640 1 Processor -- start 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.019+0000 7f4c2ccce640 1 -- start start 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c2ccce640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c280727f0 0x7f4c281ef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c2ccce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c28072c50 0x7f4c281f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c2ccce640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2813ef90 0x7f4c28144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c2ccce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c281445c0 con 0x7f4c28072c50 2024-03-16T17:47:47.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c2ccce640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c281ef710 con 0x7f4c2813ef90 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c2ccce640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c281f5b80 con 0x7f4c280727f0 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c28072c50 0x7f4c281f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c28072c50 0x7f4c281f5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53380/0 (socket says 172.21.15.132:53380) 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1ffff640 1 -- 172.21.15.132:0/4007614764 learned_addr learned my addr 172.21.15.132:0/4007614764 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c2659c640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c280727f0 0x7f4c281ef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c26d9d640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2813ef90 0x7f4c28144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1ffff640 1 -- 172.21.15.132:0/4007614764 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c280727f0 msgr2=0x7f4c281ef1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1ffff640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c280727f0 0x7f4c281ef1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1ffff640 1 -- 172.21.15.132:0/4007614764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2813ef90 msgr2=0x7f4c28144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1ffff640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2813ef90 0x7f4c28144a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1ffff640 1 -- 172.21.15.132:0/4007614764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100094d0 con 0x7f4c28072c50 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1ffff640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c28072c50 0x7f4c281f5350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c10000c00 tx=0x7f4c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1effd640 1 -- 172.21.15.132:0/4007614764 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10032880 con 0x7f4c28072c50 2024-03-16T17:47:47.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.020+0000 7f4c1effd640 1 -- 172.21.15.132:0/4007614764 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c100329e0 con 0x7f4c28072c50 2024-03-16T17:47:47.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.021+0000 7f4c2ccce640 1 -- 172.21.15.132:0/4007614764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c281f5e60 con 0x7f4c28072c50 2024-03-16T17:47:47.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.021+0000 7f4c1effd640 1 -- 172.21.15.132:0/4007614764 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10032d90 con 0x7f4c28072c50 2024-03-16T17:47:47.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.021+0000 7f4c2ccce640 1 -- 172.21.15.132:0/4007614764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c28144250 con 0x7f4c28072c50 2024-03-16T17:47:47.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.022+0000 7f4c2ccce640 1 -- 172.21.15.132:0/4007614764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2806bd50 con 0x7f4c28072c50 2024-03-16T17:47:47.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.022+0000 7f4c1effd640 1 -- 172.21.15.132:0/4007614764 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4c100453f0 con 0x7f4c28072c50 2024-03-16T17:47:47.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.022+0000 7f4c1effd640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c0806b3b0 0x7f4c0806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.022+0000 7f4c1effd640 1 -- 172.21.15.132:0/4007614764 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4c100aba70 con 0x7f4c28072c50 2024-03-16T17:47:47.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.022+0000 7f4c2659c640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c0806b3b0 0x7f4c0806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.023+0000 7f4c2659c640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c0806b3b0 0x7f4c0806d870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c180079a0 tx=0x7f4c18008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:47.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.027+0000 7f4c1effd640 1 -- 172.21.15.132:0/4007614764 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4c10076b70 con 0x7f4c28072c50 2024-03-16T17:47:47.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.198+0000 7f4c2ccce640 1 -- 172.21.15.132:0/4007614764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c280735f0 con 0x7f4c28072c50 2024-03-16T17:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.198+0000 7f4c1effd640 1 -- 172.21.15.132:0/4007614764 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c1007a230 con 0x7f4c28072c50 2024-03-16T17:47:47.202 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:47:47.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 -- 172.21.15.132:0/4007614764 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c0806b3b0 msgr2=0x7f4c0806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c0806b3b0 0x7f4c0806d870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c180079a0 tx=0x7f4c18008040 comp rx=0 tx=0).stop 2024-03-16T17:47:47.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 -- 172.21.15.132:0/4007614764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c28072c50 msgr2=0x7f4c281f5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c28072c50 0x7f4c281f5350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c10000c00 tx=0x7f4c100046c0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 -- 172.21.15.132:0/4007614764 shutdown_connections 2024-03-16T17:47:47.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c0806b3b0 0x7f4c0806d870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2813ef90 0x7f4c28144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c28072c50 0x7f4c281f5350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 --2- 172.21.15.132:0/4007614764 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c280727f0 0x7f4c281ef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 -- 172.21.15.132:0/4007614764 >> 172.21.15.132:0/4007614764 conn(0x7f4c2806aee0 msgr2=0x7f4c2815e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:47.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 -- 172.21.15.132:0/4007614764 shutdown_connections 2024-03-16T17:47:47.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.200+0000 7f4c2ccce640 1 -- 172.21.15.132:0/4007614764 wait complete. 2024-03-16T17:47:47.215 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T17:47:47.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.312+0000 7fc41deae640 1 Processor -- start 2024-03-16T17:47:47.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.312+0000 7fc41deae640 1 -- start start 2024-03-16T17:47:47.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc41deae640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 0x7fc41815c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc41deae640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc4181566f0 0x7fc418070690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc41deae640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc418070bd0 con 0x7fc41806eda0 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc41deae640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41806f5f0 con 0x7fc4181566f0 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc41deae640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41806f8d0 con 0x7fc418156310 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc4177fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 0x7fc41815c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc416ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc4181566f0 0x7fc418070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc417fff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc41806eda0 0x7fc4180b57b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46688/0 (socket says 172.21.15.132:46688) 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc4177fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 0x7fc41815c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:53684/0 (socket says 172.21.15.132:53684) 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc416ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc4181566f0 0x7fc418070690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47256/0 (socket says 172.21.15.132:47256) 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.313+0000 7fc417fff640 1 -- 172.21.15.132:0/2508857161 learned_addr learned my addr 172.21.15.132:0/2508857161 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.314+0000 7fc416ffd640 1 -- 172.21.15.132:0/2508857161 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 msgr2=0x7fc41815c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.314+0000 7fc416ffd640 1 --2- 172.21.15.132:0/2508857161 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 0x7fc41815c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.314+0000 7fc416ffd640 1 -- 172.21.15.132:0/2508857161 >> v1:172.21.15.194:6789/0 conn(0x7fc41806eda0 legacy=0x7fc4180b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.314+0000 7fc416ffd640 1 -- 172.21.15.132:0/2508857161 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41806fbb0 con 0x7fc4181566f0 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.314+0000 7fc416ffd640 1 --2- 172.21.15.132:0/2508857161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4181566f0 0x7fc418070690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0097a0 tx=0x7fc40c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=522902e63c582501 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc4167fc640 1 -- 172.21.15.132:0/2508857161 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c031830 con 0x7fc4181566f0 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc4167fc640 1 -- 172.21.15.132:0/2508857161 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c031990 con 0x7fc4181566f0 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc4167fc640 1 -- 172.21.15.132:0/2508857161 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c031d20 con 0x7fc4181566f0 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc41deae640 1 -- 172.21.15.132:0/2508857161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4181566f0 msgr2=0x7fc418070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc41deae640 1 --2- 172.21.15.132:0/2508857161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4181566f0 0x7fc418070690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0097a0 tx=0x7fc40c02b8d0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc41deae640 1 -- 172.21.15.132:0/2508857161 shutdown_connections 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc41deae640 1 --2- 172.21.15.132:0/2508857161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4181566f0 0x7fc418070690 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc41deae640 1 --2- 172.21.15.132:0/2508857161 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 0x7fc41815c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc41deae640 1 -- 172.21.15.132:0/2508857161 >> 172.21.15.132:0/2508857161 conn(0x7fc41809aa70 msgr2=0x7fc41809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc41deae640 1 -- 172.21.15.132:0/2508857161 shutdown_connections 2024-03-16T17:47:47.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.315+0000 7fc41deae640 1 -- 172.21.15.132:0/2508857161 wait complete. 2024-03-16T17:47:47.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.316+0000 7fc41deae640 1 Processor -- start 2024-03-16T17:47:47.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.316+0000 7fc41deae640 1 -- start start 2024-03-16T17:47:47.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc41deae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc41806eda0 0x7fc41806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc41deae640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 0x7fc418147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc41deae640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4181566f0 0x7fc41806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc41deae640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180cfdb0 con 0x7fc41806eda0 2024-03-16T17:47:47.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc41deae640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41806c8e0 con 0x7fc4181566f0 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc41deae640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180cfad0 con 0x7fc418156310 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc4177fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc41806eda0 0x7fc41806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc4177fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc41806eda0 0x7fc41806c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53388/0 (socket says 172.21.15.132:53388) 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc4177fe640 1 -- 172.21.15.132:0/931747580 learned_addr learned my addr 172.21.15.132:0/931747580 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc416ffd640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 0x7fc418147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc417fff640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4181566f0 0x7fc41806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc4177fe640 1 -- 172.21.15.132:0/931747580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 msgr2=0x7fc418147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc4177fe640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 0x7fc418147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc4177fe640 1 -- 172.21.15.132:0/931747580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4181566f0 msgr2=0x7fc41806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc4177fe640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4181566f0 0x7fc41806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc4177fe640 1 -- 172.21.15.132:0/931747580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c009400 con 0x7fc41806eda0 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.317+0000 7fc417fff640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4181566f0 0x7fc41806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.318+0000 7fc4177fe640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc41806eda0 0x7fc41806c3a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc40800e9b0 tx=0x7fc40800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.318+0000 7fc3fffff640 1 -- 172.21.15.132:0/931747580 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408009670 con 0x7fc41806eda0 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.318+0000 7fc3fffff640 1 -- 172.21.15.132:0/931747580 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40800c9a0 con 0x7fc41806eda0 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.318+0000 7fc41deae640 1 -- 172.21.15.132:0/931747580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41806ccb0 con 0x7fc41806eda0 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.318+0000 7fc3fffff640 1 -- 172.21.15.132:0/931747580 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800cd50 con 0x7fc41806eda0 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.318+0000 7fc41deae640 1 -- 172.21.15.132:0/931747580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41806d270 con 0x7fc41806eda0 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.319+0000 7fc41deae640 1 -- 172.21.15.132:0/931747580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41806cb10 con 0x7fc41806eda0 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.319+0000 7fc3fffff640 1 -- 172.21.15.132:0/931747580 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fc408013470 con 0x7fc41806eda0 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.320+0000 7fc3fffff640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40406b3b0 0x7fc40406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.320+0000 7fc3fffff640 1 -- 172.21.15.132:0/931747580 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc408089a00 con 0x7fc41806eda0 2024-03-16T17:47:47.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.320+0000 7fc416ffd640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40406b3b0 0x7fc40406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.320+0000 7fc416ffd640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40406b3b0 0x7fc40406d870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc40c036000 tx=0x7fc40c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:47.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.324+0000 7fc3fffff640 1 -- 172.21.15.132:0/931747580 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc41806cb10 con 0x7fc41806eda0 2024-03-16T17:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.499+0000 7fc41deae640 1 -- 172.21.15.132:0/931747580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc41806cb10 con 0x7fc41806eda0 2024-03-16T17:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.499+0000 7fc3fffff640 1 -- 172.21.15.132:0/931747580 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc41806cb10 con 0x7fc41806eda0 2024-03-16T17:47:47.503 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:47.503 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2024-03-16T17:47:47.503 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:47:47.503 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2024-03-16T17:47:47.503 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2024-03-16T17:47:47.503 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:47:47.504 INFO:teuthology.orchestra.run.smithi132.stdout:] 2024-03-16T17:47:47.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 -- 172.21.15.132:0/931747580 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40406b3b0 msgr2=0x7fc40406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40406b3b0 0x7fc40406d870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc40c036000 tx=0x7fc40c03c040 comp rx=0 tx=0).stop 2024-03-16T17:47:47.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 -- 172.21.15.132:0/931747580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc41806eda0 msgr2=0x7fc41806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc41806eda0 0x7fc41806c3a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc40800e9b0 tx=0x7fc40800ee70 comp rx=0 tx=0).stop 2024-03-16T17:47:47.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 -- 172.21.15.132:0/931747580 shutdown_connections 2024-03-16T17:47:47.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40406b3b0 0x7fc40406d870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4181566f0 0x7fc41806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc418156310 0x7fc418147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 --2- 172.21.15.132:0/931747580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc41806eda0 0x7fc41806c3a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 -- 172.21.15.132:0/931747580 >> 172.21.15.132:0/931747580 conn(0x7fc41809aa70 msgr2=0x7fc4180b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:47.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 -- 172.21.15.132:0/931747580 shutdown_connections 2024-03-16T17:47:47.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.501+0000 7fc41deae640 1 -- 172.21.15.132:0/931747580 wait complete. 2024-03-16T17:47:47.515 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T17:47:47.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T17:47:47.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.615+0000 7f1ccc084640 1 Processor -- start 2024-03-16T17:47:47.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.616+0000 7f1ccc084640 1 -- start start 2024-03-16T17:47:47.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.616+0000 7f1ccc084640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4143b10 0x7f1cc406f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.616+0000 7f1ccc084640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1cc40b4fa0 0x7f1cc415b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.616+0000 7f1ccc084640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc4143ef0 con 0x7f1cc4144120 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.616+0000 7f1ccc084640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc415e770 con 0x7f1cc40b4fa0 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.616+0000 7f1ccc084640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc415ea50 con 0x7f1cc4143b10 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.616+0000 7f1cc961f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1cc4144120 0x7f1cc40b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49778/0 (socket says 172.21.15.132:49778) 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.616+0000 7f1cc961f640 1 -- 172.21.15.132:0/3891610040 learned_addr learned my addr 172.21.15.132:0/3891610040 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.617+0000 7f1cc9e20640 1 --2- 172.21.15.132:0/3891610040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4143b10 0x7f1cc406f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.617+0000 7f1cca621640 1 --2- 172.21.15.132:0/3891610040 >> v2:172.21.15.194:3300/0 conn(0x7f1cc40b4fa0 0x7f1cc415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.617+0000 7f1cc8e1e640 1 -- 172.21.15.132:0/3891610040 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090417403 0 0) 0x7f1cc4143ef0 con 0x7f1cc4144120 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.617+0000 7f1cc8e1e640 1 -- 172.21.15.132:0/3891610040 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb0003520 con 0x7f1cc4144120 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.617+0000 7f1cc9e20640 1 -- 172.21.15.132:0/3891610040 >> v2:172.21.15.194:3300/0 conn(0x7f1cc40b4fa0 msgr2=0x7f1cc415b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.617+0000 7f1cc8e1e640 1 -- 172.21.15.132:0/3891610040 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 25420662 0 0) 0x7f1cb0003520 con 0x7f1cc4144120 2024-03-16T17:47:47.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.617+0000 7f1cc9e20640 1 --2- 172.21.15.132:0/3891610040 >> v2:172.21.15.194:3300/0 conn(0x7f1cc40b4fa0 0x7f1cc415b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.617+0000 7f1cc9e20640 1 -- 172.21.15.132:0/3891610040 >> v1:172.21.15.132:6789/0 conn(0x7f1cc4144120 legacy=0x7f1cc40b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.617+0000 7f1cc9e20640 1 -- 172.21.15.132:0/3891610040 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc415ed30 con 0x7f1cc4143b10 2024-03-16T17:47:47.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.617+0000 7f1cca621640 1 --2- 172.21.15.132:0/3891610040 >> v2:172.21.15.194:3300/0 conn(0x7f1cc40b4fa0 0x7f1cc415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.618+0000 7f1cc9e20640 1 --2- 172.21.15.132:0/3891610040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4143b10 0x7f1cc406f290 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00097a0 tx=0x7f1cc002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71fd33758487bdb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.618+0000 7f1cc8e1e640 1 -- 172.21.15.132:0/3891610040 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4001670 con 0x7f1cc4143b10 2024-03-16T17:47:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.618+0000 7f1cc8e1e640 1 -- 172.21.15.132:0/3891610040 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc002e050 con 0x7f1cc4143b10 2024-03-16T17:47:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.618+0000 7f1cc8e1e640 1 -- 172.21.15.132:0/3891610040 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc0030710 con 0x7f1cc4143b10 2024-03-16T17:47:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.618+0000 7f1ccc084640 1 -- 172.21.15.132:0/3891610040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4143b10 msgr2=0x7f1cc406f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.618+0000 7f1ccc084640 1 --2- 172.21.15.132:0/3891610040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4143b10 0x7f1cc406f290 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1cc00097a0 tx=0x7f1cc002b790 comp rx=0 tx=0).stop 2024-03-16T17:47:47.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.618+0000 7f1ccc084640 1 -- 172.21.15.132:0/3891610040 shutdown_connections 2024-03-16T17:47:47.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.618+0000 7f1ccc084640 1 --2- 172.21.15.132:0/3891610040 >> v2:172.21.15.194:3300/0 conn(0x7f1cc40b4fa0 0x7f1cc415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.618+0000 7f1ccc084640 1 --2- 172.21.15.132:0/3891610040 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4143b10 0x7f1cc406f290 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.618+0000 7f1ccc084640 1 -- 172.21.15.132:0/3891610040 >> 172.21.15.132:0/3891610040 conn(0x7f1cc406bff0 msgr2=0x7f1cc406c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:47.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.619+0000 7f1ccc084640 1 -- 172.21.15.132:0/3891610040 shutdown_connections 2024-03-16T17:47:47.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.619+0000 7f1ccc084640 1 -- 172.21.15.132:0/3891610040 wait complete. 2024-03-16T17:47:47.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1ccc084640 1 Processor -- start 2024-03-16T17:47:47.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1ccc084640 1 -- start start 2024-03-16T17:47:47.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1ccc084640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc40b4fa0 0x7f1cc4151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1ccc084640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cc4143b10 0x7f1cc413ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1ccc084640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4144120 0x7f1cc40d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1ccc084640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40d0d00 con 0x7f1cc4143b10 2024-03-16T17:47:47.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1ccc084640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc413b450 con 0x7f1cc40b4fa0 2024-03-16T17:47:47.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1ccc084640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc413b730 con 0x7f1cc4144120 2024-03-16T17:47:47.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1cc961f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cc4143b10 0x7f1cc413ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1cc961f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cc4143b10 0x7f1cc413ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53404/0 (socket says 172.21.15.132:53404) 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.620+0000 7f1cc961f640 1 -- 172.21.15.132:0/90067595 learned_addr learned my addr 172.21.15.132:0/90067595 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cc9e20640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc40b4fa0 0x7f1cc4151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cca621640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4144120 0x7f1cc40d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cc961f640 1 -- 172.21.15.132:0/90067595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4144120 msgr2=0x7f1cc40d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cc961f640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4144120 0x7f1cc40d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cc961f640 1 -- 172.21.15.132:0/90067595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc40b4fa0 msgr2=0x7f1cc4151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cc961f640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc40b4fa0 0x7f1cc4151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cc961f640 1 -- 172.21.15.132:0/90067595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc009a70 con 0x7f1cc4143b10 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cc961f640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cc4143b10 0x7f1cc413ad90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400c750 tx=0x7f1cb400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cba7fc640 1 -- 172.21.15.132:0/90067595 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4005ad0 con 0x7f1cc4143b10 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cba7fc640 1 -- 172.21.15.132:0/90067595 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb4005c30 con 0x7f1cc4143b10 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1ccc084640 1 -- 172.21.15.132:0/90067595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc0009400 con 0x7f1cc4143b10 2024-03-16T17:47:47.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1cba7fc640 1 -- 172.21.15.132:0/90067595 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4007070 con 0x7f1cc4143b10 2024-03-16T17:47:47.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.621+0000 7f1ccc084640 1 -- 172.21.15.132:0/90067595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc413bcf0 con 0x7f1cc4143b10 2024-03-16T17:47:47.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.622+0000 7f1ccc084640 1 -- 172.21.15.132:0/90067595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc40734e0 con 0x7f1cc4143b10 2024-03-16T17:47:47.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.622+0000 7f1cba7fc640 1 -- 172.21.15.132:0/90067595 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f1cb40071d0 con 0x7f1cc4143b10 2024-03-16T17:47:47.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.623+0000 7f1cba7fc640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f1ca806b3b0 0x7f1ca806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:47.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.623+0000 7f1cc9e20640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f1ca806b3b0 0x7f1ca806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:47.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.623+0000 7f1cba7fc640 1 -- 172.21.15.132:0/90067595 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1cb40895e0 con 0x7f1cc4143b10 2024-03-16T17:47:47.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.623+0000 7f1cc9e20640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f1ca806b3b0 0x7f1ca806d870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0034000 tx=0x7f1cc002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:47.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.627+0000 7f1cba7fc640 1 -- 172.21.15.132:0/90067595 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1cb4054510 con 0x7f1cc4143b10 2024-03-16T17:47:47.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:47.799+0000 7f1ccc084640 1 -- 172.21.15.132:0/90067595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1cc404f330 con 0x7f1cc4143b10 2024-03-16T17:47:48.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.459+0000 7f1cba7fc640 1 -- 172.21.15.132:0/90067595 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1cb4057bd0 con 0x7f1cc4143b10 2024-03-16T17:47:48.463 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2024-03-16T17:47:48.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.462+0000 7f1ccc084640 1 -- 172.21.15.132:0/90067595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f1ca806b3b0 msgr2=0x7f1ca806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.462+0000 7f1ccc084640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f1ca806b3b0 0x7f1ca806d870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0034000 tx=0x7f1cc002f000 comp rx=0 tx=0).stop 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.462+0000 7f1ccc084640 1 -- 172.21.15.132:0/90067595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cc4143b10 msgr2=0x7f1cc413ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.462+0000 7f1ccc084640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cc4143b10 0x7f1cc413ad90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1cb400c750 tx=0x7f1cb400cc10 comp rx=0 tx=0).stop 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.463+0000 7f1ccc084640 1 -- 172.21.15.132:0/90067595 shutdown_connections 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.463+0000 7f1ccc084640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f1ca806b3b0 0x7f1ca806d870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.463+0000 7f1ccc084640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4144120 0x7f1cc40d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.463+0000 7f1ccc084640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cc4143b10 0x7f1cc413ad90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.463+0000 7f1ccc084640 1 --2- 172.21.15.132:0/90067595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc40b4fa0 0x7f1cc4151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.463+0000 7f1ccc084640 1 -- 172.21.15.132:0/90067595 >> 172.21.15.132:0/90067595 conn(0x7f1cc406bff0 msgr2=0x7f1cc40b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.463+0000 7f1ccc084640 1 -- 172.21.15.132:0/90067595 shutdown_connections 2024-03-16T17:47:48.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.463+0000 7f1ccc084640 1 -- 172.21.15.132:0/90067595 wait complete. 2024-03-16T17:47:48.482 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T17:47:48.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.587+0000 7fd577c84640 1 Processor -- start 2024-03-16T17:47:48.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.587+0000 7fd577c84640 1 -- start start 2024-03-16T17:47:48.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.588+0000 7fd577c84640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd5700b58f0 0x7fd5700b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:48.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.588+0000 7fd577c84640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5700b48e0 con 0x7fd57006aee0 2024-03-16T17:47:48.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.588+0000 7fd577c84640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5700b4b30 con 0x7fd57015bbc0 2024-03-16T17:47:48.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.588+0000 7fd577c84640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5700b54d0 con 0x7fd5700b58f0 2024-03-16T17:47:48.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.588+0000 7fd576221640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd57006aee0 0x7fd5700cfe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49794/0 (socket says 172.21.15.132:49794) 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.588+0000 7fd576221640 1 -- 172.21.15.132:0/2197670914 learned_addr learned my addr 172.21.15.132:0/2197670914 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.588+0000 7fd57521f640 1 --2- 172.21.15.132:0/2197670914 >> v2:172.21.15.194:3300/0 conn(0x7fd5700b58f0 0x7fd5700b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.588+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102247099 0 0) 0x7fd5700b48e0 con 0x7fd57006aee0 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.588+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd55c003520 con 0x7fd57006aee0 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 555733799 0 0) 0x7fd55c003520 con 0x7fd57006aee0 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 >> v2:172.21.15.194:3300/0 conn(0x7fd5700b58f0 msgr2=0x7fd5700b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 --2- 172.21.15.132:0/2197670914 >> v2:172.21.15.194:3300/0 conn(0x7fd5700b58f0 0x7fd5700b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 >> v1:172.21.15.194:6789/0 conn(0x7fd57015bbc0 legacy=0x7fd5700cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5700b4e10 con 0x7fd57006aee0 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7fd5680019f0 con 0x7fd57006aee0 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 >> v1:172.21.15.132:6789/0 conn(0x7fd57006aee0 legacy=0x7fd5700cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd55c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd55c0047c0 0x7fd55c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd55c0052a0 0x7fd55c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5700b54d0 con 0x7fd55c003970 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c00c170 con 0x7fd55c0047c0 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55c00c330 con 0x7fd55c0052a0 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd575a20640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd55c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd57521f640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd55c0047c0 0x7fd55c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd576221640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd55c0052a0 0x7fd55c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd575a20640 1 -- 172.21.15.132:0/2197670914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd55c0052a0 msgr2=0x7fd55c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd575a20640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd55c0052a0 0x7fd55c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd575a20640 1 -- 172.21.15.132:0/2197670914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd55c0047c0 msgr2=0x7fd55c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd575a20640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd55c0047c0 0x7fd55c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd575a20640 1 -- 172.21.15.132:0/2197670914 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c003520 con 0x7fd55c003970 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd576221640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd55c0052a0 0x7fd55c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.589+0000 7fd576221640 1 -- 172.21.15.132:0/2197670914 reap_dead start 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.590+0000 7fd575a20640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd55c003d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd56c001720 tx=0x7fd55c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65664978272b54f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.590+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c0052d0 con 0x7fd55c003970 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.590+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c02e050 con 0x7fd55c003970 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.590+0000 7fd574a1e640 1 -- 172.21.15.132:0/2197670914 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c003830 con 0x7fd55c003970 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.590+0000 7fd577c84640 1 -- 172.21.15.132:0/2197670914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 msgr2=0x7fd55c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.590+0000 7fd577c84640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd55c003d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd56c001720 tx=0x7fd55c0057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.590+0000 7fd577c84640 1 -- 172.21.15.132:0/2197670914 shutdown_connections 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.590+0000 7fd577c84640 1 --2- 172.21.15.132:0/2197670914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd55c003d90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.590+0000 7fd577c84640 1 -- 172.21.15.132:0/2197670914 >> 172.21.15.132:0/2197670914 conn(0x7fd57006bff0 msgr2=0x7fd57006c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.591+0000 7fd577c84640 1 -- 172.21.15.132:0/2197670914 shutdown_connections 2024-03-16T17:47:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.591+0000 7fd577c84640 1 -- 172.21.15.132:0/2197670914 wait complete. 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.592+0000 7fd577c84640 1 Processor -- start 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.592+0000 7fd577c84640 1 -- start start 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.592+0000 7fd577c84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd570141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.592+0000 7fd577c84640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd570157700 0x7fd5701547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.592+0000 7fd577c84640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5701560a0 0x7fd570151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.592+0000 7fd577c84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd570141880 con 0x7fd55c003970 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.592+0000 7fd577c84640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd570156660 con 0x7fd570157700 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.592+0000 7fd577c84640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd570156940 con 0x7fd5701560a0 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.592+0000 7fd575a20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd570141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd575a20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd570141340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53430/0 (socket says 172.21.15.132:53430) 2024-03-16T17:47:48.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd575a20640 1 -- 172.21.15.132:0/1016078991 learned_addr learned my addr 172.21.15.132:0/1016078991 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd57521f640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd570157700 0x7fd5701547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd576221640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5701560a0 0x7fd570151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd575a20640 1 -- 172.21.15.132:0/1016078991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5701560a0 msgr2=0x7fd570151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd575a20640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5701560a0 0x7fd570151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd575a20640 1 -- 172.21.15.132:0/1016078991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd570157700 msgr2=0x7fd5701547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd575a20640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd570157700 0x7fd5701547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd575a20640 1 -- 172.21.15.132:0/1016078991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570156c20 con 0x7fd55c003970 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd576221640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5701560a0 0x7fd570151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd575a20640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd570141340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd56c005040 tx=0x7fd56c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd5667fc640 1 -- 172.21.15.132:0/1016078991 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c0076c0 con 0x7fd55c003970 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd5667fc640 1 -- 172.21.15.132:0/1016078991 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c007a30 con 0x7fd55c003970 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd5667fc640 1 -- 172.21.15.132:0/1016078991 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c006be0 con 0x7fd55c003970 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd577c84640 1 -- 172.21.15.132:0/1016078991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd570156f00 con 0x7fd55c003970 2024-03-16T17:47:48.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.593+0000 7fd577c84640 1 -- 172.21.15.132:0/1016078991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd570154d00 con 0x7fd55c003970 2024-03-16T17:47:48.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.594+0000 7fd577c84640 1 -- 172.21.15.132:0/1016078991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd570068450 con 0x7fd55c003970 2024-03-16T17:47:48.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.595+0000 7fd5667fc640 1 -- 172.21.15.132:0/1016078991 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fd56c006d40 con 0x7fd55c003970 2024-03-16T17:47:48.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.595+0000 7fd5667fc640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd55406b3b0 0x7fd55406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:48.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.595+0000 7fd5667fc640 1 -- 172.21.15.132:0/1016078991 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd56c0ab870 con 0x7fd55c003970 2024-03-16T17:47:48.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.595+0000 7fd57521f640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd55406b3b0 0x7fd55406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:48.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.595+0000 7fd57521f640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd55406b3b0 0x7fd55406d870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd5701f5150 tx=0x7fd560008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:48.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.600+0000 7fd5667fc640 1 -- 172.21.15.132:0/1016078991 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd56c076620 con 0x7fd55c003970 2024-03-16T17:47:48.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:48.773+0000 7fd577c84640 1 -- 172.21.15.132:0/1016078991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd570154e90 con 0x7fd55c003970 2024-03-16T17:47:49.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.462+0000 7fd5667fc640 1 -- 172.21.15.132:0/1016078991 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd570154e90 con 0x7fd55c003970 2024-03-16T17:47:49.466 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 -- 172.21.15.132:0/1016078991 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd55406b3b0 msgr2=0x7fd55406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd55406b3b0 0x7fd55406d870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd5701f5150 tx=0x7fd560008040 comp rx=0 tx=0).stop 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 -- 172.21.15.132:0/1016078991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 msgr2=0x7fd570141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd570141340 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd56c005040 tx=0x7fd56c001120 comp rx=0 tx=0).stop 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 -- 172.21.15.132:0/1016078991 shutdown_connections 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd55406b3b0 0x7fd55406d870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5701560a0 0x7fd570151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd570157700 0x7fd5701547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 --2- 172.21.15.132:0/1016078991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd55c003970 0x7fd570141340 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 -- 172.21.15.132:0/1016078991 >> 172.21.15.132:0/1016078991 conn(0x7fd57006bff0 msgr2=0x7fd57015d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 -- 172.21.15.132:0/1016078991 shutdown_connections 2024-03-16T17:47:49.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.465+0000 7fd577c84640 1 -- 172.21.15.132:0/1016078991 wait complete. 2024-03-16T17:47:49.491 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T17:47:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.590+0000 7f82cbeed640 1 Processor -- start 2024-03-16T17:47:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.590+0000 7f82cbeed640 1 -- start start 2024-03-16T17:47:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.591+0000 7f82cbeed640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82c40d0d10 0x7f82c40b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.591+0000 7f82cbeed640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f82c4161b40 0x7f82c40c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.591+0000 7f82cbeed640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c40cff20 con 0x7f82c4161760 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.591+0000 7f82cbeed640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c40b5500 con 0x7f82c4161b40 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.591+0000 7f82cbeed640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40cf5f0 con 0x7f82c40d0d10 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.591+0000 7f82c9c89640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f82c4161760 0x7f82c40d0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49796/0 (socket says 172.21.15.132:49796) 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.591+0000 7f82c9c89640 1 -- 172.21.15.132:0/2491071133 learned_addr learned my addr 172.21.15.132:0/2491071133 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.591+0000 7f82ca48a640 1 --2- 172.21.15.132:0/2491071133 >> v2:172.21.15.132:3300/0 conn(0x7f82c4161b40 0x7f82c40c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.591+0000 7f82c8c87640 1 -- 172.21.15.132:0/2491071133 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559261509 0 0) 0x7f82c40cff20 con 0x7f82c4161760 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.592+0000 7f82c8c87640 1 -- 172.21.15.132:0/2491071133 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b0003520 con 0x7f82c4161760 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.592+0000 7f82c9488640 1 --2- 172.21.15.132:0/2491071133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82c40d0d10 0x7f82c40b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.592+0000 7f82ca48a640 1 -- 172.21.15.132:0/2491071133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82c40d0d10 msgr2=0x7f82c40b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.592+0000 7f82ca48a640 1 --2- 172.21.15.132:0/2491071133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82c40d0d10 0x7f82c40b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.592+0000 7f82ca48a640 1 -- 172.21.15.132:0/2491071133 >> v1:172.21.15.132:6789/0 conn(0x7f82c4161760 legacy=0x7f82c40d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.592+0000 7f82ca48a640 1 -- 172.21.15.132:0/2491071133 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c40cf8d0 con 0x7f82c4161b40 2024-03-16T17:47:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.592+0000 7f82ca48a640 1 --2- 172.21.15.132:0/2491071133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 0x7f82c40c7d00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0097a0 tx=0x7f82bc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a1cb53add2e296 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:49.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.592+0000 7f82c8c87640 1 -- 172.21.15.132:0/2491071133 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc031830 con 0x7f82c4161b40 2024-03-16T17:47:49.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.592+0000 7f82c8c87640 1 -- 172.21.15.132:0/2491071133 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc031990 con 0x7f82c4161b40 2024-03-16T17:47:49.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.592+0000 7f82c8c87640 1 -- 172.21.15.132:0/2491071133 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc031d20 con 0x7f82c4161b40 2024-03-16T17:47:49.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.593+0000 7f82cbeed640 1 -- 172.21.15.132:0/2491071133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 msgr2=0x7f82c40c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:49.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.593+0000 7f82cbeed640 1 --2- 172.21.15.132:0/2491071133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 0x7f82c40c7d00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0097a0 tx=0x7f82bc02b8d0 comp rx=0 tx=0).stop 2024-03-16T17:47:49.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.593+0000 7f82cbeed640 1 -- 172.21.15.132:0/2491071133 shutdown_connections 2024-03-16T17:47:49.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.593+0000 7f82cbeed640 1 --2- 172.21.15.132:0/2491071133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 0x7f82c40c7d00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:49.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.593+0000 7f82cbeed640 1 --2- 172.21.15.132:0/2491071133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82c40d0d10 0x7f82c40b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.593+0000 7f82cbeed640 1 -- 172.21.15.132:0/2491071133 >> 172.21.15.132:0/2491071133 conn(0x7f82c40d3ed0 msgr2=0x7f82c40d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.593+0000 7f82cbeed640 1 -- 172.21.15.132:0/2491071133 shutdown_connections 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.593+0000 7f82cbeed640 1 -- 172.21.15.132:0/2491071133 wait complete. 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.594+0000 7f82cbeed640 1 Processor -- start 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.594+0000 7f82cbeed640 1 -- start start 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82cbeed640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82c40d0d10 0x7f82c40b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82cbeed640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82c4161760 0x7f82c41f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82cbeed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 0x7f82c40b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82cbeed640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c415cd30 con 0x7f82c4161b40 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82cbeed640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40b7b60 con 0x7f82c40d0d10 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82cbeed640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40b7930 con 0x7f82c4161760 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82ca48a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 0x7f82c40b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:49.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82ca48a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 0x7f82c40b8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53446/0 (socket says 172.21.15.132:53446) 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82ca48a640 1 -- 172.21.15.132:0/1036669728 learned_addr learned my addr 172.21.15.132:0/1036669728 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82c9488640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82c4161760 0x7f82c41f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82ca48a640 1 -- 172.21.15.132:0/1036669728 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82c4161760 msgr2=0x7f82c41f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82ca48a640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82c4161760 0x7f82c41f35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82c9c89640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82c40d0d10 0x7f82c40b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82ca48a640 1 -- 172.21.15.132:0/1036669728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82c40d0d10 msgr2=0x7f82c40b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82ca48a640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82c40d0d10 0x7f82c40b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82ca48a640 1 -- 172.21.15.132:0/1036669728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc009400 con 0x7f82c4161b40 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82c9c89640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82c40d0d10 0x7f82c40b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.595+0000 7f82ca48a640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 0x7f82c40b8f70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f82bc034040 tx=0x7f82bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.596+0000 7f82ba7fc640 1 -- 172.21.15.132:0/1036669728 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc03a830 con 0x7f82c4161b40 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.596+0000 7f82ba7fc640 1 -- 172.21.15.132:0/1036669728 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc03a9b0 con 0x7f82c4161b40 2024-03-16T17:47:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.596+0000 7f82cbeed640 1 -- 172.21.15.132:0/1036669728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c40c8ba0 con 0x7f82c4161b40 2024-03-16T17:47:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.596+0000 7f82ba7fc640 1 -- 172.21.15.132:0/1036669728 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc03ad60 con 0x7f82c4161b40 2024-03-16T17:47:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.596+0000 7f82cbeed640 1 -- 172.21.15.132:0/1036669728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c40c9100 con 0x7f82c4161b40 2024-03-16T17:47:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.597+0000 7f82cbeed640 1 -- 172.21.15.132:0/1036669728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c4068450 con 0x7f82c4161b40 2024-03-16T17:47:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.597+0000 7f82ba7fc640 1 -- 172.21.15.132:0/1036669728 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f82bc04d440 con 0x7f82c4161b40 2024-03-16T17:47:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.597+0000 7f82ba7fc640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f82a806b3b0 0x7f82a806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.597+0000 7f82ba7fc640 1 -- 172.21.15.132:0/1036669728 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f82bc0abc90 con 0x7f82c4161b40 2024-03-16T17:47:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.598+0000 7f82c9c89640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f82a806b3b0 0x7f82a806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.598+0000 7f82c9c89640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f82a806b3b0 0x7f82a806d870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005c00 tx=0x7f82c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:49.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.602+0000 7f82ba7fc640 1 -- 172.21.15.132:0/1036669728 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f82bc076950 con 0x7f82c4161b40 2024-03-16T17:47:49.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:49.812+0000 7f82cbeed640 1 -- 172.21.15.132:0/1036669728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f82c40a1d50 con 0x7f82c4161b40 2024-03-16T17:47:50.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.484+0000 7f82ba7fc640 1 -- 172.21.15.132:0/1036669728 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f82bc0350c0 con 0x7f82c4161b40 2024-03-16T17:47:50.488 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 2 and data pool 3 2024-03-16T17:47:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.489+0000 7f82cbeed640 1 -- 172.21.15.132:0/1036669728 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f82a806b3b0 msgr2=0x7f82a806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.489+0000 7f82cbeed640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f82a806b3b0 0x7f82a806d870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005c00 tx=0x7f82c0009040 comp rx=0 tx=0).stop 2024-03-16T17:47:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.489+0000 7f82cbeed640 1 -- 172.21.15.132:0/1036669728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 msgr2=0x7f82c40b8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.489+0000 7f82cbeed640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 0x7f82c40b8f70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f82bc034040 tx=0x7f82bc0046c0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.489+0000 7f82cbeed640 1 -- 172.21.15.132:0/1036669728 shutdown_connections 2024-03-16T17:47:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.489+0000 7f82cbeed640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f82a806b3b0 0x7f82a806d870 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005c00 tx=0x7f82c0009040 comp rx=0 tx=0).stop 2024-03-16T17:47:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.489+0000 7f82cbeed640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82c4161b40 0x7f82c40b8f70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.489+0000 7f82cbeed640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82c4161760 0x7f82c41f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.489+0000 7f82cbeed640 1 --2- 172.21.15.132:0/1036669728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82c40d0d10 0x7f82c40b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.489+0000 7f82cbeed640 1 -- 172.21.15.132:0/1036669728 >> 172.21.15.132:0/1036669728 conn(0x7f82c40d3ed0 msgr2=0x7f82c415cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.493+0000 7f82cbeed640 1 -- 172.21.15.132:0/1036669728 shutdown_connections 2024-03-16T17:47:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.493+0000 7f82cbeed640 1 -- 172.21.15.132:0/1036669728 wait complete. 2024-03-16T17:47:50.518 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.614+0000 7f80a538c640 1 Processor -- start 2024-03-16T17:47:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.614+0000 7f80a538c640 1 -- start start 2024-03-16T17:47:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.615+0000 7f80a538c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a015dfe0 0x7f80a006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.615+0000 7f80a538c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f80a0161bd0 0x7f80a0162030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.615+0000 7f80a538c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a0162a00 con 0x7f80a0162570 2024-03-16T17:47:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.615+0000 7f80a538c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a006cfe0 con 0x7f80a0161bd0 2024-03-16T17:47:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.615+0000 7f80a538c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00aea90 con 0x7f80a015dfe0 2024-03-16T17:47:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.615+0000 7f809f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f80a0162570 0x7f80a00cfdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49812/0 (socket says 172.21.15.132:49812) 2024-03-16T17:47:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.615+0000 7f809f7fe640 1 -- 172.21.15.132:0/130042595 learned_addr learned my addr 172.21.15.132:0/130042595 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.615+0000 7f809effd640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a015dfe0 0x7f80a006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.615+0000 7f809e7fc640 1 --2- 172.21.15.132:0/130042595 >> v2:172.21.15.194:3300/0 conn(0x7f80a0161bd0 0x7f80a0162030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.615+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964117551 0 0) 0x7f80a0162a00 con 0x7f80a0162570 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8088003520 con 0x7f80a0162570 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2934310427 0 0) 0x7f8088003520 con 0x7f80a0162570 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a015dfe0 msgr2=0x7f80a006ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a015dfe0 0x7f80a006ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 >> v2:172.21.15.194:3300/0 conn(0x7f80a0161bd0 msgr2=0x7f80a0162030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 --2- 172.21.15.132:0/130042595 >> v2:172.21.15.194:3300/0 conn(0x7f80a0161bd0 0x7f80a0162030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00aed70 con 0x7f80a0162570 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f8098001670 con 0x7f80a0162570 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 >> v1:172.21.15.132:6789/0 conn(0x7f80a0162570 legacy=0x7f80a00cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a015dfe0 0x7f8088003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088003ef0 0x7f80880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8088004d00 0x7f8088005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a006cfe0 con 0x7f8088003ef0 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00aea90 con 0x7f8088004d00 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808800b980 con 0x7f80a015dfe0 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809e7fc640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088003ef0 0x7f80880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809effd640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a015dfe0 0x7f8088003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809f7fe640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8088004d00 0x7f8088005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809e7fc640 1 -- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a015dfe0 msgr2=0x7f8088003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809e7fc640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f80a015dfe0 0x7f8088003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809e7fc640 1 -- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8088004d00 msgr2=0x7f8088005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809e7fc640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8088004d00 0x7f8088005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.616+0000 7f809e7fc640 1 -- 172.21.15.132:0/130042595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8088003520 con 0x7f8088003ef0 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.617+0000 7f809e7fc640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088003ef0 0x7f80880047c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8094009ac0 tx=0x7f80880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9d95975f1a84be server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.617+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809402c6d0 con 0x7f8088003ef0 2024-03-16T17:47:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.617+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809402c830 con 0x7f8088003ef0 2024-03-16T17:47:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.617+0000 7f809dffb640 1 -- 172.21.15.132:0/130042595 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809402cbc0 con 0x7f8088003ef0 2024-03-16T17:47:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.618+0000 7f80a538c640 1 -- 172.21.15.132:0/130042595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088003ef0 msgr2=0x7f80880047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.618+0000 7f80a538c640 1 --2- 172.21.15.132:0/130042595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8088003ef0 0x7f80880047c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8094009ac0 tx=0x7f80880057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.618+0000 7f809f7fe640 1 -- 172.21.15.132:0/130042595 reap_dead start 2024-03-16T17:47:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.618+0000 7f80a538c640 1 -- 172.21.15.132:0/130042595 shutdown_connections 2024-03-16T17:47:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.618+0000 7f80a538c640 1 -- 172.21.15.132:0/130042595 >> 172.21.15.132:0/130042595 conn(0x7f80a00d1c20 msgr2=0x7f80a00d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.618+0000 7f80a538c640 1 -- 172.21.15.132:0/130042595 shutdown_connections 2024-03-16T17:47:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.618+0000 7f80a538c640 1 -- 172.21.15.132:0/130042595 wait complete. 2024-03-16T17:47:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.619+0000 7f80a538c640 1 Processor -- start 2024-03-16T17:47:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.619+0000 7f80a538c640 1 -- start start 2024-03-16T17:47:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80a538c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8088003ef0 0x7f80a015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80a538c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80a0156310 0x7f80a014c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80a538c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a01582e0 0x7f80a015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80a538c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0158f90 con 0x7f80a0156310 2024-03-16T17:47:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80a538c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a015f240 con 0x7f80a01582e0 2024-03-16T17:47:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80a538c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a015e630 con 0x7f8088003ef0 2024-03-16T17:47:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80a0156310 0x7f80a014c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80a0156310 0x7f80a014c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53464/0 (socket says 172.21.15.132:53464) 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809e7fc640 1 -- 172.21.15.132:0/249165241 learned_addr learned my addr 172.21.15.132:0/249165241 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809f7fe640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a01582e0 0x7f80a015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809effd640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8088003ef0 0x7f80a015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809e7fc640 1 -- 172.21.15.132:0/249165241 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8088003ef0 msgr2=0x7f80a015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809e7fc640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8088003ef0 0x7f80a015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809e7fc640 1 -- 172.21.15.132:0/249165241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a01582e0 msgr2=0x7f80a015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809e7fc640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a01582e0 0x7f80a015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809e7fc640 1 -- 172.21.15.132:0/249165241 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a015e910 con 0x7f80a0156310 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f809e7fc640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80a0156310 0x7f80a014c280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8094037040 tx=0x7f8094004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80877fe640 1 -- 172.21.15.132:0/249165241 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094003810 con 0x7f80a0156310 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80877fe640 1 -- 172.21.15.132:0/249165241 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8094003970 con 0x7f80a0156310 2024-03-16T17:47:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80a538c640 1 -- 172.21.15.132:0/249165241 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a015ebf0 con 0x7f80a0156310 2024-03-16T17:47:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80877fe640 1 -- 172.21.15.132:0/249165241 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094003d20 con 0x7f80a0156310 2024-03-16T17:47:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.620+0000 7f80a538c640 1 -- 172.21.15.132:0/249165241 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a0158760 con 0x7f80a0156310 2024-03-16T17:47:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.621+0000 7f80a538c640 1 -- 172.21.15.132:0/249165241 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a004f2c0 con 0x7f80a0156310 2024-03-16T17:47:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.622+0000 7f80877fe640 1 -- 172.21.15.132:0/249165241 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f8094034440 con 0x7f80a0156310 2024-03-16T17:47:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.622+0000 7f80877fe640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f808c06b3e0 0x7f808c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.622+0000 7f80877fe640 1 -- 172.21.15.132:0/249165241 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80940abb20 con 0x7f80a0156310 2024-03-16T17:47:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.622+0000 7f809effd640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f808c06b3e0 0x7f808c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.623+0000 7f809effd640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f808c06b3e0 0x7f808c06d8a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8090014430 tx=0x7f809000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.627+0000 7f80877fe640 1 -- 172.21.15.132:0/249165241 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8094076830 con 0x7f80a0156310 2024-03-16T17:47:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.798+0000 7f80a538c640 1 -- 172.21.15.132:0/249165241 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80a0158a50 con 0x7f80a0156310 2024-03-16T17:47:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.799+0000 7f80877fe640 1 -- 172.21.15.132:0/249165241 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16654 (secure 0 0 0) 0x7f80940044e0 con 0x7f80a0156310 2024-03-16T17:47:50.803 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:50.803 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:49.814255+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.801+0000 7f80a538c640 1 -- 172.21.15.132:0/249165241 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f808c06b3e0 msgr2=0x7f808c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.801+0000 7f80a538c640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f808c06b3e0 0x7f808c06d8a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8090014430 tx=0x7f809000b040 comp rx=0 tx=0).stop 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.801+0000 7f80a538c640 1 -- 172.21.15.132:0/249165241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80a0156310 msgr2=0x7f80a014c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.801+0000 7f80a538c640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80a0156310 0x7f80a014c280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8094037040 tx=0x7f8094004730 comp rx=0 tx=0).stop 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.801+0000 7f80a538c640 1 -- 172.21.15.132:0/249165241 shutdown_connections 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.801+0000 7f80a538c640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f808c06b3e0 0x7f808c06d8a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.801+0000 7f80a538c640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a01582e0 0x7f80a015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.801+0000 7f80a538c640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80a0156310 0x7f80a014c280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.801+0000 7f80a538c640 1 --2- 172.21.15.132:0/249165241 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8088003ef0 0x7f80a015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.802+0000 7f80a538c640 1 -- 172.21.15.132:0/249165241 >> 172.21.15.132:0/249165241 conn(0x7f80a00d1c20 msgr2=0x7f80a00c5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.802+0000 7f80a538c640 1 -- 172.21.15.132:0/249165241 shutdown_connections 2024-03-16T17:47:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.802+0000 7f80a538c640 1 -- 172.21.15.132:0/249165241 wait complete. 2024-03-16T17:47:50.816 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:50.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.912+0000 7f825f5d7640 1 Processor -- start 2024-03-16T17:47:50.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.913+0000 7f825f5d7640 1 -- start start 2024-03-16T17:47:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.913+0000 7f825f5d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f82580ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.913+0000 7f825f5d7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f825806b5f0 0x7f82580b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.913+0000 7f825f5d7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8258161bd0 con 0x7f82580b0050 2024-03-16T17:47:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.913+0000 7f825f5d7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8258155370 con 0x7f825806b5f0 2024-03-16T17:47:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.913+0000 7f825f5d7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8258161eb0 con 0x7f8258154f90 2024-03-16T17:47:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.914+0000 7f825d373640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f82580ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.914+0000 7f825db74640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f825806b5f0 0x7f82580b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.914+0000 7f825d373640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f82580ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:53794/0 (socket says 172.21.15.132:53794) 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.914+0000 7f825db74640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f825806b5f0 0x7f82580b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47360/0 (socket says 172.21.15.132:47360) 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.914+0000 7f825cb72640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f82580b0050 0x7f825806aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46706/0 (socket says 172.21.15.132:46706) 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.914+0000 7f825d373640 1 -- 172.21.15.132:0/3414075356 learned_addr learned my addr 172.21.15.132:0/3414075356 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.914+0000 7f825d373640 1 -- 172.21.15.132:0/3414075356 >> v2:172.21.15.194:3300/0 conn(0x7f825806b5f0 msgr2=0x7f82580b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.914+0000 7f825d373640 1 --2- 172.21.15.132:0/3414075356 >> v2:172.21.15.194:3300/0 conn(0x7f825806b5f0 0x7f82580b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.914+0000 7f825d373640 1 -- 172.21.15.132:0/3414075356 >> v1:172.21.15.194:6789/0 conn(0x7f82580b0050 legacy=0x7f825806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.914+0000 7f825d373640 1 -- 172.21.15.132:0/3414075356 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8258162190 con 0x7f8258154f90 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.915+0000 7f825d373640 1 --2- 172.21.15.132:0/3414075356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f82580ae300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8248009870 tx=0x7f824802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b58a9cc3684c226b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.915+0000 7f8257fff640 1 -- 172.21.15.132:0/3414075356 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248030840 con 0x7f8258154f90 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.915+0000 7f8257fff640 1 -- 172.21.15.132:0/3414075356 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82480309a0 con 0x7f8258154f90 2024-03-16T17:47:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.915+0000 7f8257fff640 1 -- 172.21.15.132:0/3414075356 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248030d30 con 0x7f8258154f90 2024-03-16T17:47:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.915+0000 7f825f5d7640 1 -- 172.21.15.132:0/3414075356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 msgr2=0x7f82580ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.915+0000 7f825f5d7640 1 --2- 172.21.15.132:0/3414075356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f82580ae300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8248009870 tx=0x7f824802b980 comp rx=0 tx=0).stop 2024-03-16T17:47:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.916+0000 7f825f5d7640 1 -- 172.21.15.132:0/3414075356 shutdown_connections 2024-03-16T17:47:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.916+0000 7f825f5d7640 1 --2- 172.21.15.132:0/3414075356 >> v2:172.21.15.194:3300/0 conn(0x7f825806b5f0 0x7f82580b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.916+0000 7f825f5d7640 1 --2- 172.21.15.132:0/3414075356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f82580ae300 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.916+0000 7f825f5d7640 1 -- 172.21.15.132:0/3414075356 >> 172.21.15.132:0/3414075356 conn(0x7f825806bff0 msgr2=0x7f825806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.916+0000 7f825f5d7640 1 -- 172.21.15.132:0/3414075356 shutdown_connections 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.916+0000 7f825f5d7640 1 -- 172.21.15.132:0/3414075356 wait complete. 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.917+0000 7f825f5d7640 1 Processor -- start 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.917+0000 7f825f5d7640 1 -- start start 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.917+0000 7f825f5d7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825806b5f0 0x7f82580b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.917+0000 7f825f5d7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82580b0050 0x7f8258150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.917+0000 7f825f5d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f8258146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.917+0000 7f825f5d7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82581512c0 con 0x7f825806b5f0 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.917+0000 7f825f5d7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580b17e0 con 0x7f82580b0050 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.917+0000 7f825f5d7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82580b1ac0 con 0x7f8258154f90 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.917+0000 7f825d373640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825806b5f0 0x7f82580b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825d373640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825806b5f0 0x7f82580b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53476/0 (socket says 172.21.15.132:53476) 2024-03-16T17:47:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825d373640 1 -- 172.21.15.132:0/2595904765 learned_addr learned my addr 172.21.15.132:0/2595904765 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825cb72640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82580b0050 0x7f8258150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825db74640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f8258146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825d373640 1 -- 172.21.15.132:0/2595904765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 msgr2=0x7f8258146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825d373640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f8258146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825d373640 1 -- 172.21.15.132:0/2595904765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82580b0050 msgr2=0x7f8258150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825d373640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82580b0050 0x7f8258150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825d373640 1 -- 172.21.15.132:0/2595904765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82480094d0 con 0x7f825806b5f0 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825cb72640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82580b0050 0x7f8258150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825db74640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f8258146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825d373640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825806b5f0 0x7f82580b3710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8248000c00 tx=0x7f8248004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f8255ffb640 1 -- 172.21.15.132:0/2595904765 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248039a90 con 0x7f825806b5f0 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f8255ffb640 1 -- 172.21.15.132:0/2595904765 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248039bf0 con 0x7f825806b5f0 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f8255ffb640 1 -- 172.21.15.132:0/2595904765 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248043410 con 0x7f825806b5f0 2024-03-16T17:47:50.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825f5d7640 1 -- 172.21.15.132:0/2595904765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82580b1da0 con 0x7f825806b5f0 2024-03-16T17:47:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.918+0000 7f825f5d7640 1 -- 172.21.15.132:0/2595904765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82580b2360 con 0x7f825806b5f0 2024-03-16T17:47:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.919+0000 7f825f5d7640 1 -- 172.21.15.132:0/2595904765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8258068450 con 0x7f825806b5f0 2024-03-16T17:47:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.920+0000 7f8255ffb640 1 -- 172.21.15.132:0/2595904765 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f824804c3b0 con 0x7f825806b5f0 2024-03-16T17:47:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.920+0000 7f8255ffb640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f824406b3b0 0x7f824406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.920+0000 7f8255ffb640 1 -- 172.21.15.132:0/2595904765 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82480ac0d0 con 0x7f825806b5f0 2024-03-16T17:47:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.920+0000 7f825cb72640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f824406b3b0 0x7f824406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.921+0000 7f825cb72640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f824406b3b0 0x7f824406d870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82580b3c50 tx=0x7f824c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:50.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:50.924+0000 7f8255ffb640 1 -- 172.21.15.132:0/2595904765 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8248076ee0 con 0x7f825806b5f0 2024-03-16T17:47:51.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.096+0000 7f825f5d7640 1 -- 172.21.15.132:0/2595904765 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f825804f2c0 con 0x7f825806b5f0 2024-03-16T17:47:51.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.097+0000 7f8255ffb640 1 -- 172.21.15.132:0/2595904765 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16654 (secure 0 0 0) 0x7f824807a5a0 con 0x7f825806b5f0 2024-03-16T17:47:51.101 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:51.101 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:49.814255+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 -- 172.21.15.132:0/2595904765 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f824406b3b0 msgr2=0x7f824406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f824406b3b0 0x7f824406d870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f82580b3c50 tx=0x7f824c009040 comp rx=0 tx=0).stop 2024-03-16T17:47:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 -- 172.21.15.132:0/2595904765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825806b5f0 msgr2=0x7f82580b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825806b5f0 0x7f82580b3710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8248000c00 tx=0x7f8248004730 comp rx=0 tx=0).stop 2024-03-16T17:47:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 -- 172.21.15.132:0/2595904765 shutdown_connections 2024-03-16T17:47:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f824406b3b0 0x7f824406d870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8258154f90 0x7f8258146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82580b0050 0x7f8258150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 --2- 172.21.15.132:0/2595904765 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825806b5f0 0x7f82580b3710 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 -- 172.21.15.132:0/2595904765 >> 172.21.15.132:0/2595904765 conn(0x7f825806bff0 msgr2=0x7f8258160b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 -- 172.21.15.132:0/2595904765 shutdown_connections 2024-03-16T17:47:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.099+0000 7f825f5d7640 1 -- 172.21.15.132:0/2595904765 wait complete. 2024-03-16T17:47:51.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T17:47:51.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.212+0000 7f5a78447640 1 Processor -- start 2024-03-16T17:47:51.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.213+0000 7f5a78447640 1 -- start start 2024-03-16T17:47:51.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.213+0000 7f5a78447640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a700b3b50 0x7f5a70072760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.213+0000 7f5a78447640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5a7015e280 0x7f5a7015e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.213+0000 7f5a78447640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700b5cb0 con 0x7f5a7006aee0 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.213+0000 7f5a78447640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a70073020 con 0x7f5a7015e280 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.213+0000 7f5a78447640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700b53c0 con 0x7f5a700b3b50 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a761e3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5a7006aee0 0x7f5a7006b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49828/0 (socket says 172.21.15.132:49828) 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a761e3640 1 -- 172.21.15.132:0/3505605075 learned_addr learned my addr 172.21.15.132:0/3505605075 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a769e4640 1 --2- 172.21.15.132:0/3505605075 >> v2:172.21.15.194:3300/0 conn(0x7f5a7015e280 0x7f5a7015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a759e2640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a700b3b50 0x7f5a70072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070350762 0 0) 0x7f5a700b5cb0 con 0x7f5a7006aee0 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a5c003520 con 0x7f5a7006aee0 2024-03-16T17:47:51.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1546580543 0 0) 0x7f5a5c003520 con 0x7f5a7006aee0 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a700b3b50 msgr2=0x7f5a70072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a700b3b50 0x7f5a70072760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 >> v2:172.21.15.194:3300/0 conn(0x7f5a7015e280 msgr2=0x7f5a7015e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 --2- 172.21.15.132:0/3505605075 >> v2:172.21.15.194:3300/0 conn(0x7f5a7015e280 0x7f5a7015e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70072d40 con 0x7f5a7006aee0 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f5a6c001670 con 0x7f5a7006aee0 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a769e4640 1 --2- 172.21.15.132:0/3505605075 >> v2:172.21.15.194:3300/0 conn(0x7f5a7015e280 0x7f5a7015e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 >> v1:172.21.15.132:6789/0 conn(0x7f5a7006aee0 legacy=0x7f5a7006b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a700b3b50 0x7f5a5c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 0x7f5a5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a5c004d00 0x7f5a5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70073020 con 0x7f5a5c003ef0 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700b53c0 con 0x7f5a5c004d00 2024-03-16T17:47:51.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c00b980 con 0x7f5a700b3b50 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a759e2640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 0x7f5a5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a761e3640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a700b3b50 0x7f5a5c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.214+0000 7f5a769e4640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a5c004d00 0x7f5a5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.215+0000 7f5a759e2640 1 -- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a700b3b50 msgr2=0x7f5a5c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.215+0000 7f5a759e2640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a700b3b50 0x7f5a5c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.215+0000 7f5a759e2640 1 -- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a5c004d00 msgr2=0x7f5a5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.215+0000 7f5a759e2640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a5c004d00 0x7f5a5c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.215+0000 7f5a759e2640 1 -- 172.21.15.132:0/3505605075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c003520 con 0x7f5a5c003ef0 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.215+0000 7f5a769e4640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a5c004d00 0x7f5a5c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.215+0000 7f5a759e2640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 0x7f5a5c0047c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009ac0 tx=0x7f5a5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971bc811656b301a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.215+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6002c6b0 con 0x7f5a5c003ef0 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.215+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6002c810 con 0x7f5a5c003ef0 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.215+0000 7f5a751e1640 1 -- 172.21.15.132:0/3505605075 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6002cba0 con 0x7f5a5c003ef0 2024-03-16T17:47:51.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.216+0000 7f5a78447640 1 -- 172.21.15.132:0/3505605075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 msgr2=0x7f5a5c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.216+0000 7f5a78447640 1 --2- 172.21.15.132:0/3505605075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 0x7f5a5c0047c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009ac0 tx=0x7f5a5c0057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.216+0000 7f5a769e4640 1 -- 172.21.15.132:0/3505605075 reap_dead start 2024-03-16T17:47:51.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.216+0000 7f5a78447640 1 -- 172.21.15.132:0/3505605075 shutdown_connections 2024-03-16T17:47:51.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.216+0000 7f5a78447640 1 -- 172.21.15.132:0/3505605075 >> 172.21.15.132:0/3505605075 conn(0x7f5a700b2850 msgr2=0x7f5a700b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:51.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.216+0000 7f5a78447640 1 -- 172.21.15.132:0/3505605075 shutdown_connections 2024-03-16T17:47:51.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.216+0000 7f5a78447640 1 -- 172.21.15.132:0/3505605075 wait complete. 2024-03-16T17:47:51.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.217+0000 7f5a78447640 1 Processor -- start 2024-03-16T17:47:51.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.217+0000 7f5a78447640 1 -- start start 2024-03-16T17:47:51.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a78447640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 0x7f5a7014c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a78447640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a701f4ae0 0x7f5a70160e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a78447640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a700ceb20 0x7f5a700cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a78447640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a701f5bd0 con 0x7f5a5c003ef0 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a78447640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7015e690 con 0x7f5a700ceb20 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a78447640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700cf4e0 con 0x7f5a701f4ae0 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a761e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 0x7f5a7014c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a761e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 0x7f5a7014c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53502/0 (socket says 172.21.15.132:53502) 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a761e3640 1 -- 172.21.15.132:0/4068797252 learned_addr learned my addr 172.21.15.132:0/4068797252 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a769e4640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a700ceb20 0x7f5a700cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a759e2640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a701f4ae0 0x7f5a70160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a761e3640 1 -- 172.21.15.132:0/4068797252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a701f4ae0 msgr2=0x7f5a70160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a761e3640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a701f4ae0 0x7f5a70160e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a761e3640 1 -- 172.21.15.132:0/4068797252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a700ceb20 msgr2=0x7f5a700cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a761e3640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a700ceb20 0x7f5a700cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a761e3640 1 -- 172.21.15.132:0/4068797252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a701f4f90 con 0x7f5a5c003ef0 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a769e4640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a700ceb20 0x7f5a700cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.218+0000 7f5a761e3640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 0x7f5a7014c440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c007340 tx=0x7f5a6c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.219+0000 7f5a66ffd640 1 -- 172.21.15.132:0/4068797252 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c00f940 con 0x7f5a5c003ef0 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.219+0000 7f5a66ffd640 1 -- 172.21.15.132:0/4068797252 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c00faa0 con 0x7f5a5c003ef0 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.219+0000 7f5a66ffd640 1 -- 172.21.15.132:0/4068797252 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c00fe30 con 0x7f5a5c003ef0 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.219+0000 7f5a78447640 1 -- 172.21.15.132:0/4068797252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a701f5230 con 0x7f5a5c003ef0 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.219+0000 7f5a78447640 1 -- 172.21.15.132:0/4068797252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a701f57f0 con 0x7f5a5c003ef0 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.220+0000 7f5a78447640 1 -- 172.21.15.132:0/4068797252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a701f5d10 con 0x7f5a5c003ef0 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.220+0000 7f5a66ffd640 1 -- 172.21.15.132:0/4068797252 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f5a6c01d460 con 0x7f5a5c003ef0 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.220+0000 7f5a66ffd640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a5406b3b0 0x7f5a5406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.220+0000 7f5a66ffd640 1 -- 172.21.15.132:0/4068797252 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a6c089e10 con 0x7f5a5c003ef0 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.220+0000 7f5a759e2640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a5406b3b0 0x7f5a5406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.221+0000 7f5a759e2640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a5406b3b0 0x7f5a5406d870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a60036000 tx=0x7f5a60030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.225+0000 7f5a66ffd640 1 -- 172.21.15.132:0/4068797252 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5a701f5d10 con 0x7f5a5c003ef0 2024-03-16T17:47:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.432+0000 7f5a78447640 1 -- 172.21.15.132:0/4068797252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5a701f5d10 con 0x7f5a5c003ef0 2024-03-16T17:47:51.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.485+0000 7f5a66ffd640 1 -- 172.21.15.132:0/4068797252 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5a701f5d10 con 0x7f5a5c003ef0 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 -- 172.21.15.132:0/4068797252 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a5406b3b0 msgr2=0x7f5a5406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a5406b3b0 0x7f5a5406d870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a60036000 tx=0x7f5a60030000 comp rx=0 tx=0).stop 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 -- 172.21.15.132:0/4068797252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 msgr2=0x7f5a7014c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 0x7f5a7014c440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c007340 tx=0x7f5a6c007800 comp rx=0 tx=0).stop 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 -- 172.21.15.132:0/4068797252 shutdown_connections 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a5406b3b0 0x7f5a5406d870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a700ceb20 0x7f5a700cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a701f4ae0 0x7f5a70160e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 --2- 172.21.15.132:0/4068797252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a5c003ef0 0x7f5a7014c440 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 -- 172.21.15.132:0/4068797252 >> 172.21.15.132:0/4068797252 conn(0x7f5a700b2850 msgr2=0x7f5a700ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:51.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 -- 172.21.15.132:0/4068797252 shutdown_connections 2024-03-16T17:47:51.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.487+0000 7f5a78447640 1 -- 172.21.15.132:0/4068797252 wait complete. 2024-03-16T17:47:51.502 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T17:47:51.503 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-16T17:47:51.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.632+0000 7fb858b80640 1 Processor -- start 2024-03-16T17:47:51.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.632+0000 7fb858b80640 1 -- start start 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.633+0000 7fb858b80640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb85415c4f0 0x7fb8540d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.633+0000 7fb858b80640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb85415d640 0x7fb85415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.633+0000 7fb858b80640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8540ce2e0 con 0x7fb8540b30d0 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.633+0000 7fb858b80640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8540ceb80 con 0x7fb85415c4f0 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.633+0000 7fb858b80640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85415dff0 con 0x7fb85415d640 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb84bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb8540b30d0 0x7fb8540cf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49844/0 (socket says 172.21.15.132:49844) 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb84bfff640 1 -- 172.21.15.132:0/2191932192 learned_addr learned my addr 172.21.15.132:0/2191932192 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb85259c640 1 --2- 172.21.15.132:0/2191932192 >> v2:172.21.15.194:3300/0 conn(0x7fb85415c4f0 0x7fb8540d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb852d9d640 1 --2- 172.21.15.132:0/2191932192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb85415d640 0x7fb85415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb851d9b640 1 -- 172.21.15.132:0/2191932192 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128956266 0 0) 0x7fb8540ce2e0 con 0x7fb8540b30d0 2024-03-16T17:47:51.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb851d9b640 1 -- 172.21.15.132:0/2191932192 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb840003520 con 0x7fb8540b30d0 2024-03-16T17:47:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb85259c640 1 -- 172.21.15.132:0/2191932192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb85415d640 msgr2=0x7fb85415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb85259c640 1 --2- 172.21.15.132:0/2191932192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb85415d640 0x7fb85415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb85259c640 1 -- 172.21.15.132:0/2191932192 >> v1:172.21.15.132:6789/0 conn(0x7fb8540b30d0 legacy=0x7fb8540cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb85259c640 1 -- 172.21.15.132:0/2191932192 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8540cf720 con 0x7fb85415c4f0 2024-03-16T17:47:51.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.634+0000 7fb852d9d640 1 --2- 172.21.15.132:0/2191932192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb85415d640 0x7fb85415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:51.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.635+0000 7fb85259c640 1 --2- 172.21.15.132:0/2191932192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85415c4f0 0x7fb8540d1f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097a0 tx=0x7fb84402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1728dca69af65d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:51.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.635+0000 7fb851d9b640 1 -- 172.21.15.132:0/2191932192 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844031830 con 0x7fb85415c4f0 2024-03-16T17:47:51.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.635+0000 7fb851d9b640 1 -- 172.21.15.132:0/2191932192 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb844031990 con 0x7fb85415c4f0 2024-03-16T17:47:51.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.635+0000 7fb851d9b640 1 -- 172.21.15.132:0/2191932192 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844031d20 con 0x7fb85415c4f0 2024-03-16T17:47:51.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.636+0000 7fb858b80640 1 -- 172.21.15.132:0/2191932192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85415c4f0 msgr2=0x7fb8540d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.636+0000 7fb858b80640 1 --2- 172.21.15.132:0/2191932192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85415c4f0 0x7fb8540d1f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097a0 tx=0x7fb84402b8d0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.636+0000 7fb858b80640 1 -- 172.21.15.132:0/2191932192 shutdown_connections 2024-03-16T17:47:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.636+0000 7fb858b80640 1 --2- 172.21.15.132:0/2191932192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb85415d640 0x7fb85415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.636+0000 7fb858b80640 1 --2- 172.21.15.132:0/2191932192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85415c4f0 0x7fb8540d1f80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.636+0000 7fb858b80640 1 -- 172.21.15.132:0/2191932192 >> 172.21.15.132:0/2191932192 conn(0x7fb854073220 msgr2=0x7fb85409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.636+0000 7fb858b80640 1 -- 172.21.15.132:0/2191932192 shutdown_connections 2024-03-16T17:47:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.636+0000 7fb858b80640 1 -- 172.21.15.132:0/2191932192 wait complete. 2024-03-16T17:47:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.638+0000 7fb858b80640 1 Processor -- start 2024-03-16T17:47:51.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.638+0000 7fb858b80640 1 -- start start 2024-03-16T17:47:51.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.639+0000 7fb858b80640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8540b30d0 0x7fb8541f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.639+0000 7fb858b80640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85415c4f0 0x7fb85414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.639+0000 7fb858b80640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb85415d640 0x7fb85414f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.639+0000 7fb858b80640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541f5ff0 con 0x7fb85415d640 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.639+0000 7fb858b80640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541f5060 con 0x7fb85415c4f0 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.639+0000 7fb858b80640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85414e930 con 0x7fb8540b30d0 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.639+0000 7fb852d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb85415d640 0x7fb85414f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.639+0000 7fb852d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb85415d640 0x7fb85414f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53516/0 (socket says 172.21.15.132:53516) 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb852d9d640 1 -- 172.21.15.132:0/3553258216 learned_addr learned my addr 172.21.15.132:0/3553258216 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb85259c640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8540b30d0 0x7fb8541f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb84bfff640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85415c4f0 0x7fb85414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb852d9d640 1 -- 172.21.15.132:0/3553258216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8540b30d0 msgr2=0x7fb8541f5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb852d9d640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8540b30d0 0x7fb8541f5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb852d9d640 1 -- 172.21.15.132:0/3553258216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85415c4f0 msgr2=0x7fb85414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb852d9d640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85415c4f0 0x7fb85414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb852d9d640 1 -- 172.21.15.132:0/3553258216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c009a70 con 0x7fb85415d640 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb85259c640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8540b30d0 0x7fb8541f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb852d9d640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb85415d640 0x7fb85414f000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00efc0 tx=0x7fb84c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb84affd640 1 -- 172.21.15.132:0/3553258216 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c009d70 con 0x7fb85415d640 2024-03-16T17:47:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb84affd640 1 -- 172.21.15.132:0/3553258216 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c00f040 con 0x7fb85415d640 2024-03-16T17:47:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb858b80640 1 -- 172.21.15.132:0/3553258216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb844009400 con 0x7fb85415d640 2024-03-16T17:47:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb84affd640 1 -- 172.21.15.132:0/3553258216 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c003990 con 0x7fb85415d640 2024-03-16T17:47:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.640+0000 7fb858b80640 1 -- 172.21.15.132:0/3553258216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8541f52b0 con 0x7fb85415d640 2024-03-16T17:47:51.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.641+0000 7fb858b80640 1 -- 172.21.15.132:0/3553258216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85409fe70 con 0x7fb85415d640 2024-03-16T17:47:51.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.642+0000 7fb84affd640 1 -- 172.21.15.132:0/3553258216 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb84c0144a0 con 0x7fb85415d640 2024-03-16T17:47:51.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.642+0000 7fb84affd640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb83406b3e0 0x7fb83406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:51.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.642+0000 7fb85259c640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb83406b3e0 0x7fb83406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:51.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.642+0000 7fb84affd640 1 -- 172.21.15.132:0/3553258216 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb84c08a7c0 con 0x7fb85415d640 2024-03-16T17:47:51.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.643+0000 7fb85259c640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb83406b3e0 0x7fb83406d8a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb844036000 tx=0x7fb84403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:51.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.646+0000 7fb84affd640 1 -- 172.21.15.132:0/3553258216 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb84c0554b0 con 0x7fb85415d640 2024-03-16T17:47:51.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:51.862+0000 7fb858b80640 1 -- 172.21.15.132:0/3553258216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb8540b2bc0 con 0x7fb85415d640 2024-03-16T17:47:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.496+0000 7fb84affd640 1 -- 172.21.15.132:0/3553258216 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb84c058b70 con 0x7fb85415d640 2024-03-16T17:47:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 -- 172.21.15.132:0/3553258216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb83406b3e0 msgr2=0x7fb83406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb83406b3e0 0x7fb83406d8a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb844036000 tx=0x7fb84403c040 comp rx=0 tx=0).stop 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 -- 172.21.15.132:0/3553258216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb85415d640 msgr2=0x7fb85414f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb85415d640 0x7fb85414f000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00efc0 tx=0x7fb84c009f90 comp rx=0 tx=0).stop 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 -- 172.21.15.132:0/3553258216 shutdown_connections 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb83406b3e0 0x7fb83406d8a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb85415d640 0x7fb85414f000 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85415c4f0 0x7fb85414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 --2- 172.21.15.132:0/3553258216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8540b30d0 0x7fb8541f5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 -- 172.21.15.132:0/3553258216 >> 172.21.15.132:0/3553258216 conn(0x7fb854073220 msgr2=0x7fb854155670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 -- 172.21.15.132:0/3553258216 shutdown_connections 2024-03-16T17:47:52.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.498+0000 7fb858b80640 1 -- 172.21.15.132:0/3553258216 wait complete. 2024-03-16T17:47:52.513 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-16T17:47:52.513 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:47:52.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.612+0000 7f26767e4640 1 Processor -- start 2024-03-16T17:47:52.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.612+0000 7f26767e4640 1 -- start start 2024-03-16T17:47:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f26767e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267015e3d0 0x7f26700d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f26767e4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f26700d2910 0x7f26700b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f26767e4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26700d2d80 con 0x7f267015dff0 2024-03-16T17:47:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f26767e4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26700cff10 con 0x7f26700d2910 2024-03-16T17:47:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f26767e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26700b6e60 con 0x7f267015e3d0 2024-03-16T17:47:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f267015dff0 0x7f26700cf490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49860/0 (socket says 172.21.15.132:49860) 2024-03-16T17:47:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266ffff640 1 -- 172.21.15.132:0/245701294 learned_addr learned my addr 172.21.15.132:0/245701294 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219918835 0 0) 0x7f26700d2d80 con 0x7f267015dff0 2024-03-16T17:47:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2658003520 con 0x7f267015dff0 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f2674d81640 1 --2- 172.21.15.132:0/245701294 >> v2:172.21.15.194:3300/0 conn(0x7f26700d2910 0x7f26700b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266f7fe640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267015e3d0 0x7f26700d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2164645988 0 0) 0x7f2658003520 con 0x7f267015dff0 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267015e3d0 msgr2=0x7f26700d23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267015e3d0 0x7f26700d23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 >> v2:172.21.15.194:3300/0 conn(0x7f26700d2910 msgr2=0x7f26700b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 --2- 172.21.15.132:0/245701294 >> v2:172.21.15.194:3300/0 conn(0x7f26700d2910 0x7f26700b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700b7140 con 0x7f267015dff0 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f2664001670 con 0x7f267015dff0 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 >> v1:172.21.15.132:6789/0 conn(0x7f267015dff0 legacy=0x7f26700cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2658003970 0x7f2658003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26580047c0 0x7f2658004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267015e3d0 0x7f2658005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26700cff10 con 0x7f2658003970 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26700b6e60 con 0x7f26580047c0 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.613+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265800b980 con 0x7f267015e3d0 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.614+0000 7f266ffff640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2658003970 0x7f2658003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.614+0000 7f266f7fe640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26580047c0 0x7f2658004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.614+0000 7f2674d81640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267015e3d0 0x7f2658005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.614+0000 7f266ffff640 1 -- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267015e3d0 msgr2=0x7f2658005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.614+0000 7f266ffff640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267015e3d0 0x7f2658005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.614+0000 7f266ffff640 1 -- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26580047c0 msgr2=0x7f2658004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.614+0000 7f266ffff640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26580047c0 0x7f2658004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.614+0000 7f266ffff640 1 -- 172.21.15.132:0/245701294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2658003520 con 0x7f2658003970 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.615+0000 7f266ffff640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2658003970 0x7f2658003d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f266400c240 tx=0x7f26580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd859c1ea7befe server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.615+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266402cb00 con 0x7f2658003970 2024-03-16T17:47:52.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.615+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266402cc60 con 0x7f2658003970 2024-03-16T17:47:52.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.615+0000 7f266effd640 1 -- 172.21.15.132:0/245701294 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664005af0 con 0x7f2658003970 2024-03-16T17:47:52.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.615+0000 7f26767e4640 1 -- 172.21.15.132:0/245701294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2658003970 msgr2=0x7f2658003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.615+0000 7f26767e4640 1 --2- 172.21.15.132:0/245701294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2658003970 0x7f2658003d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f266400c240 tx=0x7f26580057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.615+0000 7f2674d81640 1 -- 172.21.15.132:0/245701294 reap_dead start 2024-03-16T17:47:52.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.615+0000 7f26767e4640 1 -- 172.21.15.132:0/245701294 shutdown_connections 2024-03-16T17:47:52.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.615+0000 7f26767e4640 1 -- 172.21.15.132:0/245701294 >> 172.21.15.132:0/245701294 conn(0x7f26700d3e70 msgr2=0x7f26700d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:52.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.616+0000 7f26767e4640 1 -- 172.21.15.132:0/245701294 shutdown_connections 2024-03-16T17:47:52.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.616+0000 7f26767e4640 1 -- 172.21.15.132:0/245701294 wait complete. 2024-03-16T17:47:52.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.617+0000 7f26767e4640 1 Processor -- start 2024-03-16T17:47:52.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.617+0000 7f26767e4640 1 -- start start 2024-03-16T17:47:52.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.617+0000 7f26767e4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2658003970 0x7f26700c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.617+0000 7f26767e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f267015fe20 0x7f26700cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.617+0000 7f26767e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26700cd5f0 0x7f267015e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.617+0000 7f26767e4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26700ca8d0 con 0x7f267015fe20 2024-03-16T17:47:52.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.617+0000 7f26767e4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2670144e90 con 0x7f26700cd5f0 2024-03-16T17:47:52.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f26767e4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2670145170 con 0x7f2658003970 2024-03-16T17:47:52.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f267015fe20 0x7f26700cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f267015fe20 0x7f26700cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53528/0 (socket says 172.21.15.132:53528) 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266f7fe640 1 -- 172.21.15.132:0/177224852 learned_addr learned my addr 172.21.15.132:0/177224852 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266ffff640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2658003970 0x7f26700c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f2674d81640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26700cd5f0 0x7f267015e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266f7fe640 1 -- 172.21.15.132:0/177224852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2658003970 msgr2=0x7f26700c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266f7fe640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2658003970 0x7f26700c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266f7fe640 1 -- 172.21.15.132:0/177224852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26700cd5f0 msgr2=0x7f267015e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266f7fe640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26700cd5f0 0x7f267015e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266f7fe640 1 -- 172.21.15.132:0/177224852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2670145450 con 0x7f267015fe20 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266f7fe640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f267015fe20 0x7f26700cd0b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2660011960 tx=0x7f2660011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266cff9640 1 -- 172.21.15.132:0/177224852 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660004240 con 0x7f267015fe20 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266cff9640 1 -- 172.21.15.132:0/177224852 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26600043a0 con 0x7f267015fe20 2024-03-16T17:47:52.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f26767e4640 1 -- 172.21.15.132:0/177224852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2670145730 con 0x7f267015fe20 2024-03-16T17:47:52.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f266cff9640 1 -- 172.21.15.132:0/177224852 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266000fa20 con 0x7f267015fe20 2024-03-16T17:47:52.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.618+0000 7f26767e4640 1 -- 172.21.15.132:0/177224852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2670160480 con 0x7f267015fe20 2024-03-16T17:47:52.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.619+0000 7f26767e4640 1 -- 172.21.15.132:0/177224852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2670068450 con 0x7f267015fe20 2024-03-16T17:47:52.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.620+0000 7f266cff9640 1 -- 172.21.15.132:0/177224852 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f266000fb80 con 0x7f267015fe20 2024-03-16T17:47:52.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.620+0000 7f266cff9640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f265c06b3e0 0x7f265c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.620+0000 7f266cff9640 1 -- 172.21.15.132:0/177224852 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f266008a180 con 0x7f267015fe20 2024-03-16T17:47:52.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.620+0000 7f266ffff640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f265c06b3e0 0x7f265c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.621+0000 7f266ffff640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f265c06b3e0 0x7f265c06d8a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2664034000 tx=0x7f2664007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:52.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.625+0000 7f266cff9640 1 -- 172.21.15.132:0/177224852 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2660054e90 con 0x7f267015fe20 2024-03-16T17:47:52.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.839+0000 7f26767e4640 1 -- 172.21.15.132:0/177224852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f267004f2c0 con 0x7f267015fe20 2024-03-16T17:47:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.839+0000 7f266cff9640 1 -- 172.21.15.132:0/177224852 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4980 (secure 0 0 0) 0x7f2660058550 con 0x7f267015fe20 2024-03-16T17:47:52.843 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:52.843 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/481194427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":481194427},{"type":"v1","addr":"172.21.15.194:6834","nonce":481194427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1590172463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1590172463},{"type":"v1","addr":"172.21.15.194:6835","nonce":1590172463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2008777747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2008777747},{"type":"v1","addr":"172.21.15.132:6835","nonce":2008777747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T17:47:49.814572+0000","modified":"2024-03-16T17:47:51.863322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1367984600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1367984600},{"type":"v1","addr":"172.21.15.132:6837","nonce":1367984600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-16T17:47:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-03-16T17:47:52.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.841+0000 7f26767e4640 1 -- 172.21.15.132:0/177224852 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f265c06b3e0 msgr2=0x7f265c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.841+0000 7f26767e4640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f265c06b3e0 0x7f265c06d8a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2664034000 tx=0x7f2664007000 comp rx=0 tx=0).stop 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.841+0000 7f26767e4640 1 -- 172.21.15.132:0/177224852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f267015fe20 msgr2=0x7f26700cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.841+0000 7f26767e4640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f267015fe20 0x7f26700cd0b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2660011960 tx=0x7f2660011e20 comp rx=0 tx=0).stop 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.841+0000 7f26767e4640 1 -- 172.21.15.132:0/177224852 shutdown_connections 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.841+0000 7f26767e4640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f265c06b3e0 0x7f265c06d8a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.841+0000 7f26767e4640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26700cd5f0 0x7f267015e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.841+0000 7f26767e4640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f267015fe20 0x7f26700cd0b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.841+0000 7f26767e4640 1 --2- 172.21.15.132:0/177224852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2658003970 0x7f26700c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.841+0000 7f26767e4640 1 -- 172.21.15.132:0/177224852 >> 172.21.15.132:0/177224852 conn(0x7f26700d3e70 msgr2=0x7f26700b8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.842+0000 7f26767e4640 1 -- 172.21.15.132:0/177224852 shutdown_connections 2024-03-16T17:47:52.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.842+0000 7f26767e4640 1 -- 172.21.15.132:0/177224852 wait complete. 2024-03-16T17:47:52.856 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:52.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.953+0000 7f4f4d4b5640 1 Processor -- start 2024-03-16T17:47:52.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.953+0000 7f4f4d4b5640 1 -- start start 2024-03-16T17:47:52.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f4d4b5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4f48161540 0x7f4f480b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f4d4b5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f480d0680 con 0x7f4f480d1980 2024-03-16T17:47:52.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f4d4b5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f480d08d0 con 0x7f4f480cf080 2024-03-16T17:47:52.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f4d4b5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f480b4f30 con 0x7f4f48161540 2024-03-16T17:47:52.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f46ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4f48161540 0x7f4f480b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f477fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4f480d1980 0x7f4f480d1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49868/0 (socket says 172.21.15.132:49868) 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f477fe640 1 -- 172.21.15.132:0/3908951983 learned_addr learned my addr 172.21.15.132:0/3908951983 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f46ffd640 1 --2- 172.21.15.132:0/3908951983 >> v2:172.21.15.132:3300/0 conn(0x7f4f48161540 0x7f4f480b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53536/0 (socket says 172.21.15.132:53536) 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f46ffd640 1 -- 172.21.15.132:0/3908951983 >> v1:172.21.15.194:6789/0 conn(0x7f4f480cf080 legacy=0x7f4f480cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f46ffd640 1 -- 172.21.15.132:0/3908951983 >> v1:172.21.15.132:6789/0 conn(0x7f4f480d1980 legacy=0x7f4f480d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f46ffd640 1 -- 172.21.15.132:0/3908951983 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f480d0bb0 con 0x7f4f48161540 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.954+0000 7f4f45ffb640 1 -- 172.21.15.132:0/3908951983 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491119203 0 0) 0x7f4f480d0680 con 0x7f4f480d1980 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.955+0000 7f4f46ffd640 1 --2- 172.21.15.132:0/3908951983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 0x7f4f480b3560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4f380097a0 tx=0x7f4f3802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3635b573279f996 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.955+0000 7f4f45ffb640 1 -- 172.21.15.132:0/3908951983 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38030610 con 0x7f4f48161540 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.955+0000 7f4f45ffb640 1 -- 172.21.15.132:0/3908951983 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f38030770 con 0x7f4f48161540 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.955+0000 7f4f45ffb640 1 -- 172.21.15.132:0/3908951983 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38030b00 con 0x7f4f48161540 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.956+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/3908951983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 msgr2=0x7f4f480b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.956+0000 7f4f4d4b5640 1 --2- 172.21.15.132:0/3908951983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 0x7f4f480b3560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4f380097a0 tx=0x7f4f3802b960 comp rx=0 tx=0).stop 2024-03-16T17:47:52.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.956+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/3908951983 shutdown_connections 2024-03-16T17:47:52.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.956+0000 7f4f4d4b5640 1 --2- 172.21.15.132:0/3908951983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 0x7f4f480b3560 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.956+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/3908951983 >> 172.21.15.132:0/3908951983 conn(0x7f4f4809d120 msgr2=0x7f4f480d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:52.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.956+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/3908951983 shutdown_connections 2024-03-16T17:47:52.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.956+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/3908951983 wait complete. 2024-03-16T17:47:52.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.958+0000 7f4f4d4b5640 1 Processor -- start 2024-03-16T17:47:52.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.958+0000 7f4f4d4b5640 1 -- start start 2024-03-16T17:47:52.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f4d4b5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f480cf080 0x7f4f480b9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f4d4b5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f480d1980 0x7f4f480b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f4d4b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 0x7f4f480b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f4d4b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480b9420 con 0x7f4f48161540 2024-03-16T17:47:52.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f4d4b5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f481f3b30 con 0x7f4f480d1980 2024-03-16T17:47:52.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f4d4b5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480b77e0 con 0x7f4f480cf080 2024-03-16T17:47:52.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 0x7f4f480b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 0x7f4f480b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53544/0 (socket says 172.21.15.132:53544) 2024-03-16T17:47:52.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f477fe640 1 -- 172.21.15.132:0/484363250 learned_addr learned my addr 172.21.15.132:0/484363250 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f46ffd640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f480cf080 0x7f4f480b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f467fc640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f480d1980 0x7f4f480b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f477fe640 1 -- 172.21.15.132:0/484363250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f480cf080 msgr2=0x7f4f480b9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f477fe640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f480cf080 0x7f4f480b9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f477fe640 1 -- 172.21.15.132:0/484363250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f480d1980 msgr2=0x7f4f480b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f477fe640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f480d1980 0x7f4f480b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f477fe640 1 -- 172.21.15.132:0/484363250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38009400 con 0x7f4f48161540 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f477fe640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 0x7f4f480b1d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000c7a0 tx=0x7f4f4000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.959+0000 7f4f2f7fe640 1 -- 172.21.15.132:0/484363250 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4000a640 con 0x7f4f48161540 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.960+0000 7f4f2f7fe640 1 -- 172.21.15.132:0/484363250 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4000a7a0 con 0x7f4f48161540 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.960+0000 7f4f2f7fe640 1 -- 172.21.15.132:0/484363250 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4000ab90 con 0x7f4f48161540 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.960+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/484363250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f48157c10 con 0x7f4f48161540 2024-03-16T17:47:52.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.960+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/484363250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f480b8d60 con 0x7f4f48161540 2024-03-16T17:47:52.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.961+0000 7f4f2f7fe640 1 -- 172.21.15.132:0/484363250 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4f4000acf0 con 0x7f4f48161540 2024-03-16T17:47:52.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.961+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/484363250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f480b9560 con 0x7f4f48161540 2024-03-16T17:47:52.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.961+0000 7f4f2f7fe640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f3406b3b0 0x7f4f3406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:52.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.961+0000 7f4f2f7fe640 1 -- 172.21.15.132:0/484363250 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f40089430 con 0x7f4f48161540 2024-03-16T17:47:52.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.961+0000 7f4f46ffd640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f3406b3b0 0x7f4f3406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:52.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.962+0000 7f4f46ffd640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f3406b3b0 0x7f4f3406d870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f38036000 tx=0x7f4f3803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:52.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:52.970+0000 7f4f2f7fe640 1 -- 172.21.15.132:0/484363250 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4f40054090 con 0x7f4f48161540 2024-03-16T17:47:53.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.207+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/484363250 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f4804f2c0 con 0x7f4f48161540 2024-03-16T17:47:53.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.208+0000 7f4f2f7fe640 1 -- 172.21.15.132:0/484363250 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f4f4005ce60 con 0x7f4f48161540 2024-03-16T17:47:53.212 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:53.212 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:53.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/484363250 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f3406b3b0 msgr2=0x7f4f3406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f3406b3b0 0x7f4f3406d870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f38036000 tx=0x7f4f3803b040 comp rx=0 tx=0).stop 2024-03-16T17:47:53.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/484363250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 msgr2=0x7f4f480b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 0x7f4f480b1d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4f4000c7a0 tx=0x7f4f4000cc60 comp rx=0 tx=0).stop 2024-03-16T17:47:53.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/484363250 shutdown_connections 2024-03-16T17:47:53.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f3406b3b0 0x7f4f3406d870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f48161540 0x7f4f480b1d40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f480d1980 0x7f4f480b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 --2- 172.21.15.132:0/484363250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f480cf080 0x7f4f480b9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/484363250 >> 172.21.15.132:0/484363250 conn(0x7f4f4809d120 msgr2=0x7f4f480cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:53.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/484363250 shutdown_connections 2024-03-16T17:47:53.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.210+0000 7f4f4d4b5640 1 -- 172.21.15.132:0/484363250 wait complete. 2024-03-16T17:47:53.225 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T17:47:53.225 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T17:47:53.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.322+0000 7fb188cf4640 1 Processor -- start 2024-03-16T17:47:53.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.322+0000 7fb188cf4640 1 -- start start 2024-03-16T17:47:53.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb188cf4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb184161540 0x7fb1840b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb188cf4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1840d0680 con 0x7fb1840d1980 2024-03-16T17:47:53.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb188cf4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1840d08d0 con 0x7fb1840cf080 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb188cf4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1840b4f30 con 0x7fb184161540 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb182d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb1840d1980 0x7fb1840d1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49884/0 (socket says 172.21.15.132:49884) 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb182d9d640 1 -- 172.21.15.132:0/4045880966 learned_addr learned my addr 172.21.15.132:0/4045880966 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb18259c640 1 --2- 172.21.15.132:0/4045880966 >> v2:172.21.15.194:3300/0 conn(0x7fb184161540 0x7fb1840b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753058421 0 0) 0x7fb1840d0680 con 0x7fb1840d1980 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb170003520 con 0x7fb1840d1980 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2694238096 0 0) 0x7fb170003520 con 0x7fb1840d1980 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 >> v2:172.21.15.194:3300/0 conn(0x7fb184161540 msgr2=0x7fb1840b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.323+0000 7fb181d9b640 1 --2- 172.21.15.132:0/4045880966 >> v2:172.21.15.194:3300/0 conn(0x7fb184161540 0x7fb1840b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 >> v1:172.21.15.194:6789/0 conn(0x7fb1840cf080 legacy=0x7fb1840cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1840d0bb0 con 0x7fb1840d1980 2024-03-16T17:47:53.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb18259c640 1 --2- 172.21.15.132:0/4045880966 >> v2:172.21.15.194:3300/0 conn(0x7fb184161540 0x7fb1840b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7fb17c0019f0 con 0x7fb1840d1980 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 >> v1:172.21.15.132:6789/0 conn(0x7fb1840d1980 legacy=0x7fb1840d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb181d9b640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb170003970 0x7fb170003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb181d9b640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb170004370 0x7fb170004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb181d9b640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb170005040 0x7fb17000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1840b4f30 con 0x7fb170003970 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17000bfa0 con 0x7fb170005040 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17000c160 con 0x7fb170004370 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb18259c640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb170003970 0x7fb170003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb182d9d640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb170005040 0x7fb17000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb17bfff640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb170004370 0x7fb170004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb18259c640 1 -- 172.21.15.132:0/4045880966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb170004370 msgr2=0x7fb170004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb18259c640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb170004370 0x7fb170004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb18259c640 1 -- 172.21.15.132:0/4045880966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb170005040 msgr2=0x7fb17000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb18259c640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb170005040 0x7fb17000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb18259c640 1 -- 172.21.15.132:0/4045880966 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170003520 con 0x7fb170003970 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb182d9d640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb170005040 0x7fb17000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb17bfff640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb170004370 0x7fb170004840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.324+0000 7fb182d9d640 1 -- 172.21.15.132:0/4045880966 reap_dead start 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.325+0000 7fb18259c640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb170003970 0x7fb170003d50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb174009c90 tx=0x7fb1700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7c556539a50862 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.325+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17402c8f0 con 0x7fb170003970 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.325+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17402ca50 con 0x7fb170003970 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.325+0000 7fb181d9b640 1 -- 172.21.15.132:0/4045880966 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17402ce40 con 0x7fb170003970 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.325+0000 7fb188cf4640 1 -- 172.21.15.132:0/4045880966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb170003970 msgr2=0x7fb170003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.325+0000 7fb188cf4640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb170003970 0x7fb170003d50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb174009c90 tx=0x7fb1700057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.325+0000 7fb188cf4640 1 -- 172.21.15.132:0/4045880966 shutdown_connections 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.325+0000 7fb188cf4640 1 --2- 172.21.15.132:0/4045880966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb170003970 0x7fb170003d50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.325+0000 7fb188cf4640 1 -- 172.21.15.132:0/4045880966 >> 172.21.15.132:0/4045880966 conn(0x7fb18409d120 msgr2=0x7fb1840d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:53.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.326+0000 7fb188cf4640 1 -- 172.21.15.132:0/4045880966 shutdown_connections 2024-03-16T17:47:53.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.326+0000 7fb188cf4640 1 -- 172.21.15.132:0/4045880966 wait complete. 2024-03-16T17:47:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.327+0000 7fb188cf4640 1 Processor -- start 2024-03-16T17:47:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.327+0000 7fb188cf4640 1 -- start start 2024-03-16T17:47:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.327+0000 7fb188cf4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb170003970 0x7fb1841586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.327+0000 7fb188cf4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1841593c0 0x7fb1840d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb188cf4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb184158e70 0x7fb1840d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb188cf4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1840b7f70 con 0x7fb184158e70 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb188cf4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1840b73f0 con 0x7fb1841593c0 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb188cf4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1840b76d0 con 0x7fb170003970 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb182d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb184158e70 0x7fb1840d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb182d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb184158e70 0x7fb1840d22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53560/0 (socket says 172.21.15.132:53560) 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb182d9d640 1 -- 172.21.15.132:0/2885252396 learned_addr learned my addr 172.21.15.132:0/2885252396 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb18259c640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb170003970 0x7fb1841586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb17bfff640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1841593c0 0x7fb1840d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb182d9d640 1 -- 172.21.15.132:0/2885252396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb170003970 msgr2=0x7fb1841586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb182d9d640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb170003970 0x7fb1841586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb182d9d640 1 -- 172.21.15.132:0/2885252396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1841593c0 msgr2=0x7fb1840d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb182d9d640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1841593c0 0x7fb1840d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb182d9d640 1 -- 172.21.15.132:0/2885252396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1840b79b0 con 0x7fb184158e70 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb182d9d640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb184158e70 0x7fb1840d22d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1840c7550 tx=0x7fb17c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb17affd640 1 -- 172.21.15.132:0/2885252396 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00eb90 con 0x7fb184158e70 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb17affd640 1 -- 172.21.15.132:0/2885252396 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c00ed10 con 0x7fb184158e70 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb188cf4640 1 -- 172.21.15.132:0/2885252396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1840b7c90 con 0x7fb184158e70 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb17affd640 1 -- 172.21.15.132:0/2885252396 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c013660 con 0x7fb184158e70 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.328+0000 7fb188cf4640 1 -- 172.21.15.132:0/2885252396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb184159ad0 con 0x7fb184158e70 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.329+0000 7fb188cf4640 1 -- 172.21.15.132:0/2885252396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18415d090 con 0x7fb184158e70 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.330+0000 7fb17affd640 1 -- 172.21.15.132:0/2885252396 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb17c0137c0 con 0x7fb184158e70 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.331+0000 7fb17affd640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb16406b3e0 0x7fb16406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.331+0000 7fb18259c640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb16406b3e0 0x7fb16406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.331+0000 7fb17affd640 1 -- 172.21.15.132:0/2885252396 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb17c089f90 con 0x7fb184158e70 2024-03-16T17:47:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.331+0000 7fb18259c640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb16406b3e0 0x7fb16406d8a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb174036000 tx=0x7fb174030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.339+0000 7fb17affd640 1 -- 172.21.15.132:0/2885252396 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb18415d090 con 0x7fb184158e70 2024-03-16T17:47:53.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.513+0000 7fb188cf4640 1 -- 172.21.15.132:0/2885252396 --> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1840b2990 con 0x7fb16406b3e0 2024-03-16T17:47:53.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.519+0000 7fb17affd640 1 -- 172.21.15.132:0/2885252396 <== mgr.4107 v2:172.21.15.132:6832/2724898791 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237079 (secure 0 0 0) 0x7fb1840b2990 con 0x7fb16406b3e0 2024-03-16T17:47:53.525 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:53.526 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-03-16T17:47:53.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 -- 172.21.15.132:0/2885252396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb16406b3e0 msgr2=0x7fb16406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb16406b3e0 0x7fb16406d8a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb174036000 tx=0x7fb174030000 comp rx=0 tx=0).stop 2024-03-16T17:47:53.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 -- 172.21.15.132:0/2885252396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb184158e70 msgr2=0x7fb1840d22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb184158e70 0x7fb1840d22d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1840c7550 tx=0x7fb17c00e530 comp rx=0 tx=0).stop 2024-03-16T17:47:53.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 -- 172.21.15.132:0/2885252396 shutdown_connections 2024-03-16T17:47:53.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb16406b3e0 0x7fb16406d8a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb184158e70 0x7fb1840d22d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1841593c0 0x7fb1840d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 --2- 172.21.15.132:0/2885252396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb170003970 0x7fb1841586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 -- 172.21.15.132:0/2885252396 >> 172.21.15.132:0/2885252396 conn(0x7fb18409d120 msgr2=0x7fb18406c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:53.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 -- 172.21.15.132:0/2885252396 shutdown_connections 2024-03-16T17:47:53.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.522+0000 7fb188cf4640 1 -- 172.21.15.132:0/2885252396 wait complete. 2024-03-16T17:47:53.540 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-16T17:47:51.844251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219740,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754980,"statfs":{"total":773094113280,"available":772869099520,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12753,"internal_metadata":221236783},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000760"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-16T17:47:40.446705+0000","last_change":"2024-03-16T17:47:39.177353+0000","last_active":"2024-03-16T17:47:40.446705+0000","last_peered":"2024-03-16T17:47:40.446705+0000","last_clean":"2024-03-16T17:47:40.446705+0000","last_became_active":"2024-03-16T17:47:39.176109+0000","last_became_peered":"2024-03-16T17:47:39.176109+0000","last_unstale":"2024-03-16T17:47:40.446705+0000","last_undegraded":"2024-03-16T17:47:40.446705+0000","last_fullsized":"2024-03-16T17:47:40.446705+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_clean_scrub_stamp":"2024-03-16T17:47:37.885590+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:47.704856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:49.460953+0000","last_change":"2024-03-16T17:47:49.460953+0000","last_active":"2024-03-16T17:47:49.460953+0000","last_peered":"2024-03-16T17:47:49.460953+0000","last_clean":"2024-03-16T17:47:49.460953+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:49.460953+0000","last_undegraded":"2024-03-16T17:47:49.460953+0000","last_fullsized":"2024-03-16T17:47:49.460953+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-16T17:47:48.456025+0000","last_change":"2024-03-16T17:47:48.456025+0000","last_active":"2024-03-16T17:47:48.456025+0000","last_peered":"2024-03-16T17:47:48.456025+0000","last_clean":"2024-03-16T17:47:48.456025+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-16T17:47:48.456025+0000","last_undegraded":"2024-03-16T17:47:48.456025+0000","last_fullsized":"2024-03-16T17:47:48.456025+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28376,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343464,"statfs":{"total":96636764160,"available":96607707136,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T17:47:53.544 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T17:47:53.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.676+0000 7fc8bb22e640 1 Processor -- start 2024-03-16T17:47:53.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.676+0000 7fc8bb22e640 1 -- start start 2024-03-16T17:47:53.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.677+0000 7fc8bb22e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8b40b3560 0x7fc8b40cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.677+0000 7fc8bb22e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8b40d1980 0x7fc8b40d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.677+0000 7fc8bb22e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b40d0680 con 0x7fc8b4161540 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.677+0000 7fc8bb22e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b40b4f30 con 0x7fc8b40d1980 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.677+0000 7fc8bb22e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b40d08d0 con 0x7fc8b40b3560 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.677+0000 7fc8b97cb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8b40d1980 0x7fc8b40d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.677+0000 7fc8b97cb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8b40d1980 0x7fc8b40d1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53572/0 (socket says 172.21.15.132:53572) 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.677+0000 7fc8b8fca640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc8b4161540 0x7fc8b40cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49892/0 (socket says 172.21.15.132:49892) 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.677+0000 7fc8b97cb640 1 -- 172.21.15.132:0/819936471 learned_addr learned my addr 172.21.15.132:0/819936471 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.677+0000 7fc8b3fff640 1 --2- 172.21.15.132:0/819936471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8b40b3560 0x7fc8b40cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.678+0000 7fc8b97cb640 1 -- 172.21.15.132:0/819936471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8b40b3560 msgr2=0x7fc8b40cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.678+0000 7fc8b97cb640 1 --2- 172.21.15.132:0/819936471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8b40b3560 0x7fc8b40cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.678+0000 7fc8b97cb640 1 -- 172.21.15.132:0/819936471 >> v1:172.21.15.132:6789/0 conn(0x7fc8b4161540 legacy=0x7fc8b40cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.678+0000 7fc8b97cb640 1 -- 172.21.15.132:0/819936471 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b40d0bb0 con 0x7fc8b40d1980 2024-03-16T17:47:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.678+0000 7fc8b97cb640 1 --2- 172.21.15.132:0/819936471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b40d1980 0x7fc8b40d1df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009e50 tx=0x7fc8ac02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3b9c7c60515c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.678+0000 7fc8b37fe640 1 -- 172.21.15.132:0/819936471 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac02cb00 con 0x7fc8b40d1980 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.678+0000 7fc8b37fe640 1 -- 172.21.15.132:0/819936471 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac02cc60 con 0x7fc8b40d1980 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.678+0000 7fc8b37fe640 1 -- 172.21.15.132:0/819936471 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac0343f0 con 0x7fc8b40d1980 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.679+0000 7fc8bb22e640 1 -- 172.21.15.132:0/819936471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b40d1980 msgr2=0x7fc8b40d1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.679+0000 7fc8bb22e640 1 --2- 172.21.15.132:0/819936471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b40d1980 0x7fc8b40d1df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009e50 tx=0x7fc8ac02bf60 comp rx=0 tx=0).stop 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.679+0000 7fc8bb22e640 1 -- 172.21.15.132:0/819936471 shutdown_connections 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.679+0000 7fc8bb22e640 1 --2- 172.21.15.132:0/819936471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b40d1980 0x7fc8b40d1df0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.679+0000 7fc8bb22e640 1 --2- 172.21.15.132:0/819936471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8b40b3560 0x7fc8b40cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.679+0000 7fc8bb22e640 1 -- 172.21.15.132:0/819936471 >> 172.21.15.132:0/819936471 conn(0x7fc8b409d120 msgr2=0x7fc8b40d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.679+0000 7fc8bb22e640 1 -- 172.21.15.132:0/819936471 shutdown_connections 2024-03-16T17:47:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.679+0000 7fc8bb22e640 1 -- 172.21.15.132:0/819936471 wait complete. 2024-03-16T17:47:53.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.680+0000 7fc8bb22e640 1 Processor -- start 2024-03-16T17:47:53.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.680+0000 7fc8bb22e640 1 -- start start 2024-03-16T17:47:53.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8bb22e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8b40b3560 0x7fc8b40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8bb22e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8b40d1980 0x7fc8b40cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8bb22e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4161540 0x7fc8b40b9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8bb22e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b40b99a0 con 0x7fc8b4161540 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8bb22e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b40cc170 con 0x7fc8b40b3560 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8bb22e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b40cb560 con 0x7fc8b40d1980 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8b97cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4161540 0x7fc8b40b9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8b97cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4161540 0x7fc8b40b9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53580/0 (socket says 172.21.15.132:53580) 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8b97cb640 1 -- 172.21.15.132:0/2324860544 learned_addr learned my addr 172.21.15.132:0/2324860544 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8b8fca640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8b40b3560 0x7fc8b40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8b3fff640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8b40d1980 0x7fc8b40cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8b97cb640 1 -- 172.21.15.132:0/2324860544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8b40d1980 msgr2=0x7fc8b40cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8b97cb640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8b40d1980 0x7fc8b40cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8b97cb640 1 -- 172.21.15.132:0/2324860544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8b40b3560 msgr2=0x7fc8b40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8b97cb640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8b40b3560 0x7fc8b40cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.681+0000 7fc8b97cb640 1 -- 172.21.15.132:0/2324860544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009b30 con 0x7fc8b4161540 2024-03-16T17:47:53.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.682+0000 7fc8b97cb640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4161540 0x7fc8b40b9460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009e50 tx=0x7fc8ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:53.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.682+0000 7fc8b17fa640 1 -- 172.21.15.132:0/2324860544 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac009510 con 0x7fc8b4161540 2024-03-16T17:47:53.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.682+0000 7fc8b17fa640 1 -- 172.21.15.132:0/2324860544 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac03e450 con 0x7fc8b4161540 2024-03-16T17:47:53.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.682+0000 7fc8bb22e640 1 -- 172.21.15.132:0/2324860544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b40cb840 con 0x7fc8b4161540 2024-03-16T17:47:53.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.682+0000 7fc8b17fa640 1 -- 172.21.15.132:0/2324860544 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac03e800 con 0x7fc8b4161540 2024-03-16T17:47:53.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.682+0000 7fc8bb22e640 1 -- 172.21.15.132:0/2324860544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b40cbe00 con 0x7fc8b4161540 2024-03-16T17:47:53.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.683+0000 7fc8bb22e640 1 -- 172.21.15.132:0/2324860544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b40cc300 con 0x7fc8b4161540 2024-03-16T17:47:53.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.683+0000 7fc8b17fa640 1 -- 172.21.15.132:0/2324860544 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fc8ac03e960 con 0x7fc8b4161540 2024-03-16T17:47:53.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.684+0000 7fc8b17fa640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc89406b3e0 0x7fc89406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:53.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.684+0000 7fc8b8fca640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc89406b3e0 0x7fc89406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:53.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.684+0000 7fc8b17fa640 1 -- 172.21.15.132:0/2324860544 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8ac0ac930 con 0x7fc8b4161540 2024-03-16T17:47:53.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.684+0000 7fc8b8fca640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc89406b3e0 0x7fc89406d8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc89c000f60 tx=0x7fc89c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:53.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.688+0000 7fc8b17fa640 1 -- 172.21.15.132:0/2324860544 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc8ac077590 con 0x7fc8b4161540 2024-03-16T17:47:53.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.862+0000 7fc8bb22e640 1 -- 172.21.15.132:0/2324860544 --> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8b40ceb60 con 0x7fc89406b3e0 2024-03-16T17:47:53.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.868+0000 7fc8b17fa640 1 -- 172.21.15.132:0/2324860544 <== mgr.4107 v2:172.21.15.132:6832/2724898791 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251942 (secure 0 0 0) 0x7fc89c0012f0 con 0x7fc89406b3e0 2024-03-16T17:47:53.874 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:53.875 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-03-16T17:47:53.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 -- 172.21.15.132:0/2324860544 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc89406b3e0 msgr2=0x7fc89406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc89406b3e0 0x7fc89406d8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc89c000f60 tx=0x7fc89c009040 comp rx=0 tx=0).stop 2024-03-16T17:47:53.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 -- 172.21.15.132:0/2324860544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4161540 msgr2=0x7fc8b40b9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:53.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4161540 0x7fc8b40b9460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009e50 tx=0x7fc8ac004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:53.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 -- 172.21.15.132:0/2324860544 shutdown_connections 2024-03-16T17:47:53.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc89406b3e0 0x7fc89406d8a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4161540 0x7fc8b40b9460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8b40d1980 0x7fc8b40cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 --2- 172.21.15.132:0/2324860544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8b40b3560 0x7fc8b40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:53.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 -- 172.21.15.132:0/2324860544 >> 172.21.15.132:0/2324860544 conn(0x7fc8b409d120 msgr2=0x7fc8b40b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:53.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 -- 172.21.15.132:0/2324860544 shutdown_connections 2024-03-16T17:47:53.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:53.871+0000 7fc8bb22e640 1 -- 172.21.15.132:0/2324860544 wait complete. 2024-03-16T17:47:53.885 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-16T17:47:53.844623+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218944,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755776,"statfs":{"total":773094113280,"available":772869914624,"internally_reserved":0,"allocated":2830336,"data_stored":1721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12753,"internal_metadata":221236783},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.383295"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521964+0000","last_change":"2024-03-16T17:47:50.495081+0000","last_active":"2024-03-16T17:47:52.521964+0000","last_peered":"2024-03-16T17:47:52.521964+0000","last_clean":"2024-03-16T17:47:52.521964+0000","last_became_active":"2024-03-16T17:47:50.494717+0000","last_became_peered":"2024-03-16T17:47:50.494717+0000","last_unstale":"2024-03-16T17:47:52.521964+0000","last_undegraded":"2024-03-16T17:47:52.521964+0000","last_fullsized":"2024-03-16T17:47:52.521964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:04:30.010877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494900+0000","last_change":"2024-03-16T17:47:50.491581+0000","last_active":"2024-03-16T17:47:51.494900+0000","last_peered":"2024-03-16T17:47:51.494900+0000","last_clean":"2024-03-16T17:47:51.494900+0000","last_became_active":"2024-03-16T17:47:50.491333+0000","last_became_peered":"2024-03-16T17:47:50.491333+0000","last_unstale":"2024-03-16T17:47:51.494900+0000","last_undegraded":"2024-03-16T17:47:51.494900+0000","last_fullsized":"2024-03-16T17:47:51.494900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521308+0000","last_change":"2024-03-16T17:47:50.492368+0000","last_active":"2024-03-16T17:47:52.521308+0000","last_peered":"2024-03-16T17:47:52.521308+0000","last_clean":"2024-03-16T17:47:52.521308+0000","last_became_active":"2024-03-16T17:47:50.492083+0000","last_became_peered":"2024-03-16T17:47:50.492083+0000","last_unstale":"2024-03-16T17:47:52.521308+0000","last_undegraded":"2024-03-16T17:47:52.521308+0000","last_fullsized":"2024-03-16T17:47:52.521308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:58:26.517921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500483+0000","last_change":"2024-03-16T17:47:50.494809+0000","last_active":"2024-03-16T17:47:51.500483+0000","last_peered":"2024-03-16T17:47:51.500483+0000","last_clean":"2024-03-16T17:47:51.500483+0000","last_became_active":"2024-03-16T17:47:50.494538+0000","last_became_peered":"2024-03-16T17:47:50.494538+0000","last_unstale":"2024-03-16T17:47:51.500483+0000","last_undegraded":"2024-03-16T17:47:51.500483+0000","last_fullsized":"2024-03-16T17:47:51.500483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:11.212917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521509+0000","last_change":"2024-03-16T17:47:50.493953+0000","last_active":"2024-03-16T17:47:52.521509+0000","last_peered":"2024-03-16T17:47:52.521509+0000","last_clean":"2024-03-16T17:47:52.521509+0000","last_became_active":"2024-03-16T17:47:50.493629+0000","last_became_peered":"2024-03-16T17:47:50.493629+0000","last_unstale":"2024-03-16T17:47:52.521509+0000","last_undegraded":"2024-03-16T17:47:52.521509+0000","last_fullsized":"2024-03-16T17:47:52.521509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:41:17.182744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500785+0000","last_change":"2024-03-16T17:47:50.495431+0000","last_active":"2024-03-16T17:47:51.500785+0000","last_peered":"2024-03-16T17:47:51.500785+0000","last_clean":"2024-03-16T17:47:51.500785+0000","last_became_active":"2024-03-16T17:47:50.492556+0000","last_became_peered":"2024-03-16T17:47:50.492556+0000","last_unstale":"2024-03-16T17:47:51.500785+0000","last_undegraded":"2024-03-16T17:47:51.500785+0000","last_fullsized":"2024-03-16T17:47:51.500785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:41:17.182744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521080+0000","last_change":"2024-03-16T17:47:50.505084+0000","last_active":"2024-03-16T17:47:52.521080+0000","last_peered":"2024-03-16T17:47:52.521080+0000","last_clean":"2024-03-16T17:47:52.521080+0000","last_became_active":"2024-03-16T17:47:50.504788+0000","last_became_peered":"2024-03-16T17:47:50.504788+0000","last_unstale":"2024-03-16T17:47:52.521080+0000","last_undegraded":"2024-03-16T17:47:52.521080+0000","last_fullsized":"2024-03-16T17:47:52.521080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:57:07.363497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520574+0000","last_change":"2024-03-16T17:47:50.499062+0000","last_active":"2024-03-16T17:47:52.520574+0000","last_peered":"2024-03-16T17:47:52.520574+0000","last_clean":"2024-03-16T17:47:52.520574+0000","last_became_active":"2024-03-16T17:47:50.498783+0000","last_became_peered":"2024-03-16T17:47:50.498783+0000","last_unstale":"2024-03-16T17:47:52.520574+0000","last_undegraded":"2024-03-16T17:47:52.520574+0000","last_fullsized":"2024-03-16T17:47:52.520574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:58:26.517921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521968+0000","last_change":"2024-03-16T17:47:50.502669+0000","last_active":"2024-03-16T17:47:52.521968+0000","last_peered":"2024-03-16T17:47:52.521968+0000","last_clean":"2024-03-16T17:47:52.521968+0000","last_became_active":"2024-03-16T17:47:50.501969+0000","last_became_peered":"2024-03-16T17:47:50.501969+0000","last_unstale":"2024-03-16T17:47:52.521968+0000","last_undegraded":"2024-03-16T17:47:52.521968+0000","last_fullsized":"2024-03-16T17:47:52.521968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:45:04.415199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499708+0000","last_change":"2024-03-16T17:47:50.493316+0000","last_active":"2024-03-16T17:47:51.499708+0000","last_peered":"2024-03-16T17:47:51.499708+0000","last_clean":"2024-03-16T17:47:51.499708+0000","last_became_active":"2024-03-16T17:47:50.493053+0000","last_became_peered":"2024-03-16T17:47:50.493053+0000","last_unstale":"2024-03-16T17:47:51.499708+0000","last_undegraded":"2024-03-16T17:47:51.499708+0000","last_fullsized":"2024-03-16T17:47:51.499708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499549+0000","last_change":"2024-03-16T17:47:50.492718+0000","last_active":"2024-03-16T17:47:51.499549+0000","last_peered":"2024-03-16T17:47:51.499549+0000","last_clean":"2024-03-16T17:47:51.499549+0000","last_became_active":"2024-03-16T17:47:50.492439+0000","last_became_peered":"2024-03-16T17:47:50.492439+0000","last_unstale":"2024-03-16T17:47:51.499549+0000","last_undegraded":"2024-03-16T17:47:51.499549+0000","last_fullsized":"2024-03-16T17:47:51.499549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521619+0000","last_change":"2024-03-16T17:47:50.490986+0000","last_active":"2024-03-16T17:47:52.521619+0000","last_peered":"2024-03-16T17:47:52.521619+0000","last_clean":"2024-03-16T17:47:52.521619+0000","last_became_active":"2024-03-16T17:47:50.490454+0000","last_became_peered":"2024-03-16T17:47:50.490454+0000","last_unstale":"2024-03-16T17:47:52.521619+0000","last_undegraded":"2024-03-16T17:47:52.521619+0000","last_fullsized":"2024-03-16T17:47:52.521619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:44.623412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521178+0000","last_change":"2024-03-16T17:47:50.497782+0000","last_active":"2024-03-16T17:47:52.521178+0000","last_peered":"2024-03-16T17:47:52.521178+0000","last_clean":"2024-03-16T17:47:52.521178+0000","last_became_active":"2024-03-16T17:47:50.497502+0000","last_became_peered":"2024-03-16T17:47:50.497502+0000","last_unstale":"2024-03-16T17:47:52.521178+0000","last_undegraded":"2024-03-16T17:47:52.521178+0000","last_fullsized":"2024-03-16T17:47:52.521178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:39:30.261042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521420+0000","last_change":"2024-03-16T17:47:50.487780+0000","last_active":"2024-03-16T17:47:52.521420+0000","last_peered":"2024-03-16T17:47:52.521420+0000","last_clean":"2024-03-16T17:47:52.521420+0000","last_became_active":"2024-03-16T17:47:50.487531+0000","last_became_peered":"2024-03-16T17:47:50.487531+0000","last_unstale":"2024-03-16T17:47:52.521420+0000","last_undegraded":"2024-03-16T17:47:52.521420+0000","last_fullsized":"2024-03-16T17:47:52.521420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494597+0000","last_change":"2024-03-16T17:47:50.489383+0000","last_active":"2024-03-16T17:47:51.494597+0000","last_peered":"2024-03-16T17:47:51.494597+0000","last_clean":"2024-03-16T17:47:51.494597+0000","last_became_active":"2024-03-16T17:47:50.489069+0000","last_became_peered":"2024-03-16T17:47:50.489069+0000","last_unstale":"2024-03-16T17:47:51.494597+0000","last_undegraded":"2024-03-16T17:47:51.494597+0000","last_fullsized":"2024-03-16T17:47:51.494597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500491+0000","last_change":"2024-03-16T17:47:50.496049+0000","last_active":"2024-03-16T17:47:51.500491+0000","last_peered":"2024-03-16T17:47:51.500491+0000","last_clean":"2024-03-16T17:47:51.500491+0000","last_became_active":"2024-03-16T17:47:50.495736+0000","last_became_peered":"2024-03-16T17:47:50.495736+0000","last_unstale":"2024-03-16T17:47:51.500491+0000","last_undegraded":"2024-03-16T17:47:51.500491+0000","last_fullsized":"2024-03-16T17:47:51.500491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501076+0000","last_change":"2024-03-16T17:47:50.497692+0000","last_active":"2024-03-16T17:47:51.501076+0000","last_peered":"2024-03-16T17:47:51.501076+0000","last_clean":"2024-03-16T17:47:51.501076+0000","last_became_active":"2024-03-16T17:47:50.497133+0000","last_became_peered":"2024-03-16T17:47:50.497133+0000","last_unstale":"2024-03-16T17:47:51.501076+0000","last_undegraded":"2024-03-16T17:47:51.501076+0000","last_fullsized":"2024-03-16T17:47:51.501076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:14:09.646659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522205+0000","last_change":"2024-03-16T17:47:50.490816+0000","last_active":"2024-03-16T17:47:52.522205+0000","last_peered":"2024-03-16T17:47:52.522205+0000","last_clean":"2024-03-16T17:47:52.522205+0000","last_became_active":"2024-03-16T17:47:50.490521+0000","last_became_peered":"2024-03-16T17:47:50.490521+0000","last_unstale":"2024-03-16T17:47:52.522205+0000","last_undegraded":"2024-03-16T17:47:52.522205+0000","last_fullsized":"2024-03-16T17:47:52.522205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:44.623412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521893+0000","last_change":"2024-03-16T17:47:50.495340+0000","last_active":"2024-03-16T17:47:52.521893+0000","last_peered":"2024-03-16T17:47:52.521893+0000","last_clean":"2024-03-16T17:47:52.521893+0000","last_became_active":"2024-03-16T17:47:50.495069+0000","last_became_peered":"2024-03-16T17:47:50.495069+0000","last_unstale":"2024-03-16T17:47:52.521893+0000","last_undegraded":"2024-03-16T17:47:52.521893+0000","last_fullsized":"2024-03-16T17:47:52.521893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:40:23.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499593+0000","last_change":"2024-03-16T17:47:50.491366+0000","last_active":"2024-03-16T17:47:51.499593+0000","last_peered":"2024-03-16T17:47:51.499593+0000","last_clean":"2024-03-16T17:47:51.499593+0000","last_became_active":"2024-03-16T17:47:50.491097+0000","last_became_peered":"2024-03-16T17:47:50.491097+0000","last_unstale":"2024-03-16T17:47:51.499593+0000","last_undegraded":"2024-03-16T17:47:51.499593+0000","last_fullsized":"2024-03-16T17:47:51.499593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521572+0000","last_change":"2024-03-16T17:47:50.496801+0000","last_active":"2024-03-16T17:47:52.521572+0000","last_peered":"2024-03-16T17:47:52.521572+0000","last_clean":"2024-03-16T17:47:52.521572+0000","last_became_active":"2024-03-16T17:47:50.496475+0000","last_became_peered":"2024-03-16T17:47:50.496475+0000","last_unstale":"2024-03-16T17:47:52.521572+0000","last_undegraded":"2024-03-16T17:47:52.521572+0000","last_fullsized":"2024-03-16T17:47:52.521572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500611+0000","last_change":"2024-03-16T17:47:50.497501+0000","last_active":"2024-03-16T17:47:51.500611+0000","last_peered":"2024-03-16T17:47:51.500611+0000","last_clean":"2024-03-16T17:47:51.500611+0000","last_became_active":"2024-03-16T17:47:50.497232+0000","last_became_peered":"2024-03-16T17:47:50.497232+0000","last_unstale":"2024-03-16T17:47:51.500611+0000","last_undegraded":"2024-03-16T17:47:51.500611+0000","last_fullsized":"2024-03-16T17:47:51.500611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:43.769763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520575+0000","last_change":"2024-03-16T17:47:50.500668+0000","last_active":"2024-03-16T17:47:52.520575+0000","last_peered":"2024-03-16T17:47:52.520575+0000","last_clean":"2024-03-16T17:47:52.520575+0000","last_became_active":"2024-03-16T17:47:50.500420+0000","last_became_peered":"2024-03-16T17:47:50.500420+0000","last_unstale":"2024-03-16T17:47:52.520575+0000","last_undegraded":"2024-03-16T17:47:52.520575+0000","last_fullsized":"2024-03-16T17:47:52.520575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500398+0000","last_change":"2024-03-16T17:47:50.494033+0000","last_active":"2024-03-16T17:47:51.500398+0000","last_peered":"2024-03-16T17:47:51.500398+0000","last_clean":"2024-03-16T17:47:51.500398+0000","last_became_active":"2024-03-16T17:47:50.493181+0000","last_became_peered":"2024-03-16T17:47:50.493181+0000","last_unstale":"2024-03-16T17:47:51.500398+0000","last_undegraded":"2024-03-16T17:47:51.500398+0000","last_fullsized":"2024-03-16T17:47:51.500398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521102+0000","last_change":"2024-03-16T17:47:50.501551+0000","last_active":"2024-03-16T17:47:52.521102+0000","last_peered":"2024-03-16T17:47:52.521102+0000","last_clean":"2024-03-16T17:47:52.521102+0000","last_became_active":"2024-03-16T17:47:50.500985+0000","last_became_peered":"2024-03-16T17:47:50.500985+0000","last_unstale":"2024-03-16T17:47:52.521102+0000","last_undegraded":"2024-03-16T17:47:52.521102+0000","last_fullsized":"2024-03-16T17:47:52.521102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:11.212917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499729+0000","last_change":"2024-03-16T17:47:50.494874+0000","last_active":"2024-03-16T17:47:51.499729+0000","last_peered":"2024-03-16T17:47:51.499729+0000","last_clean":"2024-03-16T17:47:51.499729+0000","last_became_active":"2024-03-16T17:47:50.494624+0000","last_became_peered":"2024-03-16T17:47:50.494624+0000","last_unstale":"2024-03-16T17:47:51.499729+0000","last_undegraded":"2024-03-16T17:47:51.499729+0000","last_fullsized":"2024-03-16T17:47:51.499729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494828+0000","last_change":"2024-03-16T17:47:50.495096+0000","last_active":"2024-03-16T17:47:51.494828+0000","last_peered":"2024-03-16T17:47:51.494828+0000","last_clean":"2024-03-16T17:47:51.494828+0000","last_became_active":"2024-03-16T17:47:50.494845+0000","last_became_peered":"2024-03-16T17:47:50.494845+0000","last_unstale":"2024-03-16T17:47:51.494828+0000","last_undegraded":"2024-03-16T17:47:51.494828+0000","last_fullsized":"2024-03-16T17:47:51.494828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521090+0000","last_change":"2024-03-16T17:47:50.496454+0000","last_active":"2024-03-16T17:47:52.521090+0000","last_peered":"2024-03-16T17:47:52.521090+0000","last_clean":"2024-03-16T17:47:52.521090+0000","last_became_active":"2024-03-16T17:47:50.496216+0000","last_became_peered":"2024-03-16T17:47:50.496216+0000","last_unstale":"2024-03-16T17:47:52.521090+0000","last_undegraded":"2024-03-16T17:47:52.521090+0000","last_fullsized":"2024-03-16T17:47:52.521090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521655+0000","last_change":"2024-03-16T17:47:50.493770+0000","last_active":"2024-03-16T17:47:52.521655+0000","last_peered":"2024-03-16T17:47:52.521655+0000","last_clean":"2024-03-16T17:47:52.521655+0000","last_became_active":"2024-03-16T17:47:50.493371+0000","last_became_peered":"2024-03-16T17:47:50.493371+0000","last_unstale":"2024-03-16T17:47:52.521655+0000","last_undegraded":"2024-03-16T17:47:52.521655+0000","last_fullsized":"2024-03-16T17:47:52.521655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500983+0000","last_change":"2024-03-16T17:47:50.493391+0000","last_active":"2024-03-16T17:47:51.500983+0000","last_peered":"2024-03-16T17:47:51.500983+0000","last_clean":"2024-03-16T17:47:51.500983+0000","last_became_active":"2024-03-16T17:47:50.493125+0000","last_became_peered":"2024-03-16T17:47:50.493125+0000","last_unstale":"2024-03-16T17:47:51.500983+0000","last_undegraded":"2024-03-16T17:47:51.500983+0000","last_fullsized":"2024-03-16T17:47:51.500983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:45.171163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522135+0000","last_change":"2024-03-16T17:47:50.492316+0000","last_active":"2024-03-16T17:47:52.522135+0000","last_peered":"2024-03-16T17:47:52.522135+0000","last_clean":"2024-03-16T17:47:52.522135+0000","last_became_active":"2024-03-16T17:47:50.492048+0000","last_became_peered":"2024-03-16T17:47:50.492048+0000","last_unstale":"2024-03-16T17:47:52.522135+0000","last_undegraded":"2024-03-16T17:47:52.522135+0000","last_fullsized":"2024-03-16T17:47:52.522135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:13.979638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499284+0000","last_change":"2024-03-16T17:47:50.500770+0000","last_active":"2024-03-16T17:47:51.499284+0000","last_peered":"2024-03-16T17:47:51.499284+0000","last_clean":"2024-03-16T17:47:51.499284+0000","last_became_active":"2024-03-16T17:47:50.500482+0000","last_became_peered":"2024-03-16T17:47:50.500482+0000","last_unstale":"2024-03-16T17:47:51.499284+0000","last_undegraded":"2024-03-16T17:47:51.499284+0000","last_fullsized":"2024-03-16T17:47:51.499284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521043+0000","last_change":"2024-03-16T17:47:50.489102+0000","last_active":"2024-03-16T17:47:52.521043+0000","last_peered":"2024-03-16T17:47:52.521043+0000","last_clean":"2024-03-16T17:47:52.521043+0000","last_became_active":"2024-03-16T17:47:50.488757+0000","last_became_peered":"2024-03-16T17:47:50.488757+0000","last_unstale":"2024-03-16T17:47:52.521043+0000","last_undegraded":"2024-03-16T17:47:52.521043+0000","last_fullsized":"2024-03-16T17:47:52.521043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:53.335867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521375+0000","last_change":"2024-03-16T17:47:49.484094+0000","last_active":"2024-03-16T17:47:52.521375+0000","last_peered":"2024-03-16T17:47:52.521375+0000","last_clean":"2024-03-16T17:47:52.521375+0000","last_became_active":"2024-03-16T17:47:49.483835+0000","last_became_peered":"2024-03-16T17:47:49.483835+0000","last_unstale":"2024-03-16T17:47:52.521375+0000","last_undegraded":"2024-03-16T17:47:52.521375+0000","last_fullsized":"2024-03-16T17:47:52.521375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521642+0000","last_change":"2024-03-16T17:47:50.492375+0000","last_active":"2024-03-16T17:47:52.521642+0000","last_peered":"2024-03-16T17:47:52.521642+0000","last_clean":"2024-03-16T17:47:52.521642+0000","last_became_active":"2024-03-16T17:47:50.492119+0000","last_became_peered":"2024-03-16T17:47:50.492119+0000","last_unstale":"2024-03-16T17:47:52.521642+0000","last_undegraded":"2024-03-16T17:47:52.521642+0000","last_fullsized":"2024-03-16T17:47:52.521642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499392+0000","last_change":"2024-03-16T17:47:49.480693+0000","last_active":"2024-03-16T17:47:51.499392+0000","last_peered":"2024-03-16T17:47:51.499392+0000","last_clean":"2024-03-16T17:47:51.499392+0000","last_became_active":"2024-03-16T17:47:49.480396+0000","last_became_peered":"2024-03-16T17:47:49.480396+0000","last_unstale":"2024-03-16T17:47:51.499392+0000","last_undegraded":"2024-03-16T17:47:51.499392+0000","last_fullsized":"2024-03-16T17:47:51.499392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520666+0000","last_change":"2024-03-16T17:47:49.482964+0000","last_active":"2024-03-16T17:47:52.520666+0000","last_peered":"2024-03-16T17:47:52.520666+0000","last_clean":"2024-03-16T17:47:52.520666+0000","last_became_active":"2024-03-16T17:47:49.482603+0000","last_became_peered":"2024-03-16T17:47:49.482603+0000","last_unstale":"2024-03-16T17:47:52.520666+0000","last_undegraded":"2024-03-16T17:47:52.520666+0000","last_fullsized":"2024-03-16T17:47:52.520666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:18:43.224585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520762+0000","last_change":"2024-03-16T17:47:50.504067+0000","last_active":"2024-03-16T17:47:52.520762+0000","last_peered":"2024-03-16T17:47:52.520762+0000","last_clean":"2024-03-16T17:47:52.520762+0000","last_became_active":"2024-03-16T17:47:50.503836+0000","last_became_peered":"2024-03-16T17:47:50.503836+0000","last_unstale":"2024-03-16T17:47:52.520762+0000","last_undegraded":"2024-03-16T17:47:52.520762+0000","last_fullsized":"2024-03-16T17:47:52.520762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500556+0000","last_change":"2024-03-16T17:47:49.480169+0000","last_active":"2024-03-16T17:47:51.500556+0000","last_peered":"2024-03-16T17:47:51.500556+0000","last_clean":"2024-03-16T17:47:51.500556+0000","last_became_active":"2024-03-16T17:47:49.478055+0000","last_became_peered":"2024-03-16T17:47:49.478055+0000","last_unstale":"2024-03-16T17:47:51.500556+0000","last_undegraded":"2024-03-16T17:47:51.500556+0000","last_fullsized":"2024-03-16T17:47:51.500556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494549+0000","last_change":"2024-03-16T17:47:50.493815+0000","last_active":"2024-03-16T17:47:51.494549+0000","last_peered":"2024-03-16T17:47:51.494549+0000","last_clean":"2024-03-16T17:47:51.494549+0000","last_became_active":"2024-03-16T17:47:50.493522+0000","last_became_peered":"2024-03-16T17:47:50.493522+0000","last_unstale":"2024-03-16T17:47:51.494549+0000","last_undegraded":"2024-03-16T17:47:51.494549+0000","last_fullsized":"2024-03-16T17:47:51.494549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499476+0000","last_change":"2024-03-16T17:47:49.486100+0000","last_active":"2024-03-16T17:47:51.499476+0000","last_peered":"2024-03-16T17:47:51.499476+0000","last_clean":"2024-03-16T17:47:51.499476+0000","last_became_active":"2024-03-16T17:47:49.485816+0000","last_became_peered":"2024-03-16T17:47:49.485816+0000","last_unstale":"2024-03-16T17:47:51.499476+0000","last_undegraded":"2024-03-16T17:47:51.499476+0000","last_fullsized":"2024-03-16T17:47:51.499476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:58.531025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500516+0000","last_change":"2024-03-16T17:47:50.497437+0000","last_active":"2024-03-16T17:47:51.500516+0000","last_peered":"2024-03-16T17:47:51.500516+0000","last_clean":"2024-03-16T17:47:51.500516+0000","last_became_active":"2024-03-16T17:47:50.497148+0000","last_became_peered":"2024-03-16T17:47:50.497148+0000","last_unstale":"2024-03-16T17:47:51.500516+0000","last_undegraded":"2024-03-16T17:47:51.500516+0000","last_fullsized":"2024-03-16T17:47:51.500516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:39:30.261042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500710+0000","last_change":"2024-03-16T17:47:49.482053+0000","last_active":"2024-03-16T17:47:51.500710+0000","last_peered":"2024-03-16T17:47:51.500710+0000","last_clean":"2024-03-16T17:47:51.500710+0000","last_became_active":"2024-03-16T17:47:49.481763+0000","last_became_peered":"2024-03-16T17:47:49.481763+0000","last_unstale":"2024-03-16T17:47:51.500710+0000","last_undegraded":"2024-03-16T17:47:51.500710+0000","last_fullsized":"2024-03-16T17:47:51.500710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:58.531025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521081+0000","last_change":"2024-03-16T17:47:50.504585+0000","last_active":"2024-03-16T17:47:52.521081+0000","last_peered":"2024-03-16T17:47:52.521081+0000","last_clean":"2024-03-16T17:47:52.521081+0000","last_became_active":"2024-03-16T17:47:50.502857+0000","last_became_peered":"2024-03-16T17:47:50.502857+0000","last_unstale":"2024-03-16T17:47:52.521081+0000","last_undegraded":"2024-03-16T17:47:52.521081+0000","last_fullsized":"2024-03-16T17:47:52.521081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:22:00.192672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494819+0000","last_change":"2024-03-16T17:47:49.485845+0000","last_active":"2024-03-16T17:47:51.494819+0000","last_peered":"2024-03-16T17:47:51.494819+0000","last_clean":"2024-03-16T17:47:51.494819+0000","last_became_active":"2024-03-16T17:47:49.485582+0000","last_became_peered":"2024-03-16T17:47:49.485582+0000","last_unstale":"2024-03-16T17:47:51.494819+0000","last_undegraded":"2024-03-16T17:47:51.494819+0000","last_fullsized":"2024-03-16T17:47:51.494819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:58.531025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521613+0000","last_change":"2024-03-16T17:47:50.498096+0000","last_active":"2024-03-16T17:47:52.521613+0000","last_peered":"2024-03-16T17:47:52.521613+0000","last_clean":"2024-03-16T17:47:52.521613+0000","last_became_active":"2024-03-16T17:47:50.495381+0000","last_became_peered":"2024-03-16T17:47:50.495381+0000","last_unstale":"2024-03-16T17:47:52.521613+0000","last_undegraded":"2024-03-16T17:47:52.521613+0000","last_fullsized":"2024-03-16T17:47:52.521613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:13.979638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499604+0000","last_change":"2024-03-16T17:47:49.483811+0000","last_active":"2024-03-16T17:47:51.499604+0000","last_peered":"2024-03-16T17:47:51.499604+0000","last_clean":"2024-03-16T17:47:51.499604+0000","last_became_active":"2024-03-16T17:47:49.483494+0000","last_became_peered":"2024-03-16T17:47:49.483494+0000","last_unstale":"2024-03-16T17:47:51.499604+0000","last_undegraded":"2024-03-16T17:47:51.499604+0000","last_fullsized":"2024-03-16T17:47:51.499604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521750+0000","last_change":"2024-03-16T17:47:50.499367+0000","last_active":"2024-03-16T17:47:52.521750+0000","last_peered":"2024-03-16T17:47:52.521750+0000","last_clean":"2024-03-16T17:47:52.521750+0000","last_became_active":"2024-03-16T17:47:50.499087+0000","last_became_peered":"2024-03-16T17:47:50.499087+0000","last_unstale":"2024-03-16T17:47:52.521750+0000","last_undegraded":"2024-03-16T17:47:52.521750+0000","last_fullsized":"2024-03-16T17:47:52.521750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:02:20.712220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521724+0000","last_change":"2024-03-16T17:47:49.484787+0000","last_active":"2024-03-16T17:47:52.521724+0000","last_peered":"2024-03-16T17:47:52.521724+0000","last_clean":"2024-03-16T17:47:52.521724+0000","last_became_active":"2024-03-16T17:47:49.484518+0000","last_became_peered":"2024-03-16T17:47:49.484518+0000","last_unstale":"2024-03-16T17:47:52.521724+0000","last_undegraded":"2024-03-16T17:47:52.521724+0000","last_fullsized":"2024-03-16T17:47:52.521724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:39:26.504278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521491+0000","last_change":"2024-03-16T17:47:50.491184+0000","last_active":"2024-03-16T17:47:52.521491+0000","last_peered":"2024-03-16T17:47:52.521491+0000","last_clean":"2024-03-16T17:47:52.521491+0000","last_became_active":"2024-03-16T17:47:50.490924+0000","last_became_peered":"2024-03-16T17:47:50.490924+0000","last_unstale":"2024-03-16T17:47:52.521491+0000","last_undegraded":"2024-03-16T17:47:52.521491+0000","last_fullsized":"2024-03-16T17:47:52.521491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501121+0000","last_change":"2024-03-16T17:47:49.483984+0000","last_active":"2024-03-16T17:47:51.501121+0000","last_peered":"2024-03-16T17:47:51.501121+0000","last_clean":"2024-03-16T17:47:51.501121+0000","last_became_active":"2024-03-16T17:47:49.483687+0000","last_became_peered":"2024-03-16T17:47:49.483687+0000","last_unstale":"2024-03-16T17:47:51.501121+0000","last_undegraded":"2024-03-16T17:47:51.501121+0000","last_fullsized":"2024-03-16T17:47:51.501121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521501+0000","last_change":"2024-03-16T17:47:50.500826+0000","last_active":"2024-03-16T17:47:52.521501+0000","last_peered":"2024-03-16T17:47:52.521501+0000","last_clean":"2024-03-16T17:47:52.521501+0000","last_became_active":"2024-03-16T17:47:50.500555+0000","last_became_peered":"2024-03-16T17:47:50.500555+0000","last_unstale":"2024-03-16T17:47:52.521501+0000","last_undegraded":"2024-03-16T17:47:52.521501+0000","last_fullsized":"2024-03-16T17:47:52.521501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:48:00.859392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499164+0000","last_change":"2024-03-16T17:47:49.480239+0000","last_active":"2024-03-16T17:47:51.499164+0000","last_peered":"2024-03-16T17:47:51.499164+0000","last_clean":"2024-03-16T17:47:51.499164+0000","last_became_active":"2024-03-16T17:47:49.479908+0000","last_became_peered":"2024-03-16T17:47:49.479908+0000","last_unstale":"2024-03-16T17:47:51.499164+0000","last_undegraded":"2024-03-16T17:47:51.499164+0000","last_fullsized":"2024-03-16T17:47:51.499164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499604+0000","last_change":"2024-03-16T17:47:50.492853+0000","last_active":"2024-03-16T17:47:51.499604+0000","last_peered":"2024-03-16T17:47:51.499604+0000","last_clean":"2024-03-16T17:47:51.499604+0000","last_became_active":"2024-03-16T17:47:50.492558+0000","last_became_peered":"2024-03-16T17:47:50.492558+0000","last_unstale":"2024-03-16T17:47:51.499604+0000","last_undegraded":"2024-03-16T17:47:51.499604+0000","last_fullsized":"2024-03-16T17:47:51.499604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522062+0000","last_change":"2024-03-16T17:47:49.479326+0000","last_active":"2024-03-16T17:47:52.522062+0000","last_peered":"2024-03-16T17:47:52.522062+0000","last_clean":"2024-03-16T17:47:52.522062+0000","last_became_active":"2024-03-16T17:47:49.479034+0000","last_became_peered":"2024-03-16T17:47:49.479034+0000","last_unstale":"2024-03-16T17:47:52.522062+0000","last_undegraded":"2024-03-16T17:47:52.522062+0000","last_fullsized":"2024-03-16T17:47:52.522062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521246+0000","last_change":"2024-03-16T17:47:50.500094+0000","last_active":"2024-03-16T17:47:52.521246+0000","last_peered":"2024-03-16T17:47:52.521246+0000","last_clean":"2024-03-16T17:47:52.521246+0000","last_became_active":"2024-03-16T17:47:50.499817+0000","last_became_peered":"2024-03-16T17:47:50.499817+0000","last_unstale":"2024-03-16T17:47:52.521246+0000","last_undegraded":"2024-03-16T17:47:52.521246+0000","last_fullsized":"2024-03-16T17:47:52.521246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:43.769763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521499+0000","last_change":"2024-03-16T17:47:49.483884+0000","last_active":"2024-03-16T17:47:52.521499+0000","last_peered":"2024-03-16T17:47:52.521499+0000","last_clean":"2024-03-16T17:47:52.521499+0000","last_became_active":"2024-03-16T17:47:49.483542+0000","last_became_peered":"2024-03-16T17:47:49.483542+0000","last_unstale":"2024-03-16T17:47:52.521499+0000","last_undegraded":"2024-03-16T17:47:52.521499+0000","last_fullsized":"2024-03-16T17:47:52.521499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:20:40.919920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521833+0000","last_change":"2024-03-16T17:47:50.498543+0000","last_active":"2024-03-16T17:47:52.521833+0000","last_peered":"2024-03-16T17:47:52.521833+0000","last_clean":"2024-03-16T17:47:52.521833+0000","last_became_active":"2024-03-16T17:47:50.498283+0000","last_became_peered":"2024-03-16T17:47:50.498283+0000","last_unstale":"2024-03-16T17:47:52.521833+0000","last_undegraded":"2024-03-16T17:47:52.521833+0000","last_fullsized":"2024-03-16T17:47:52.521833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:14:09.646659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522156+0000","last_change":"2024-03-16T17:47:49.484771+0000","last_active":"2024-03-16T17:47:52.522156+0000","last_peered":"2024-03-16T17:47:52.522156+0000","last_clean":"2024-03-16T17:47:52.522156+0000","last_became_active":"2024-03-16T17:47:49.484490+0000","last_became_peered":"2024-03-16T17:47:49.484490+0000","last_unstale":"2024-03-16T17:47:52.522156+0000","last_undegraded":"2024-03-16T17:47:52.522156+0000","last_fullsized":"2024-03-16T17:47:52.522156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522091+0000","last_change":"2024-03-16T17:47:50.505116+0000","last_active":"2024-03-16T17:47:52.522091+0000","last_peered":"2024-03-16T17:47:52.522091+0000","last_clean":"2024-03-16T17:47:52.522091+0000","last_became_active":"2024-03-16T17:47:50.504865+0000","last_became_peered":"2024-03-16T17:47:50.504865+0000","last_unstale":"2024-03-16T17:47:52.522091+0000","last_undegraded":"2024-03-16T17:47:52.522091+0000","last_fullsized":"2024-03-16T17:47:52.522091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:08:08.823896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494934+0000","last_change":"2024-03-16T17:47:49.477416+0000","last_active":"2024-03-16T17:47:51.494934+0000","last_peered":"2024-03-16T17:47:51.494934+0000","last_clean":"2024-03-16T17:47:51.494934+0000","last_became_active":"2024-03-16T17:47:49.477156+0000","last_became_peered":"2024-03-16T17:47:49.477156+0000","last_unstale":"2024-03-16T17:47:51.494934+0000","last_undegraded":"2024-03-16T17:47:51.494934+0000","last_fullsized":"2024-03-16T17:47:51.494934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500668+0000","last_change":"2024-03-16T17:47:50.493922+0000","last_active":"2024-03-16T17:47:51.500668+0000","last_peered":"2024-03-16T17:47:51.500668+0000","last_clean":"2024-03-16T17:47:51.500668+0000","last_became_active":"2024-03-16T17:47:50.493259+0000","last_became_peered":"2024-03-16T17:47:50.493259+0000","last_unstale":"2024-03-16T17:47:51.500668+0000","last_undegraded":"2024-03-16T17:47:51.500668+0000","last_fullsized":"2024-03-16T17:47:51.500668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:48:00.859392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522188+0000","last_change":"2024-03-16T17:47:49.481283+0000","last_active":"2024-03-16T17:47:52.522188+0000","last_peered":"2024-03-16T17:47:52.522188+0000","last_clean":"2024-03-16T17:47:52.522188+0000","last_became_active":"2024-03-16T17:47:49.480969+0000","last_became_peered":"2024-03-16T17:47:49.480969+0000","last_unstale":"2024-03-16T17:47:52.522188+0000","last_undegraded":"2024-03-16T17:47:52.522188+0000","last_fullsized":"2024-03-16T17:47:52.522188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:18:43.224585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521666+0000","last_change":"2024-03-16T17:47:50.494717+0000","last_active":"2024-03-16T17:47:52.521666+0000","last_peered":"2024-03-16T17:47:52.521666+0000","last_clean":"2024-03-16T17:47:52.521666+0000","last_became_active":"2024-03-16T17:47:50.494415+0000","last_became_peered":"2024-03-16T17:47:50.494415+0000","last_unstale":"2024-03-16T17:47:52.521666+0000","last_undegraded":"2024-03-16T17:47:52.521666+0000","last_fullsized":"2024-03-16T17:47:52.521666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:45.171163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520876+0000","last_change":"2024-03-16T17:47:39.177353+0000","last_active":"2024-03-16T17:47:52.520876+0000","last_peered":"2024-03-16T17:47:52.520876+0000","last_clean":"2024-03-16T17:47:52.520876+0000","last_became_active":"2024-03-16T17:47:39.176109+0000","last_became_peered":"2024-03-16T17:47:39.176109+0000","last_unstale":"2024-03-16T17:47:52.520876+0000","last_undegraded":"2024-03-16T17:47:52.520876+0000","last_fullsized":"2024-03-16T17:47:52.520876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_clean_scrub_stamp":"2024-03-16T17:47:37.885590+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:47.704856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500310+0000","last_change":"2024-03-16T17:47:49.482795+0000","last_active":"2024-03-16T17:47:51.500310+0000","last_peered":"2024-03-16T17:47:51.500310+0000","last_clean":"2024-03-16T17:47:51.500310+0000","last_became_active":"2024-03-16T17:47:49.482524+0000","last_became_peered":"2024-03-16T17:47:49.482524+0000","last_unstale":"2024-03-16T17:47:51.500310+0000","last_undegraded":"2024-03-16T17:47:51.500310+0000","last_fullsized":"2024-03-16T17:47:51.500310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520716+0000","last_change":"2024-03-16T17:47:50.499991+0000","last_active":"2024-03-16T17:47:52.520716+0000","last_peered":"2024-03-16T17:47:52.520716+0000","last_clean":"2024-03-16T17:47:52.520716+0000","last_became_active":"2024-03-16T17:47:50.499726+0000","last_became_peered":"2024-03-16T17:47:50.499726+0000","last_unstale":"2024-03-16T17:47:52.520716+0000","last_undegraded":"2024-03-16T17:47:52.520716+0000","last_fullsized":"2024-03-16T17:47:52.520716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521734+0000","last_change":"2024-03-16T17:47:49.482775+0000","last_active":"2024-03-16T17:47:52.521734+0000","last_peered":"2024-03-16T17:47:52.521734+0000","last_clean":"2024-03-16T17:47:52.521734+0000","last_became_active":"2024-03-16T17:47:49.482367+0000","last_became_peered":"2024-03-16T17:47:49.482367+0000","last_unstale":"2024-03-16T17:47:52.521734+0000","last_undegraded":"2024-03-16T17:47:52.521734+0000","last_fullsized":"2024-03-16T17:47:52.521734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521344+0000","last_change":"2024-03-16T17:47:50.491608+0000","last_active":"2024-03-16T17:47:52.521344+0000","last_peered":"2024-03-16T17:47:52.521344+0000","last_clean":"2024-03-16T17:47:52.521344+0000","last_became_active":"2024-03-16T17:47:50.491341+0000","last_became_peered":"2024-03-16T17:47:50.491341+0000","last_unstale":"2024-03-16T17:47:52.521344+0000","last_undegraded":"2024-03-16T17:47:52.521344+0000","last_fullsized":"2024-03-16T17:47:52.521344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522116+0000","last_change":"2024-03-16T17:47:49.483339+0000","last_active":"2024-03-16T17:47:52.522116+0000","last_peered":"2024-03-16T17:47:52.522116+0000","last_clean":"2024-03-16T17:47:52.522116+0000","last_became_active":"2024-03-16T17:47:49.483030+0000","last_became_peered":"2024-03-16T17:47:49.483030+0000","last_unstale":"2024-03-16T17:47:52.522116+0000","last_undegraded":"2024-03-16T17:47:52.522116+0000","last_fullsized":"2024-03-16T17:47:52.522116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494583+0000","last_change":"2024-03-16T17:47:50.492425+0000","last_active":"2024-03-16T17:47:51.494583+0000","last_peered":"2024-03-16T17:47:51.494583+0000","last_clean":"2024-03-16T17:47:51.494583+0000","last_became_active":"2024-03-16T17:47:50.492129+0000","last_became_peered":"2024-03-16T17:47:50.492129+0000","last_unstale":"2024-03-16T17:47:51.494583+0000","last_undegraded":"2024-03-16T17:47:51.494583+0000","last_fullsized":"2024-03-16T17:47:51.494583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501157+0000","last_change":"2024-03-16T17:47:49.479391+0000","last_active":"2024-03-16T17:47:51.501157+0000","last_peered":"2024-03-16T17:47:51.501157+0000","last_clean":"2024-03-16T17:47:51.501157+0000","last_became_active":"2024-03-16T17:47:49.479121+0000","last_became_peered":"2024-03-16T17:47:49.479121+0000","last_unstale":"2024-03-16T17:47:51.501157+0000","last_undegraded":"2024-03-16T17:47:51.501157+0000","last_fullsized":"2024-03-16T17:47:51.501157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521315+0000","last_change":"2024-03-16T17:47:50.497378+0000","last_active":"2024-03-16T17:47:52.521315+0000","last_peered":"2024-03-16T17:47:52.521315+0000","last_clean":"2024-03-16T17:47:52.521315+0000","last_became_active":"2024-03-16T17:47:50.497042+0000","last_became_peered":"2024-03-16T17:47:50.497042+0000","last_unstale":"2024-03-16T17:47:52.521315+0000","last_undegraded":"2024-03-16T17:47:52.521315+0000","last_fullsized":"2024-03-16T17:47:52.521315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:02.404060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494714+0000","last_change":"2024-03-16T17:47:49.481660+0000","last_active":"2024-03-16T17:47:51.494714+0000","last_peered":"2024-03-16T17:47:51.494714+0000","last_clean":"2024-03-16T17:47:51.494714+0000","last_became_active":"2024-03-16T17:47:49.481419+0000","last_became_peered":"2024-03-16T17:47:49.481419+0000","last_unstale":"2024-03-16T17:47:51.494714+0000","last_undegraded":"2024-03-16T17:47:51.494714+0000","last_fullsized":"2024-03-16T17:47:51.494714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501144+0000","last_change":"2024-03-16T17:47:50.496399+0000","last_active":"2024-03-16T17:47:51.501144+0000","last_peered":"2024-03-16T17:47:51.501144+0000","last_clean":"2024-03-16T17:47:51.501144+0000","last_became_active":"2024-03-16T17:47:50.496000+0000","last_became_peered":"2024-03-16T17:47:50.496000+0000","last_unstale":"2024-03-16T17:47:51.501144+0000","last_undegraded":"2024-03-16T17:47:51.501144+0000","last_fullsized":"2024-03-16T17:47:51.501144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:40:23.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521930+0000","last_change":"2024-03-16T17:47:49.484747+0000","last_active":"2024-03-16T17:47:52.521930+0000","last_peered":"2024-03-16T17:47:52.521930+0000","last_clean":"2024-03-16T17:47:52.521930+0000","last_became_active":"2024-03-16T17:47:49.484405+0000","last_became_peered":"2024-03-16T17:47:49.484405+0000","last_unstale":"2024-03-16T17:47:52.521930+0000","last_undegraded":"2024-03-16T17:47:52.521930+0000","last_fullsized":"2024-03-16T17:47:52.521930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:21:22.363663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494614+0000","last_change":"2024-03-16T17:47:50.492799+0000","last_active":"2024-03-16T17:47:51.494614+0000","last_peered":"2024-03-16T17:47:51.494614+0000","last_clean":"2024-03-16T17:47:51.494614+0000","last_became_active":"2024-03-16T17:47:50.492116+0000","last_became_peered":"2024-03-16T17:47:50.492116+0000","last_unstale":"2024-03-16T17:47:51.494614+0000","last_undegraded":"2024-03-16T17:47:51.494614+0000","last_fullsized":"2024-03-16T17:47:51.494614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.498597+0000","last_change":"2024-03-16T17:47:49.480286+0000","last_active":"2024-03-16T17:47:51.498597+0000","last_peered":"2024-03-16T17:47:51.498597+0000","last_clean":"2024-03-16T17:47:51.498597+0000","last_became_active":"2024-03-16T17:47:49.479968+0000","last_became_peered":"2024-03-16T17:47:49.479968+0000","last_unstale":"2024-03-16T17:47:51.498597+0000","last_undegraded":"2024-03-16T17:47:51.498597+0000","last_fullsized":"2024-03-16T17:47:51.498597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:43.618484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521225+0000","last_change":"2024-03-16T17:47:50.496046+0000","last_active":"2024-03-16T17:47:52.521225+0000","last_peered":"2024-03-16T17:47:52.521225+0000","last_clean":"2024-03-16T17:47:52.521225+0000","last_became_active":"2024-03-16T17:47:50.495774+0000","last_became_peered":"2024-03-16T17:47:50.495774+0000","last_unstale":"2024-03-16T17:47:52.521225+0000","last_undegraded":"2024-03-16T17:47:52.521225+0000","last_fullsized":"2024-03-16T17:47:52.521225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:57:07.363497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499593+0000","last_change":"2024-03-16T17:47:49.478995+0000","last_active":"2024-03-16T17:47:51.499593+0000","last_peered":"2024-03-16T17:47:51.499593+0000","last_clean":"2024-03-16T17:47:51.499593+0000","last_became_active":"2024-03-16T17:47:49.478495+0000","last_became_peered":"2024-03-16T17:47:49.478495+0000","last_unstale":"2024-03-16T17:47:51.499593+0000","last_undegraded":"2024-03-16T17:47:51.499593+0000","last_fullsized":"2024-03-16T17:47:51.499593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521105+0000","last_change":"2024-03-16T17:47:50.488336+0000","last_active":"2024-03-16T17:47:52.521105+0000","last_peered":"2024-03-16T17:47:52.521105+0000","last_clean":"2024-03-16T17:47:52.521105+0000","last_became_active":"2024-03-16T17:47:50.488097+0000","last_became_peered":"2024-03-16T17:47:50.488097+0000","last_unstale":"2024-03-16T17:47:52.521105+0000","last_undegraded":"2024-03-16T17:47:52.521105+0000","last_fullsized":"2024-03-16T17:47:52.521105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:48:41.055949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520819+0000","last_change":"2024-03-16T17:47:49.485058+0000","last_active":"2024-03-16T17:47:52.520819+0000","last_peered":"2024-03-16T17:47:52.520819+0000","last_clean":"2024-03-16T17:47:52.520819+0000","last_became_active":"2024-03-16T17:47:49.484767+0000","last_became_peered":"2024-03-16T17:47:49.484767+0000","last_unstale":"2024-03-16T17:47:52.520819+0000","last_undegraded":"2024-03-16T17:47:52.520819+0000","last_fullsized":"2024-03-16T17:47:52.520819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:12.974711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521233+0000","last_change":"2024-03-16T17:47:50.491877+0000","last_active":"2024-03-16T17:47:52.521233+0000","last_peered":"2024-03-16T17:47:52.521233+0000","last_clean":"2024-03-16T17:47:52.521233+0000","last_became_active":"2024-03-16T17:47:50.491512+0000","last_became_peered":"2024-03-16T17:47:50.491512+0000","last_unstale":"2024-03-16T17:47:52.521233+0000","last_undegraded":"2024-03-16T17:47:52.521233+0000","last_fullsized":"2024-03-16T17:47:52.521233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:59.535953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494603+0000","last_change":"2024-03-16T17:47:49.478211+0000","last_active":"2024-03-16T17:47:51.494603+0000","last_peered":"2024-03-16T17:47:51.494603+0000","last_clean":"2024-03-16T17:47:51.494603+0000","last_became_active":"2024-03-16T17:47:49.477944+0000","last_became_peered":"2024-03-16T17:47:49.477944+0000","last_unstale":"2024-03-16T17:47:51.494603+0000","last_undegraded":"2024-03-16T17:47:51.494603+0000","last_fullsized":"2024-03-16T17:47:51.494603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:12.974711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520683+0000","last_change":"2024-03-16T17:47:50.496170+0000","last_active":"2024-03-16T17:47:52.520683+0000","last_peered":"2024-03-16T17:47:52.520683+0000","last_clean":"2024-03-16T17:47:52.520683+0000","last_became_active":"2024-03-16T17:47:50.495911+0000","last_became_peered":"2024-03-16T17:47:50.495911+0000","last_unstale":"2024-03-16T17:47:52.520683+0000","last_undegraded":"2024-03-16T17:47:52.520683+0000","last_fullsized":"2024-03-16T17:47:52.520683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494768+0000","last_change":"2024-03-16T17:47:49.487179+0000","last_active":"2024-03-16T17:47:51.494768+0000","last_peered":"2024-03-16T17:47:51.494768+0000","last_clean":"2024-03-16T17:47:51.494768+0000","last_became_active":"2024-03-16T17:47:49.486891+0000","last_became_peered":"2024-03-16T17:47:49.486891+0000","last_unstale":"2024-03-16T17:47:51.494768+0000","last_undegraded":"2024-03-16T17:47:51.494768+0000","last_fullsized":"2024-03-16T17:47:51.494768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521308+0000","last_change":"2024-03-16T17:47:50.493256+0000","last_active":"2024-03-16T17:47:52.521308+0000","last_peered":"2024-03-16T17:47:52.521308+0000","last_clean":"2024-03-16T17:47:52.521308+0000","last_became_active":"2024-03-16T17:47:50.492993+0000","last_became_peered":"2024-03-16T17:47:50.492993+0000","last_unstale":"2024-03-16T17:47:52.521308+0000","last_undegraded":"2024-03-16T17:47:52.521308+0000","last_fullsized":"2024-03-16T17:47:52.521308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:43.769763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521638+0000","last_change":"2024-03-16T17:47:49.485238+0000","last_active":"2024-03-16T17:47:52.521638+0000","last_peered":"2024-03-16T17:47:52.521638+0000","last_clean":"2024-03-16T17:47:52.521638+0000","last_became_active":"2024-03-16T17:47:49.484882+0000","last_became_peered":"2024-03-16T17:47:49.484882+0000","last_unstale":"2024-03-16T17:47:52.521638+0000","last_undegraded":"2024-03-16T17:47:52.521638+0000","last_fullsized":"2024-03-16T17:47:52.521638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:01:30.780692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499249+0000","last_change":"2024-03-16T17:47:50.491997+0000","last_active":"2024-03-16T17:47:51.499249+0000","last_peered":"2024-03-16T17:47:51.499249+0000","last_clean":"2024-03-16T17:47:51.499249+0000","last_became_active":"2024-03-16T17:47:50.491733+0000","last_became_peered":"2024-03-16T17:47:50.491733+0000","last_unstale":"2024-03-16T17:47:51.499249+0000","last_undegraded":"2024-03-16T17:47:51.499249+0000","last_fullsized":"2024-03-16T17:47:51.499249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:58:26.517921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501072+0000","last_change":"2024-03-16T17:47:50.500620+0000","last_active":"2024-03-16T17:47:51.501072+0000","last_peered":"2024-03-16T17:47:51.501072+0000","last_clean":"2024-03-16T17:47:51.501072+0000","last_became_active":"2024-03-16T17:47:50.500350+0000","last_became_peered":"2024-03-16T17:47:50.500350+0000","last_unstale":"2024-03-16T17:47:51.501072+0000","last_undegraded":"2024-03-16T17:47:51.501072+0000","last_fullsized":"2024-03-16T17:47:51.501072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:02:20.712220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521598+0000","last_change":"2024-03-16T17:47:49.486202+0000","last_active":"2024-03-16T17:47:52.521598+0000","last_peered":"2024-03-16T17:47:52.521598+0000","last_clean":"2024-03-16T17:47:52.521598+0000","last_became_active":"2024-03-16T17:47:49.485500+0000","last_became_peered":"2024-03-16T17:47:49.485500+0000","last_unstale":"2024-03-16T17:47:52.521598+0000","last_undegraded":"2024-03-16T17:47:52.521598+0000","last_fullsized":"2024-03-16T17:47:52.521598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:43.618484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500577+0000","last_change":"2024-03-16T17:47:50.491413+0000","last_active":"2024-03-16T17:47:51.500577+0000","last_peered":"2024-03-16T17:47:51.500577+0000","last_clean":"2024-03-16T17:47:51.500577+0000","last_became_active":"2024-03-16T17:47:50.491137+0000","last_became_peered":"2024-03-16T17:47:50.491137+0000","last_unstale":"2024-03-16T17:47:51.500577+0000","last_undegraded":"2024-03-16T17:47:51.500577+0000","last_fullsized":"2024-03-16T17:47:51.500577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:57:07.363497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521824+0000","last_change":"2024-03-16T17:47:49.481386+0000","last_active":"2024-03-16T17:47:52.521824+0000","last_peered":"2024-03-16T17:47:52.521824+0000","last_clean":"2024-03-16T17:47:52.521824+0000","last_became_active":"2024-03-16T17:47:49.481018+0000","last_became_peered":"2024-03-16T17:47:49.481018+0000","last_unstale":"2024-03-16T17:47:52.521824+0000","last_undegraded":"2024-03-16T17:47:52.521824+0000","last_fullsized":"2024-03-16T17:47:52.521824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:29:10.861159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520936+0000","last_change":"2024-03-16T17:47:50.504628+0000","last_active":"2024-03-16T17:47:52.520936+0000","last_peered":"2024-03-16T17:47:52.520936+0000","last_clean":"2024-03-16T17:47:52.520936+0000","last_became_active":"2024-03-16T17:47:50.503220+0000","last_became_peered":"2024-03-16T17:47:50.503220+0000","last_unstale":"2024-03-16T17:47:52.520936+0000","last_undegraded":"2024-03-16T17:47:52.520936+0000","last_fullsized":"2024-03-16T17:47:52.520936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:21:23.368591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521157+0000","last_change":"2024-03-16T17:47:49.486523+0000","last_active":"2024-03-16T17:47:52.521157+0000","last_peered":"2024-03-16T17:47:52.521157+0000","last_clean":"2024-03-16T17:47:52.521157+0000","last_became_active":"2024-03-16T17:47:49.486072+0000","last_became_peered":"2024-03-16T17:47:49.486072+0000","last_unstale":"2024-03-16T17:47:52.521157+0000","last_undegraded":"2024-03-16T17:47:52.521157+0000","last_fullsized":"2024-03-16T17:47:52.521157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:49:57.754681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520972+0000","last_change":"2024-03-16T17:47:50.497830+0000","last_active":"2024-03-16T17:47:52.520972+0000","last_peered":"2024-03-16T17:47:52.520972+0000","last_clean":"2024-03-16T17:47:52.520972+0000","last_became_active":"2024-03-16T17:47:50.497566+0000","last_became_peered":"2024-03-16T17:47:50.497566+0000","last_unstale":"2024-03-16T17:47:52.520972+0000","last_undegraded":"2024-03-16T17:47:52.520972+0000","last_fullsized":"2024-03-16T17:47:52.520972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521251+0000","last_change":"2024-03-16T17:47:49.483468+0000","last_active":"2024-03-16T17:47:52.521251+0000","last_peered":"2024-03-16T17:47:52.521251+0000","last_clean":"2024-03-16T17:47:52.521251+0000","last_became_active":"2024-03-16T17:47:49.483189+0000","last_became_peered":"2024-03-16T17:47:49.483189+0000","last_unstale":"2024-03-16T17:47:52.521251+0000","last_undegraded":"2024-03-16T17:47:52.521251+0000","last_fullsized":"2024-03-16T17:47:52.521251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:49:57.754681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T17:47:53.889 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T17:47:53.890 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-16T17:47:53.890 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-16T17:47:53.890 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-16T17:47:53.890 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-16T17:47:54.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.023+0000 7f2aca14b640 1 Processor -- start 2024-03-16T17:47:54.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.023+0000 7f2aca14b640 1 -- start start 2024-03-16T17:47:54.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.023+0000 7f2aca14b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2ac415e110 0x7f2ac40d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.023+0000 7f2aca14b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac40d2990 0x7f2ac40d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.023+0000 7f2aca14b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac40b5780 con 0x7f2ac40d0d40 2024-03-16T17:47:54.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.023+0000 7f2aca14b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac40d11d0 con 0x7f2ac415e110 2024-03-16T17:47:54.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.023+0000 7f2aca14b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40b3760 con 0x7f2ac40d2990 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2ac40d0d40 0x7f2ac40ce940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49898/0 (socket says 172.21.15.132:49898) 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac3fff640 1 -- 172.21.15.132:0/3807699756 learned_addr learned my addr 172.21.15.132:0/3807699756 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac37fe640 1 --2- 172.21.15.132:0/3807699756 >> v2:172.21.15.194:3300/0 conn(0x7f2ac415e110 0x7f2ac40d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2abaffd640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac40d2990 0x7f2ac40d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883380097 0 0) 0x7f2ac40b5780 con 0x7f2ac40d0d40 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab0003520 con 0x7f2ac40d0d40 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2528845809 0 0) 0x7f2ab0003520 con 0x7f2ac40d0d40 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac40d2990 msgr2=0x7f2ac40d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac40d2990 0x7f2ac40d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 >> v2:172.21.15.194:3300/0 conn(0x7f2ac415e110 msgr2=0x7f2ac40d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 --2- 172.21.15.132:0/3807699756 >> v2:172.21.15.194:3300/0 conn(0x7f2ac415e110 0x7f2ac40d2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40b39b0 con 0x7f2ac40d0d40 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f2abc0019f0 con 0x7f2ac40d0d40 2024-03-16T17:47:54.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 >> v1:172.21.15.132:6789/0 conn(0x7f2ac40d0d40 legacy=0x7f2ac40ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 0x7f2ab0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac40d2990 0x7f2ab00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab0004d00 0x7f2ab0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40d11d0 con 0x7f2ab0003970 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40b3760 con 0x7f2ab0004d00 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab000b980 con 0x7f2ac40d2990 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac37fe640 1 --2- 172.21.15.132:0/3807699756 >> v2:172.21.15.194:3300/0 conn(0x7f2ac415e110 0x7f2ac40d2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac37fe640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 0x7f2ab0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2ac3fff640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab0004d00 0x7f2ab0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.024+0000 7f2abaffd640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac40d2990 0x7f2ab00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.025+0000 7f2ac37fe640 1 -- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac40d2990 msgr2=0x7f2ab00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.025+0000 7f2ac37fe640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac40d2990 0x7f2ab00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.025+0000 7f2ac37fe640 1 -- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab0004d00 msgr2=0x7f2ab0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.025+0000 7f2ac37fe640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ab0004d00 0x7f2ab0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.025+0000 7f2ac37fe640 1 -- 172.21.15.132:0/3807699756 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0003520 con 0x7f2ab0003970 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.025+0000 7f2ac37fe640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 0x7f2ab0003d90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009c70 tx=0x7f2ab00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94905500cd3c44d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.025+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4004020 con 0x7f2ab0003970 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.025+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4004180 con 0x7f2ab0003970 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.025+0000 7f2ac2ffd640 1 -- 172.21.15.132:0/3807699756 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab402c960 con 0x7f2ab0003970 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.026+0000 7f2aca14b640 1 -- 172.21.15.132:0/3807699756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 msgr2=0x7f2ab0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.026+0000 7f2aca14b640 1 --2- 172.21.15.132:0/3807699756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 0x7f2ab0003d90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4009c70 tx=0x7f2ab00057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.026+0000 7f2ac3fff640 1 -- 172.21.15.132:0/3807699756 reap_dead start 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.026+0000 7f2aca14b640 1 -- 172.21.15.132:0/3807699756 shutdown_connections 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.026+0000 7f2aca14b640 1 -- 172.21.15.132:0/3807699756 >> 172.21.15.132:0/3807699756 conn(0x7f2ac40d3e70 msgr2=0x7f2ac40d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.026+0000 7f2aca14b640 1 -- 172.21.15.132:0/3807699756 shutdown_connections 2024-03-16T17:47:54.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.026+0000 7f2aca14b640 1 -- 172.21.15.132:0/3807699756 wait complete. 2024-03-16T17:47:54.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.028+0000 7f2aca14b640 1 Processor -- start 2024-03-16T17:47:54.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.028+0000 7f2aca14b640 1 -- start start 2024-03-16T17:47:54.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2aca14b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 0x7f2ac414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2aca14b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac41610b0 0x7f2ac40cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2aca14b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ac414d100 0x7f2ac414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2aca14b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac414daf0 con 0x7f2ab0003970 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2aca14b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40cd590 con 0x7f2ac414d100 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2aca14b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40cd870 con 0x7f2ac41610b0 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2ac37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 0x7f2ac414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2ac37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 0x7f2ac414dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53602/0 (socket says 172.21.15.132:53602) 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2ac37fe640 1 -- 172.21.15.132:0/351160162 learned_addr learned my addr 172.21.15.132:0/351160162 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2ac3fff640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ac414d100 0x7f2ac414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2abaffd640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac41610b0 0x7f2ac40cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2ac37fe640 1 -- 172.21.15.132:0/351160162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac41610b0 msgr2=0x7f2ac40cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2ac37fe640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac41610b0 0x7f2ac40cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2ac37fe640 1 -- 172.21.15.132:0/351160162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ac414d100 msgr2=0x7f2ac414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2ac37fe640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ac414d100 0x7f2ac414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2ac37fe640 1 -- 172.21.15.132:0/351160162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40cdb50 con 0x7f2ab0003970 2024-03-16T17:47:54.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2ac3fff640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ac414d100 0x7f2ac414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.029+0000 7f2abaffd640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac41610b0 0x7f2ac40cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.030+0000 7f2ac37fe640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 0x7f2ac414dca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2ab402c510 tx=0x7f2ab4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.030+0000 7f2ac0ff9640 1 -- 172.21.15.132:0/351160162 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4005e90 con 0x7f2ab0003970 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.030+0000 7f2ac0ff9640 1 -- 172.21.15.132:0/351160162 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab402cb70 con 0x7f2ab0003970 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.030+0000 7f2aca14b640 1 -- 172.21.15.132:0/351160162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac40cde30 con 0x7f2ab0003970 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.030+0000 7f2ac0ff9640 1 -- 172.21.15.132:0/351160162 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4006040 con 0x7f2ab0003970 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.030+0000 7f2aca14b640 1 -- 172.21.15.132:0/351160162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac40cd210 con 0x7f2ab0003970 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.031+0000 7f2aca14b640 1 -- 172.21.15.132:0/351160162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac4068450 con 0x7f2ab0003970 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.031+0000 7f2ac0ff9640 1 -- 172.21.15.132:0/351160162 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f2ab40061a0 con 0x7f2ab0003970 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.032+0000 7f2ac0ff9640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2aa406b3e0 0x7f2aa406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.032+0000 7f2ac0ff9640 1 -- 172.21.15.132:0/351160162 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ab40abf80 con 0x7f2ab0003970 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.032+0000 7f2abaffd640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2aa406b3e0 0x7f2aa406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.032+0000 7f2abaffd640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2aa406b3e0 0x7f2aa406d8a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40ccac0 tx=0x7f2aac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:54.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.036+0000 7f2ac0ff9640 1 -- 172.21.15.132:0/351160162 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2ab40dfe10 con 0x7f2ab0003970 2024-03-16T17:47:54.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.255+0000 7f2aca14b640 1 -- 172.21.15.132:0/351160162 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2ac404f2c0 con 0x7f2ab0003970 2024-03-16T17:47:54.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.258+0000 7f2ac0ff9640 1 -- 172.21.15.132:0/351160162 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171252 (secure 0 0 0) 0x7f2ab40dcd10 con 0x7f2ab0003970 2024-03-16T17:47:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:54.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 -- 172.21.15.132:0/351160162 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2aa406b3e0 msgr2=0x7f2aa406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2aa406b3e0 0x7f2aa406d8a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40ccac0 tx=0x7f2aac008040 comp rx=0 tx=0).stop 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 -- 172.21.15.132:0/351160162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 msgr2=0x7f2ac414dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 0x7f2ac414dca0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2ab402c510 tx=0x7f2ab4004730 comp rx=0 tx=0).stop 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 -- 172.21.15.132:0/351160162 shutdown_connections 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2aa406b3e0 0x7f2aa406d8a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ac414d100 0x7f2ac414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ac41610b0 0x7f2ac40cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 --2- 172.21.15.132:0/351160162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab0003970 0x7f2ac414dca0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 -- 172.21.15.132:0/351160162 >> 172.21.15.132:0/351160162 conn(0x7f2ac40d3e70 msgr2=0x7f2ac40b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 -- 172.21.15.132:0/351160162 shutdown_connections 2024-03-16T17:47:54.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.261+0000 7f2aca14b640 1 -- 172.21.15.132:0/351160162 wait complete. 2024-03-16T17:47:54.275 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2724898791},{"type":"v1","addr":"172.21.15.132:6833","nonce":2724898791}]},"active_addr":"172.21.15.132:6833/2724898791","active_change":"2024-03-16T17:47:29.834894+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":445320646}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1759582233}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1035795762}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":395514352}]}]} 2024-03-16T17:47:54.279 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-16T17:47:54.279 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-16T17:47:54.279 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:54.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.376+0000 7f4f7ee5c640 1 Processor -- start 2024-03-16T17:47:54.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.376+0000 7f4f7ee5c640 1 -- start start 2024-03-16T17:47:54.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f7ee5c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4f78161540 0x7f4f780b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f7ee5c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f780d0680 con 0x7f4f780d1980 2024-03-16T17:47:54.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f7ee5c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f780d08d0 con 0x7f4f780cf080 2024-03-16T17:47:54.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f7ee5c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f780b4f30 con 0x7f4f78161540 2024-03-16T17:47:54.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f7d3f9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4f780d1980 0x7f4f780d1dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49910/0 (socket says 172.21.15.132:49910) 2024-03-16T17:47:54.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f7d3f9640 1 -- 172.21.15.132:0/2674059163 learned_addr learned my addr 172.21.15.132:0/2674059163 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:54.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f7cbf8640 1 --2- 172.21.15.132:0/2674059163 >> v2:172.21.15.194:3300/0 conn(0x7f4f78161540 0x7f4f780b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f777fe640 1 -- 172.21.15.132:0/2674059163 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651887475 0 0) 0x7f4f780d0680 con 0x7f4f780d1980 2024-03-16T17:47:54.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f777fe640 1 -- 172.21.15.132:0/2674059163 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f60003520 con 0x7f4f780d1980 2024-03-16T17:47:54.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f777fe640 1 -- 172.21.15.132:0/2674059163 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4029997373 0 0) 0x7f4f60003520 con 0x7f4f780d1980 2024-03-16T17:47:54.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f7cbf8640 1 -- 172.21.15.132:0/2674059163 >> v1:172.21.15.194:6789/0 conn(0x7f4f780cf080 legacy=0x7f4f780cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f7cbf8640 1 -- 172.21.15.132:0/2674059163 >> v1:172.21.15.132:6789/0 conn(0x7f4f780d1980 legacy=0x7f4f780d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.377+0000 7f4f7cbf8640 1 -- 172.21.15.132:0/2674059163 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f780d0bb0 con 0x7f4f78161540 2024-03-16T17:47:54.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f7cbf8640 1 --2- 172.21.15.132:0/2674059163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f78161540 0x7f4f780b3560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009d90 tx=0x7f4f7002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ca6723414cc5f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:54.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f777fe640 1 -- 172.21.15.132:0/2674059163 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68001670 con 0x7f4f78161540 2024-03-16T17:47:54.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f777fe640 1 -- 172.21.15.132:0/2674059163 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7002c940 con 0x7f4f78161540 2024-03-16T17:47:54.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f777fe640 1 -- 172.21.15.132:0/2674059163 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7002ccb0 con 0x7f4f78161540 2024-03-16T17:47:54.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/2674059163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f78161540 msgr2=0x7f4f780b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f7ee5c640 1 --2- 172.21.15.132:0/2674059163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f78161540 0x7f4f780b3560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009d90 tx=0x7f4f7002be10 comp rx=0 tx=0).stop 2024-03-16T17:47:54.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/2674059163 shutdown_connections 2024-03-16T17:47:54.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f7ee5c640 1 --2- 172.21.15.132:0/2674059163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f78161540 0x7f4f780b3560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/2674059163 >> 172.21.15.132:0/2674059163 conn(0x7f4f7809d120 msgr2=0x7f4f780d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:54.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/2674059163 shutdown_connections 2024-03-16T17:47:54.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.379+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/2674059163 wait complete. 2024-03-16T17:47:54.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.381+0000 7f4f7ee5c640 1 Processor -- start 2024-03-16T17:47:54.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.381+0000 7f4f7ee5c640 1 -- start start 2024-03-16T17:47:54.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.381+0000 7f4f7ee5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f780cf080 0x7f4f780c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.381+0000 7f4f7ee5c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f780d1980 0x7f4f78159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.381+0000 7f4f7ee5c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f78161540 0x7f4f781595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.381+0000 7f4f7ee5c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7815bb10 con 0x7f4f780cf080 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.381+0000 7f4f7ee5c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7815af00 con 0x7f4f78161540 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.381+0000 7f4f7ee5c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7815b1e0 con 0x7f4f780d1980 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.381+0000 7f4f7cbf8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f780cf080 0x7f4f780c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.381+0000 7f4f7cbf8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f780cf080 0x7f4f780c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53608/0 (socket says 172.21.15.132:53608) 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f7cbf8640 1 -- 172.21.15.132:0/1967063317 learned_addr learned my addr 172.21.15.132:0/1967063317 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f7cbf8640 1 -- 172.21.15.132:0/1967063317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f780d1980 msgr2=0x7f4f78159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f7cbf8640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f780d1980 0x7f4f78159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f7cbf8640 1 -- 172.21.15.132:0/1967063317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f78161540 msgr2=0x7f4f781595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f7cbf8640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f78161540 0x7f4f781595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f7cbf8640 1 -- 172.21.15.132:0/1967063317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009a70 con 0x7f4f780cf080 2024-03-16T17:47:54.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f7cbf8640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f780cf080 0x7f4f780c8350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f70037040 tx=0x7f4f70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:54.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f757fa640 1 -- 172.21.15.132:0/1967063317 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70009450 con 0x7f4f780cf080 2024-03-16T17:47:54.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f757fa640 1 -- 172.21.15.132:0/1967063317 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7003e410 con 0x7f4f780cf080 2024-03-16T17:47:54.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f757fa640 1 -- 172.21.15.132:0/1967063317 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7003e7a0 con 0x7f4f780cf080 2024-03-16T17:47:54.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/1967063317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7815b4c0 con 0x7f4f780cf080 2024-03-16T17:47:54.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.382+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/1967063317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f780c8890 con 0x7f4f780cf080 2024-03-16T17:47:54.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.383+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/1967063317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f780c8a20 con 0x7f4f780cf080 2024-03-16T17:47:54.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.384+0000 7f4f757fa640 1 -- 172.21.15.132:0/1967063317 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4f7003b050 con 0x7f4f780cf080 2024-03-16T17:47:54.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.384+0000 7f4f757fa640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f6406b3b0 0x7f4f6406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.385+0000 7f4f757fa640 1 -- 172.21.15.132:0/1967063317 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f700ac1d0 con 0x7f4f780cf080 2024-03-16T17:47:54.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.385+0000 7f4f77fff640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f6406b3b0 0x7f4f6406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.385+0000 7f4f77fff640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f6406b3b0 0x7f4f6406d870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c000f60 tx=0x7f4f6c0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:54.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.389+0000 7f4f757fa640 1 -- 172.21.15.132:0/1967063317 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4f70076fe0 con 0x7f4f780cf080 2024-03-16T17:47:54.425 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T17:47:54.421+0000 7f3e59299640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T17:47:54.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.729+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/1967063317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f7804f2c0 con 0x7f4f780cf080 2024-03-16T17:47:54.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.730+0000 7f4f757fa640 1 -- 172.21.15.132:0/1967063317 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f4f7007a6a0 con 0x7f4f780cf080 2024-03-16T17:47:54.733 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:54.734 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:54.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/1967063317 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f6406b3b0 msgr2=0x7f4f6406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f6406b3b0 0x7f4f6406d870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c000f60 tx=0x7f4f6c0079b0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/1967063317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f780cf080 msgr2=0x7f4f780c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f780cf080 0x7f4f780c8350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f70037040 tx=0x7f4f70004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/1967063317 shutdown_connections 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f6406b3b0 0x7f4f6406d870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f78161540 0x7f4f781595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f780d1980 0x7f4f78159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 --2- 172.21.15.132:0/1967063317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f780cf080 0x7f4f780c8350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/1967063317 >> 172.21.15.132:0/1967063317 conn(0x7f4f7809d120 msgr2=0x7f4f7806ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/1967063317 shutdown_connections 2024-03-16T17:47:54.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.732+0000 7f4f7ee5c640 1 -- 172.21.15.132:0/1967063317 wait complete. 2024-03-16T17:47:54.746 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-16T17:47:54.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:54.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.842+0000 7feca33fd640 1 Processor -- start 2024-03-16T17:47:54.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.842+0000 7feca33fd640 1 -- start start 2024-03-16T17:47:54.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca33fd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec9c0cfcd0 0x7fec9c0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca33fd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec9c0b50f0 0x7fec9c0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca33fd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c0b4f20 con 0x7fec9c0d0890 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca33fd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9c0d1380 con 0x7fec9c0b50f0 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca33fd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0d4e10 con 0x7fec9c0cfcd0 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca199a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec9c0b50f0 0x7fec9c0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca1199640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fec9c0d0890 0x7fec9c0d0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49926/0 (socket says 172.21.15.132:49926) 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca1199640 1 -- 172.21.15.132:0/1991774424 learned_addr learned my addr 172.21.15.132:0/1991774424 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca199a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec9c0b50f0 0x7fec9c0ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53622/0 (socket says 172.21.15.132:53622) 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca199a640 1 -- 172.21.15.132:0/1991774424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec9c0cfcd0 msgr2=0x7fec9c0c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca0998640 1 --2- 172.21.15.132:0/1991774424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec9c0cfcd0 0x7fec9c0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca199a640 1 --2- 172.21.15.132:0/1991774424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec9c0cfcd0 0x7fec9c0c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca199a640 1 -- 172.21.15.132:0/1991774424 >> v1:172.21.15.132:6789/0 conn(0x7fec9c0d0890 legacy=0x7fec9c0d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7fec93fff640 1 -- 172.21.15.132:0/1991774424 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111150543 0 0) 0x7fec9c0b4f20 con 0x7fec9c0d0890 2024-03-16T17:47:54.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.843+0000 7feca199a640 1 -- 172.21.15.132:0/1991774424 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c0b4c40 con 0x7fec9c0b50f0 2024-03-16T17:47:54.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.844+0000 7feca199a640 1 --2- 172.21.15.132:0/1991774424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0b50f0 0x7fec9c0ca440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fec98009dc0 tx=0x7fec9802be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c1f75155a2983e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:54.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.844+0000 7fec93fff640 1 -- 172.21.15.132:0/1991774424 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9802cc40 con 0x7fec9c0b50f0 2024-03-16T17:47:54.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.844+0000 7fec93fff640 1 -- 172.21.15.132:0/1991774424 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9802cda0 con 0x7fec9c0b50f0 2024-03-16T17:47:54.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.844+0000 7fec93fff640 1 -- 172.21.15.132:0/1991774424 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98034660 con 0x7fec9c0b50f0 2024-03-16T17:47:54.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.845+0000 7feca33fd640 1 -- 172.21.15.132:0/1991774424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0b50f0 msgr2=0x7fec9c0ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.845+0000 7feca33fd640 1 --2- 172.21.15.132:0/1991774424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0b50f0 0x7fec9c0ca440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fec98009dc0 tx=0x7fec9802be90 comp rx=0 tx=0).stop 2024-03-16T17:47:54.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.845+0000 7feca33fd640 1 -- 172.21.15.132:0/1991774424 shutdown_connections 2024-03-16T17:47:54.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.845+0000 7feca33fd640 1 --2- 172.21.15.132:0/1991774424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0b50f0 0x7fec9c0ca440 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.845+0000 7feca33fd640 1 --2- 172.21.15.132:0/1991774424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec9c0cfcd0 0x7fec9c0c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.845+0000 7feca33fd640 1 -- 172.21.15.132:0/1991774424 >> 172.21.15.132:0/1991774424 conn(0x7fec9c0d3f10 msgr2=0x7fec9c0d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:54.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.845+0000 7feca33fd640 1 -- 172.21.15.132:0/1991774424 shutdown_connections 2024-03-16T17:47:54.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.845+0000 7feca33fd640 1 -- 172.21.15.132:0/1991774424 wait complete. 2024-03-16T17:47:54.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.846+0000 7feca33fd640 1 Processor -- start 2024-03-16T17:47:54.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.846+0000 7feca33fd640 1 -- start start 2024-03-16T17:47:54.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca33fd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec9c0b50f0 0x7fec9c0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca33fd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec9c0cfcd0 0x7fec9c158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca33fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0d0890 0x7fec9c0b9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca33fd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0ccce0 con 0x7fec9c0d0890 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca33fd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0cd580 con 0x7fec9c0cfcd0 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca33fd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c158f80 con 0x7fec9c0b50f0 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca199a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0d0890 0x7fec9c0b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca199a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0d0890 0x7fec9c0b9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53638/0 (socket says 172.21.15.132:53638) 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca199a640 1 -- 172.21.15.132:0/1831191071 learned_addr learned my addr 172.21.15.132:0/1831191071 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca1199640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec9c0b50f0 0x7fec9c0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca0998640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec9c0cfcd0 0x7fec9c158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca199a640 1 -- 172.21.15.132:0/1831191071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec9c0b50f0 msgr2=0x7fec9c0b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca199a640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec9c0b50f0 0x7fec9c0b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca199a640 1 -- 172.21.15.132:0/1831191071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec9c0cfcd0 msgr2=0x7fec9c158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca199a640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec9c0cfcd0 0x7fec9c158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca199a640 1 -- 172.21.15.132:0/1831191071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec98009a70 con 0x7fec9c0d0890 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca199a640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0d0890 0x7fec9c0b9340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fec9802c4a0 tx=0x7fec98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:54.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7fec91ffb640 1 -- 172.21.15.132:0/1831191071 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98040650 con 0x7fec9c0d0890 2024-03-16T17:47:54.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7fec91ffb640 1 -- 172.21.15.132:0/1831191071 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec980407b0 con 0x7fec9c0d0890 2024-03-16T17:47:54.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7fec91ffb640 1 -- 172.21.15.132:0/1831191071 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98040b60 con 0x7fec9c0d0890 2024-03-16T17:47:54.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.848+0000 7feca33fd640 1 -- 172.21.15.132:0/1831191071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c0b3ab0 con 0x7fec9c0d0890 2024-03-16T17:47:54.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.849+0000 7feca33fd640 1 -- 172.21.15.132:0/1831191071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c0cd210 con 0x7fec9c0d0890 2024-03-16T17:47:54.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.850+0000 7feca33fd640 1 -- 172.21.15.132:0/1831191071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9c04f2c0 con 0x7fec9c0d0890 2024-03-16T17:47:54.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.850+0000 7fec91ffb640 1 -- 172.21.15.132:0/1831191071 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fec98040cc0 con 0x7fec9c0d0890 2024-03-16T17:47:54.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.851+0000 7fec91ffb640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec8006b3b0 0x7fec8006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:54.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.851+0000 7feca1199640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec8006b3b0 0x7fec8006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:54.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.851+0000 7fec91ffb640 1 -- 172.21.15.132:0/1831191071 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec980ac8b0 con 0x7fec9c0d0890 2024-03-16T17:47:54.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.851+0000 7feca1199640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec8006b3b0 0x7fec8006d870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec94007fd0 tx=0x7fec94007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:54.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:54.855+0000 7fec91ffb640 1 -- 172.21.15.132:0/1831191071 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fec98077650 con 0x7fec9c0d0890 2024-03-16T17:47:55.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.117+0000 7feca33fd640 1 -- 172.21.15.132:0/1831191071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec9c0d22d0 con 0x7fec9c0d0890 2024-03-16T17:47:55.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.118+0000 7fec91ffb640 1 -- 172.21.15.132:0/1831191071 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fec9807ad10 con 0x7fec9c0d0890 2024-03-16T17:47:55.122 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:55.122 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 -- 172.21.15.132:0/1831191071 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec8006b3b0 msgr2=0x7fec8006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec8006b3b0 0x7fec8006d870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec94007fd0 tx=0x7fec94007de0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 -- 172.21.15.132:0/1831191071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0d0890 msgr2=0x7fec9c0b9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0d0890 0x7fec9c0b9340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fec9802c4a0 tx=0x7fec98004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 -- 172.21.15.132:0/1831191071 shutdown_connections 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec8006b3b0 0x7fec8006d870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c0d0890 0x7fec9c0b9340 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec9c0cfcd0 0x7fec9c158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 --2- 172.21.15.132:0/1831191071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec9c0b50f0 0x7fec9c0b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 -- 172.21.15.132:0/1831191071 >> 172.21.15.132:0/1831191071 conn(0x7fec9c0d3f10 msgr2=0x7fec9c0c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 -- 172.21.15.132:0/1831191071 shutdown_connections 2024-03-16T17:47:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.121+0000 7feca33fd640 1 -- 172.21.15.132:0/1831191071 wait complete. 2024-03-16T17:47:55.136 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-16T17:47:55.136 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-16T17:47:55.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-16T17:47:55.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-16T17:47:55.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-16T17:47:55.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-16T17:47:55.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-16T17:47:55.139 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-16T17:47:55.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.306+0000 7fc29cb31640 1 Processor -- start 2024-03-16T17:47:55.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.306+0000 7fd08591e640 1 Processor -- start 2024-03-16T17:47:55.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.306+0000 7fd08591e640 1 -- start start 2024-03-16T17:47:55.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fd08591e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08014b600 0x7fd080072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fd08591e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08014b9e0 con 0x7fd080071360 2024-03-16T17:47:55.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fd08591e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08014be70 con 0x7fd0800b33e0 2024-03-16T17:47:55.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fd08591e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800717f0 con 0x7fd08014b600 2024-03-16T17:47:55.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.307+0000 7f6b29708640 1 Processor -- start 2024-03-16T17:47:55.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.307+0000 7f6b29708640 1 -- start start 2024-03-16T17:47:55.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fd07f7fe640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd0800b33e0 0x7fd0800cd820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46732/0 (socket says 172.21.15.132:46732) 2024-03-16T17:47:55.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fd07f7fe640 1 -- 172.21.15.132:0/2897964370 learned_addr learned my addr 172.21.15.132:0/2897964370 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:55.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fd07effd640 1 --2- 172.21.15.132:0/2897964370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08014b600 0x7fd080072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7f6b29708640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b2415a510 0x7f6b240d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.307+0000 7fc29cb31640 1 -- start start 2024-03-16T17:47:55.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fc29cb31640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29814b670 0x7fc298070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fc29cb31640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc29814bbd0 0x7fc298072140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fc29cb31640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc29806da80 0x7fc29806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fc29cb31640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc298071d20 con 0x7fc29806da80 2024-03-16T17:47:55.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fc29cb31640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29814ba50 con 0x7fc29814bbd0 2024-03-16T17:47:55.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fc29cb31640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29806e410 con 0x7fc29814b670 2024-03-16T17:47:55.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fc2977fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29814b670 0x7fc298070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fc2977fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29814b670 0x7fc298070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:54004/0 (socket says 172.21.15.132:54004) 2024-03-16T17:47:55.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.308+0000 7fc2977fe640 1 -- 172.21.15.132:0/1961787969 learned_addr learned my addr 172.21.15.132:0/1961787969 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b29708640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6b240727b0 0x7f6b24072c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b29708640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b240ad980 con 0x7f6b240b3e80 2024-03-16T17:47:55.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7fc296ffd640 1 --2- 172.21.15.132:0/1961787969 >> v2:172.21.15.194:3300/0 conn(0x7fc29814bbd0 0x7fc298072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7fd07effd640 1 -- 172.21.15.132:0/2897964370 >> v1:172.21.15.194:6789/0 conn(0x7fd0800b33e0 legacy=0x7fd0800cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7fd07effd640 1 -- 172.21.15.132:0/2897964370 >> v1:172.21.15.132:6789/0 conn(0x7fd080071360 legacy=0x7fd080166920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7fd07effd640 1 -- 172.21.15.132:0/2897964370 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080071ad0 con 0x7fd08014b600 2024-03-16T17:47:55.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b237fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6b240727b0 0x7f6b24072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b237fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6b240727b0 0x7f6b24072c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47542/0 (socket says 172.21.15.132:47542) 2024-03-16T17:47:55.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b237fe640 1 -- 172.21.15.132:0/1128446734 learned_addr learned my addr 172.21.15.132:0/1128446734 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b1bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6b240b3e80 0x7f6b240ad270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49942/0 (socket says 172.21.15.132:49942) 2024-03-16T17:47:55.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b29708640 1 -- 172.21.15.132:0/1128446734 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b24073180 con 0x7f6b2415a510 2024-03-16T17:47:55.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b29708640 1 -- 172.21.15.132:0/1128446734 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2415a8f0 con 0x7f6b240727b0 2024-03-16T17:47:55.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b22ffd640 1 --2- 172.21.15.132:0/1128446734 >> v2:172.21.15.132:3300/0 conn(0x7f6b2415a510 0x7f6b240d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7fc297fff640 1 --2- 172.21.15.132:0/1961787969 >> v2:172.21.15.132:3300/0 conn(0x7fc29806da80 0x7fc29806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fc296ffd640 1 -- 172.21.15.132:0/1961787969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29814b670 msgr2=0x7fc298070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fc296ffd640 1 --2- 172.21.15.132:0/1961787969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29814b670 0x7fc298070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fc296ffd640 1 -- 172.21.15.132:0/1961787969 >> v2:172.21.15.132:3300/0 conn(0x7fc29806da80 msgr2=0x7fc29806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fc296ffd640 1 --2- 172.21.15.132:0/1961787969 >> v2:172.21.15.132:3300/0 conn(0x7fc29806da80 0x7fc29806ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fc296ffd640 1 -- 172.21.15.132:0/1961787969 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980710a0 con 0x7fc29814bbd0 2024-03-16T17:47:55.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fc297fff640 1 --2- 172.21.15.132:0/1961787969 >> v2:172.21.15.132:3300/0 conn(0x7fc29806da80 0x7fc29806ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:55.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fd07effd640 1 --2- 172.21.15.132:0/2897964370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08014b600 0x7fd080072890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd0740097d0 tx=0x7fd07402b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccaf9437839ca0fd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b237fe640 1 -- 172.21.15.132:0/1128446734 >> v2:172.21.15.132:3300/0 conn(0x7f6b2415a510 msgr2=0x7f6b240d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fd07dffb640 1 -- 172.21.15.132:0/2897964370 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074031770 con 0x7fd08014b600 2024-03-16T17:47:55.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fd07dffb640 1 -- 172.21.15.132:0/2897964370 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0740318d0 con 0x7fd08014b600 2024-03-16T17:47:55.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b237fe640 1 --2- 172.21.15.132:0/1128446734 >> v2:172.21.15.132:3300/0 conn(0x7f6b2415a510 0x7f6b240d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b237fe640 1 -- 172.21.15.132:0/1128446734 >> v1:172.21.15.132:6789/0 conn(0x7f6b240b3e80 legacy=0x7f6b240ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.309+0000 7f6b237fe640 1 -- 172.21.15.132:0/1128446734 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2406b0f0 con 0x7f6b240727b0 2024-03-16T17:47:55.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fd07dffb640 1 -- 172.21.15.132:0/2897964370 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074031c60 con 0x7fd08014b600 2024-03-16T17:47:55.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.310+0000 7fab0ccaa640 1 Processor -- start 2024-03-16T17:47:55.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7fab0ccaa640 1 -- start start 2024-03-16T17:47:55.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7f6b237fe640 1 --2- 172.21.15.132:0/1128446734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b240727b0 0x7f6b24072c40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b240726a0 tx=0x7f6b1c02e1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32237c96a703ff7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7fc296ffd640 1 --2- 172.21.15.132:0/1961787969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29814bbd0 0x7fc298072140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc298073430 tx=0x7fc28c02b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d834addd743608ca server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7f5d3495a640 1 Processor -- start 2024-03-16T17:47:55.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7f5d3495a640 1 -- start start 2024-03-16T17:47:55.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7fc2967fc640 1 -- 172.21.15.132:0/1961787969 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c031520 con 0x7fc29814bbd0 2024-03-16T17:47:55.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7f14f3e0f640 1 Processor -- start 2024-03-16T17:47:55.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7fc2967fc640 1 -- 172.21.15.132:0/1961787969 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c031680 con 0x7fc29814bbd0 2024-03-16T17:47:55.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7fc2967fc640 1 -- 172.21.15.132:0/1961787969 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c031a10 con 0x7fc29814bbd0 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7fd08591e640 1 -- 172.21.15.132:0/2897964370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08014b600 msgr2=0x7fd080072890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.311+0000 7fd08591e640 1 --2- 172.21.15.132:0/2897964370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08014b600 0x7fd080072890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd0740097d0 tx=0x7fd07402b810 comp rx=0 tx=0).stop 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fd08591e640 1 -- 172.21.15.132:0/2897964370 shutdown_connections 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fd08591e640 1 --2- 172.21.15.132:0/2897964370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08014b600 0x7fd080072890 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fd08591e640 1 -- 172.21.15.132:0/2897964370 >> 172.21.15.132:0/2897964370 conn(0x7fd0800b16d0 msgr2=0x7fd0800b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fab0ccaa640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab080b5ee0 0x7fab080b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fab0ccaa640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab080af020 0x7fab080af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fab0ccaa640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab080b6d40 con 0x7fab080d18a0 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fab0ccaa640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab080aeb40 con 0x7fab080b5ee0 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fab0ccaa640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0815e4c0 con 0x7fab080af020 2024-03-16T17:47:55.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fab06ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab080b5ee0 0x7fab080b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fab06ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab080b5ee0 0x7fab080b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47548/0 (socket says 172.21.15.132:47548) 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fab07fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab080af020 0x7fab080af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fab06ffd640 1 -- 172.21.15.132:0/275116817 learned_addr learned my addr 172.21.15.132:0/275116817 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017340384 0 0) 0x7fab080b6d40 con 0x7fab080d18a0 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf0003520 con 0x7fab080d18a0 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fc29cb31640 1 -- 172.21.15.132:0/1961787969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29814bbd0 msgr2=0x7fc298072140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fc29cb31640 1 --2- 172.21.15.132:0/1961787969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29814bbd0 0x7fc298072140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc298073430 tx=0x7fc28c02b7c0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fc29cb31640 1 -- 172.21.15.132:0/1961787969 shutdown_connections 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fc29cb31640 1 --2- 172.21.15.132:0/1961787969 >> v2:172.21.15.132:3300/0 conn(0x7fc29806da80 0x7fc29806ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fc29cb31640 1 --2- 172.21.15.132:0/1961787969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29814bbd0 0x7fc298072140 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fc29cb31640 1 --2- 172.21.15.132:0/1961787969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29814b670 0x7fc298070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fc29cb31640 1 -- 172.21.15.132:0/1961787969 >> 172.21.15.132:0/1961787969 conn(0x7fc2980b1740 msgr2=0x7fc2980b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fd08591e640 1 -- 172.21.15.132:0/2897964370 shutdown_connections 2024-03-16T17:47:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7f14f3e0f640 1 -- start start 2024-03-16T17:47:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7f5d3495a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d280dfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7f5d3495a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5d280509a0 0x7f5d28050dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7f6b227fc640 1 -- 172.21.15.132:0/1128446734 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c02eb60 con 0x7f6b240727b0 2024-03-16T17:47:55.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7f6b227fc640 1 -- 172.21.15.132:0/1128446734 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c02ecc0 con 0x7f6b240727b0 2024-03-16T17:47:55.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7f6b227fc640 1 -- 172.21.15.132:0/1128446734 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c008720 con 0x7f6b240727b0 2024-03-16T17:47:55.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7fd08591e640 1 -- 172.21.15.132:0/2897964370 wait complete. 2024-03-16T17:47:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7f5d3495a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d28051310 con 0x7f5d28055720 2024-03-16T17:47:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7f5d3495a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d280543b0 con 0x7f5d280509a0 2024-03-16T17:47:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.312+0000 7f5d3495a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d28054680 con 0x7f5d2803b920 2024-03-16T17:47:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f5d2effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d280dfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f5d2effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d280dfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:54008/0 (socket says 172.21.15.132:54008) 2024-03-16T17:47:55.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f5d2effd640 1 -- 172.21.15.132:0/1396389404 learned_addr learned my addr 172.21.15.132:0/1396389404 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 323796654 0 0) 0x7faaf0003520 con 0x7fab080d18a0 2024-03-16T17:47:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab080af020 msgr2=0x7fab080af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab080af020 0x7fab080af4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 >> v2:172.21.15.194:3300/0 conn(0x7fab080b5ee0 msgr2=0x7fab080b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 --2- 172.21.15.132:0/275116817 >> v2:172.21.15.194:3300/0 conn(0x7fab080b5ee0 0x7fab080b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080b64a0 con 0x7fab080d18a0 2024-03-16T17:47:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7faaf8001670 con 0x7fab080d18a0 2024-03-16T17:47:55.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f5d2effd640 1 -- 172.21.15.132:0/1396389404 >> v2:172.21.15.132:3300/0 conn(0x7f5d280509a0 msgr2=0x7f5d28050dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 >> v1:172.21.15.194:6789/0 conn(0x7fab080d18a0 legacy=0x7fab080d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faaf0003970 0x7faaf0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf0004360 0x7faaf0004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaf0004f60 0x7faaf000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab080aeb40 con 0x7faaf0004f60 2024-03-16T17:47:55.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0815e4c0 con 0x7faaf0004360 2024-03-16T17:47:55.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf0014700 con 0x7faaf0003970 2024-03-16T17:47:55.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f14f3e0f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14ec0b2bb0 0x7f14ec070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f14f3e0f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ec06b9d0 0x7f14ec0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f14f3e0f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec0cf1d0 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f14f3e0f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec0b3090 con 0x7f14ec0b2bb0 2024-03-16T17:47:55.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f14f3e0f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec0b3530 con 0x7f14ec06b9d0 2024-03-16T17:47:55.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f14f13aa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14ec0b2bb0 0x7f14ec070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f14f13aa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14ec0b2bb0 0x7f14ec070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53680/0 (socket says 172.21.15.132:53680) 2024-03-16T17:47:55.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f14f13aa640 1 -- 172.21.15.132:0/116543180 learned_addr learned my addr 172.21.15.132:0/116543180 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f14f23ac640 1 --2- 172.21.15.132:0/116543180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ec06b9d0 0x7f14ec0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f4c3a553640 1 Processor -- start 2024-03-16T17:47:55.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fc29cb31640 1 -- 172.21.15.132:0/1961787969 shutdown_connections 2024-03-16T17:47:55.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fd08591e640 1 Processor -- start 2024-03-16T17:47:55.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7fab06ffd640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf0004360 0x7faaf0004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fab07fff640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaf0004f60 0x7faaf000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fab077fe640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faaf0003970 0x7faaf0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f6b29708640 1 -- 172.21.15.132:0/1128446734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b240727b0 msgr2=0x7f6b24072c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f6b29708640 1 --2- 172.21.15.132:0/1128446734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b240727b0 0x7f6b24072c40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b240726a0 tx=0x7f6b1c02e1c0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f6b29708640 1 -- 172.21.15.132:0/1128446734 shutdown_connections 2024-03-16T17:47:55.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f6b29708640 1 --2- 172.21.15.132:0/1128446734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b240727b0 0x7f6b24072c40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f6b29708640 1 --2- 172.21.15.132:0/1128446734 >> v2:172.21.15.132:3300/0 conn(0x7f6b2415a510 0x7f6b240d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f6b29708640 1 -- 172.21.15.132:0/1128446734 >> 172.21.15.132:0/1128446734 conn(0x7f6b24071900 msgr2=0x7f6b240b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fc29cb31640 1 -- 172.21.15.132:0/1961787969 wait complete. 2024-03-16T17:47:55.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f14f0ba9640 1 -- 172.21.15.132:0/116543180 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152987767 0 0) 0x7f14ec0cf1d0 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f14f0ba9640 1 -- 172.21.15.132:0/116543180 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d4003520 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f14f23ac640 1 -- 172.21.15.132:0/116543180 >> v2:172.21.15.132:3300/0 conn(0x7f14ec0b2bb0 msgr2=0x7f14ec070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f14f23ac640 1 --2- 172.21.15.132:0/116543180 >> v2:172.21.15.132:3300/0 conn(0x7f14ec0b2bb0 0x7f14ec070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f14f23ac640 1 -- 172.21.15.132:0/116543180 >> v1:172.21.15.194:6789/0 conn(0x7f14ec0cf6b0 legacy=0x7f14ec15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f6b29708640 1 -- 172.21.15.132:0/1128446734 shutdown_connections 2024-03-16T17:47:55.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f6b29708640 1 -- 172.21.15.132:0/1128446734 wait complete. 2024-03-16T17:47:55.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fab06ffd640 1 -- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faaf0003970 msgr2=0x7faaf0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fab06ffd640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faaf0003970 0x7faaf0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fab06ffd640 1 -- 172.21.15.132:0/275116817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaf0004f60 msgr2=0x7faaf000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fab06ffd640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaf0004f60 0x7faaf000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fab06ffd640 1 -- 172.21.15.132:0/275116817 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080b64a0 con 0x7faaf0004360 2024-03-16T17:47:55.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fab07fff640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaf0004f60 0x7faaf000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:55.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f5d2ffff640 1 --2- 172.21.15.132:0/1396389404 >> v2:172.21.15.132:3300/0 conn(0x7f5d280509a0 0x7f5d28050dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f5d2effd640 1 --2- 172.21.15.132:0/1396389404 >> v2:172.21.15.132:3300/0 conn(0x7f5d280509a0 0x7f5d28050dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f5d2effd640 1 -- 172.21.15.132:0/1396389404 >> v1:172.21.15.132:6789/0 conn(0x7f5d28055720 legacy=0x7f5d28053ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.313+0000 7f5d2effd640 1 -- 172.21.15.132:0/1396389404 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d28054960 con 0x7f5d2803b920 2024-03-16T17:47:55.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f14f23ac640 1 -- 172.21.15.132:0/116543180 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0b3810 con 0x7f14ec06b9d0 2024-03-16T17:47:55.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7f5d2effd640 1 --2- 172.21.15.132:0/1396389404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d280dfee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5d280503d0 tx=0x7f5d2402b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6dbb40c68a7cd95 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.314+0000 7fd08591e640 1 -- start start 2024-03-16T17:47:55.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7f14f23ac640 1 --2- 172.21.15.132:0/116543180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ec06b9d0 0x7f14ec0710e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0097a0 tx=0x7f14dc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b72fd7726f27d63 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd08591e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0800b33e0 0x7fd080146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd08591e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd08014b600 0x7fd080140c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd08591e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd080141bd0 0x7fd0800a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd08591e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd080141170 con 0x7fd080141bd0 2024-03-16T17:47:55.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd08591e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd080142420 con 0x7fd08014b600 2024-03-16T17:47:55.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd08591e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd080142700 con 0x7fd0800b33e0 2024-03-16T17:47:55.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd07effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0800b33e0 0x7fd080146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7f14f0ba9640 1 -- 172.21.15.132:0/116543180 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc030610 con 0x7f14ec06b9d0 2024-03-16T17:47:55.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7f14f0ba9640 1 -- 172.21.15.132:0/116543180 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc030770 con 0x7f14ec06b9d0 2024-03-16T17:47:55.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7f14f0ba9640 1 -- 172.21.15.132:0/116543180 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc030ae0 con 0x7f14ec06b9d0 2024-03-16T17:47:55.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd07effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0800b33e0 0x7fd080146170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:54036/0 (socket says 172.21.15.132:54036) 2024-03-16T17:47:55.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd07effd640 1 -- 172.21.15.132:0/2655922987 learned_addr learned my addr 172.21.15.132:0/2655922987 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd07e7fc640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd08014b600 0x7fd080140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7fd07f7fe640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd080141bd0 0x7fd0800a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7f5d2e7fc640 1 -- 172.21.15.132:0/1396389404 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24030860 con 0x7f5d2803b920 2024-03-16T17:47:55.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7f5d2e7fc640 1 -- 172.21.15.132:0/1396389404 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d240309c0 con 0x7f5d2803b920 2024-03-16T17:47:55.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.315+0000 7f5d2e7fc640 1 -- 172.21.15.132:0/1396389404 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24030d30 con 0x7f5d2803b920 2024-03-16T17:47:55.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fc29cb31640 1 Processor -- start 2024-03-16T17:47:55.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fd07effd640 1 -- 172.21.15.132:0/2655922987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd08014b600 msgr2=0x7fd080140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fd07effd640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd08014b600 0x7fd080140c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fd07effd640 1 -- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd080141bd0 msgr2=0x7fd0800a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fab06ffd640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf0004360 0x7faaf0004840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faafc0098d0 tx=0x7faaf00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77d19e4c669aaac3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7f5d3495a640 1 -- 172.21.15.132:0/1396389404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 msgr2=0x7f5d280dfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7f5d3495a640 1 --2- 172.21.15.132:0/1396389404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d280dfee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5d280503d0 tx=0x7f5d2402b9a0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fd07effd640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd080141bd0 0x7fd0800a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fd07effd640 1 -- 172.21.15.132:0/2655922987 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd074009400 con 0x7fd0800b33e0 2024-03-16T17:47:55.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7f4c3a553640 1 -- start start 2024-03-16T17:47:55.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7f6b29708640 1 Processor -- start 2024-03-16T17:47:55.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fd07f7fe640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd080141bd0 0x7fd0800a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:55.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fd07effd640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0800b33e0 0x7fd080146170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd074034040 tx=0x7fd0740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc02f630 con 0x7faaf0004360 2024-03-16T17:47:55.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7f6b29708640 1 -- start start 2024-03-16T17:47:55.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc02f790 con 0x7faaf0004360 2024-03-16T17:47:55.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7f14f3e0f640 1 -- 172.21.15.132:0/116543180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ec06b9d0 msgr2=0x7f14ec0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7f14f3e0f640 1 --2- 172.21.15.132:0/116543180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ec06b9d0 0x7f14ec0710e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0097a0 tx=0x7f14dc02b960 comp rx=0 tx=0).stop 2024-03-16T17:47:55.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fd067fff640 1 -- 172.21.15.132:0/2655922987 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074032610 con 0x7fd0800b33e0 2024-03-16T17:47:55.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fd067fff640 1 -- 172.21.15.132:0/2655922987 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd074032790 con 0x7fd0800b33e0 2024-03-16T17:47:55.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.316+0000 7fc29cb31640 1 -- start start 2024-03-16T17:47:55.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fc29cb31640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29806da80 0x7fc298161530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fc29cb31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29814b670 0x7fc298131d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fc29cb31640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29814bbd0 0x7fc2981322b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fd067fff640 1 -- 172.21.15.132:0/2655922987 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074032b40 con 0x7fd0800b33e0 2024-03-16T17:47:55.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fd08591e640 1 -- 172.21.15.132:0/2655922987 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd080146740 con 0x7fd0800b33e0 2024-03-16T17:47:55.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fc29cb31640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc298161b20 con 0x7fc29814b670 2024-03-16T17:47:55.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fd08591e640 1 -- 172.21.15.132:0/2655922987 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd080146d00 con 0x7fd0800b33e0 2024-03-16T17:47:55.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fc29cb31640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc298161e00 con 0x7fc29814bbd0 2024-03-16T17:47:55.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fc29cb31640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2981620e0 con 0x7fc29806da80 2024-03-16T17:47:55.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fc297fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29814bbd0 0x7fc2981322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fab067fc640 1 -- 172.21.15.132:0/275116817 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc02fb20 con 0x7faaf0004360 2024-03-16T17:47:55.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fc297fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29814bbd0 0x7fc2981322b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47576/0 (socket says 172.21.15.132:47576) 2024-03-16T17:47:55.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fc297fff640 1 -- 172.21.15.132:0/2325566558 learned_addr learned my addr 172.21.15.132:0/2325566558 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7fab0ccaa640 1 -- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf0004360 msgr2=0x7faaf0004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fab0ccaa640 1 --2- 172.21.15.132:0/275116817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf0004360 0x7faaf0004840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faafc0098d0 tx=0x7faaf00057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7f4c3a553640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4c2c005e90 0x7f4c2c0062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7f4c3a553640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2c054330 con 0x7f4c2c0ead00 2024-03-16T17:47:55.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7f4c3a553640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2c053720 con 0x7f4c2c006810 2024-03-16T17:47:55.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7f4c3a553640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c053a00 con 0x7f4c2c005e90 2024-03-16T17:47:55.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.317+0000 7f4c38d50640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4c2c005e90 0x7f4c2c0062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f4c38d50640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4c2c005e90 0x7f4c2c0062d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47582/0 (socket says 172.21.15.132:47582) 2024-03-16T17:47:55.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f4c38d50640 1 -- 172.21.15.132:0/1801072008 learned_addr learned my addr 172.21.15.132:0/1801072008 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fd08591e640 1 -- 172.21.15.132:0/2655922987 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd080142590 con 0x7fd0800b33e0 2024-03-16T17:47:55.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fab07fff640 1 -- 172.21.15.132:0/275116817 reap_dead start 2024-03-16T17:47:55.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fab0ccaa640 1 -- 172.21.15.132:0/275116817 shutdown_connections 2024-03-16T17:47:55.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fab0ccaa640 1 -- 172.21.15.132:0/275116817 >> 172.21.15.132:0/275116817 conn(0x7fab0809aa70 msgr2=0x7fab0809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fc296ffd640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29814b670 0x7fc298131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f6b29708640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b240727b0 0x7f6b2414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fab0ccaa640 1 -- 172.21.15.132:0/275116817 shutdown_connections 2024-03-16T17:47:55.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fab0ccaa640 1 -- 172.21.15.132:0/275116817 wait complete. 2024-03-16T17:47:55.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fc2977fe640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29806da80 0x7fc298161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f5d3495a640 1 -- 172.21.15.132:0/1396389404 shutdown_connections 2024-03-16T17:47:55.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f5d3495a640 1 --2- 172.21.15.132:0/1396389404 >> v2:172.21.15.132:3300/0 conn(0x7f5d280509a0 0x7f5d28050dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f5d3495a640 1 --2- 172.21.15.132:0/1396389404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d280dfee0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f5d3495a640 1 -- 172.21.15.132:0/1396389404 >> 172.21.15.132:0/1396389404 conn(0x7f5d28052650 msgr2=0x7f5d28052a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f5d3495a640 1 -- 172.21.15.132:0/1396389404 shutdown_connections 2024-03-16T17:47:55.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f4c38d50640 1 -- 172.21.15.132:0/1801072008 >> v1:172.21.15.194:6789/0 conn(0x7f4c2c006810 legacy=0x7f4c2c006c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T17:47:55.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f4c38d50640 1 -- 172.21.15.132:0/1801072008 >> v1:172.21.15.132:6789/0 conn(0x7f4c2c0ead00 legacy=0x7f4c2c04fa90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T17:47:55.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f4c38d50640 1 -- 172.21.15.132:0/1801072008 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c053ce0 con 0x7f4c2c005e90 2024-03-16T17:47:55.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f5d3495a640 1 -- 172.21.15.132:0/1396389404 wait complete. 2024-03-16T17:47:55.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fc297fff640 1 -- 172.21.15.132:0/2325566558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29806da80 msgr2=0x7fc298161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fc297fff640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc29806da80 0x7fc298161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fc297fff640 1 -- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29814b670 msgr2=0x7fc298131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f6b29708640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b240b3e80 0x7f6b2414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f6b29708640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b2415a510 0x7f6b240add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f6b29708640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b241504c0 con 0x7f6b240727b0 2024-03-16T17:47:55.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f6b22ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b240727b0 0x7f6b2414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f6b22ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b240727b0 0x7f6b2414c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53732/0 (socket says 172.21.15.132:53732) 2024-03-16T17:47:55.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f6b22ffd640 1 -- 172.21.15.132:0/2392277209 learned_addr learned my addr 172.21.15.132:0/2392277209 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f6b29708640 1 -- 172.21.15.132:0/2392277209 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2414eee0 con 0x7f6b2415a510 2024-03-16T17:47:55.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fc297fff640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29814b670 0x7fc298131d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fc297fff640 1 -- 172.21.15.132:0/2325566558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c009400 con 0x7fc29814bbd0 2024-03-16T17:47:55.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7fc296ffd640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc29814b670 0x7fc298131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:55.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f6b237fe640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b2415a510 0x7f6b240add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.318+0000 7f6b29708640 1 -- 172.21.15.132:0/2392277209 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2414f1c0 con 0x7f6b240b3e80 2024-03-16T17:47:55.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f6b1bfff640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b240b3e80 0x7f6b2414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f14f3e0f640 1 -- 172.21.15.132:0/116543180 shutdown_connections 2024-03-16T17:47:55.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f14f3e0f640 1 --2- 172.21.15.132:0/116543180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ec06b9d0 0x7f14ec0710e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f14f3e0f640 1 --2- 172.21.15.132:0/116543180 >> v2:172.21.15.132:3300/0 conn(0x7f14ec0b2bb0 0x7f14ec070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f14f3e0f640 1 -- 172.21.15.132:0/116543180 >> 172.21.15.132:0/116543180 conn(0x7f14ec06aee0 msgr2=0x7f14ec06b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7fc297fff640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29814bbd0 0x7fc2981322b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc29000cef0 tx=0x7fc29000a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f6b237fe640 1 -- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b240b3e80 msgr2=0x7f6b2414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f14f3e0f640 1 -- 172.21.15.132:0/116543180 shutdown_connections 2024-03-16T17:47:55.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7fc27ffff640 1 -- 172.21.15.132:0/2325566558 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000d840 con 0x7fc29814bbd0 2024-03-16T17:47:55.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f6b237fe640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b240b3e80 0x7f6b2414ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f6b237fe640 1 -- 172.21.15.132:0/2392277209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b240727b0 msgr2=0x7f6b2414c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc298163c40 con 0x7fc29814bbd0 2024-03-16T17:47:55.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29815daf0 con 0x7fc29814bbd0 2024-03-16T17:47:55.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f6b237fe640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b240727b0 0x7f6b2414c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7fc27ffff640 1 -- 172.21.15.132:0/2325566558 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29000d9a0 con 0x7fc29814bbd0 2024-03-16T17:47:55.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f6b237fe640 1 -- 172.21.15.132:0/2392277209 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c00ac40 con 0x7f6b2415a510 2024-03-16T17:47:55.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f6b22ffd640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b240727b0 0x7f6b2414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:55.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.320+0000 7f4c38d50640 1 --2- 172.21.15.132:0/1801072008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2c005e90 0x7f4c2c0062d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009870 tx=0x7f4c2402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba91d2960cec6dec server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.320+0000 7fc27ffff640 1 -- 172.21.15.132:0/2325566558 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29000dd50 con 0x7fc29814bbd0 2024-03-16T17:47:55.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.319+0000 7f14f3e0f640 1 -- 172.21.15.132:0/116543180 wait complete. 2024-03-16T17:47:55.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.320+0000 7f6b237fe640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b2415a510 0x7f6b240add50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b2415aa30 tx=0x7f6b1c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.320+0000 7fab0ccaa640 1 Processor -- start 2024-03-16T17:47:55.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.320+0000 7fab0ccaa640 1 -- start start 2024-03-16T17:47:55.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.320+0000 7fd067fff640 1 -- 172.21.15.132:0/2655922987 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fd074032ca0 con 0x7fd0800b33e0 2024-03-16T17:47:55.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7f6b1b7fe640 1 -- 172.21.15.132:0/2392277209 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c02eb60 con 0x7f6b2415a510 2024-03-16T17:47:55.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7f6b29708640 1 -- 172.21.15.132:0/2392277209 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2414f4a0 con 0x7f6b2415a510 2024-03-16T17:47:55.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7f6b29708640 1 -- 172.21.15.132:0/2392277209 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2414fa60 con 0x7f6b2415a510 2024-03-16T17:47:55.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7fd067fff640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd06c06b4b0 0x7fd06c06d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7f14f3e0f640 1 Processor -- start 2024-03-16T17:47:55.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7f6b1b7fe640 1 -- 172.21.15.132:0/2392277209 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c008e20 con 0x7f6b2415a510 2024-03-16T17:47:55.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7f14f3e0f640 1 -- start start 2024-03-16T17:47:55.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7f4c2bfff640 1 -- 172.21.15.132:0/1801072008 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c24031870 con 0x7f4c2c005e90 2024-03-16T17:47:55.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7f4c2bfff640 1 -- 172.21.15.132:0/1801072008 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c240319d0 con 0x7f4c2c005e90 2024-03-16T17:47:55.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7fab0ccaa640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab081473e0 0x7fab08152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7fc27ffff640 1 -- 172.21.15.132:0/2325566558 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fc29001e3b0 con 0x7fc29814bbd0 2024-03-16T17:47:55.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fab0ccaa640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab08151500 0x7fab08152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fab0ccaa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab081477c0 0x7fab080b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fc27ffff640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc28406b480 0x7fc28406d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fab07fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab081477c0 0x7fab080b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.320+0000 7f5d3495a640 1 Processor -- start 2024-03-16T17:47:55.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.320+0000 7f5d3495a640 1 -- start start 2024-03-16T17:47:55.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7f5d3495a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d2804de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.321+0000 7f5d3495a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d280509a0 0x7f5d2804e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2f7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d2804de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2f7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d2804de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:54064/0 (socket says 172.21.15.132:54064) 2024-03-16T17:47:55.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d3495a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d28055720 0x7f5d2804b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fab07fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab081477c0 0x7fab080b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53738/0 (socket says 172.21.15.132:53738) 2024-03-16T17:47:55.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fab07fff640 1 -- 172.21.15.132:0/2995635911 learned_addr learned my addr 172.21.15.132:0/2995635911 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2f7fe640 1 -- 172.21.15.132:0/1591551269 learned_addr learned my addr 172.21.15.132:0/1591551269 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2804f350 con 0x7f5d28055720 2024-03-16T17:47:55.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2804f770 con 0x7f5d280509a0 2024-03-16T17:47:55.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2804e9b0 con 0x7f5d2803b920 2024-03-16T17:47:55.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2effd640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d280509a0 0x7f5d2804e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab081536a0 con 0x7fab081477c0 2024-03-16T17:47:55.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab08155c60 con 0x7fab081473e0 2024-03-16T17:47:55.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab08154d80 con 0x7fab08151500 2024-03-16T17:47:55.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fc27ffff640 1 -- 172.21.15.132:0/2325566558 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc29008a5e0 con 0x7fc29814bbd0 2024-03-16T17:47:55.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2ffff640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d28055720 0x7f5d2804b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2f7fe640 1 -- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d280509a0 msgr2=0x7f5d2804e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2f7fe640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d280509a0 0x7f5d2804e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2f7fe640 1 -- 172.21.15.132:0/1591551269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d28055720 msgr2=0x7f5d2804b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc278001030 con 0x7fc29814bbd0 2024-03-16T17:47:55.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fc27ffff640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:6800/119971439,v1:172.21.15.132:6801/119971439] conn(0x7fc284073620 0x7fc284075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fc2977fe640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc28406b480 0x7fc28406d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2f7fe640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d28055720 0x7f5d2804b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2f7fe640 1 -- 172.21.15.132:0/1591551269 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d240094d0 con 0x7f5d2803b920 2024-03-16T17:47:55.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f5d2ffff640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d28055720 0x7f5d2804b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:55.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f5d2f7fe640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d2804de20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c410 tx=0x7f5d1c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fab077fe640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab081473e0 0x7fab08152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fab06ffd640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab08151500 0x7fab08152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fab07fff640 1 -- 172.21.15.132:0/2995635911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab08151500 msgr2=0x7fab08152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fab07fff640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab08151500 0x7fab08152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fab07fff640 1 -- 172.21.15.132:0/2995635911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab081473e0 msgr2=0x7fab08152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fab07fff640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab081473e0 0x7fab08152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fab07fff640 1 -- 172.21.15.132:0/2995635911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08155f00 con 0x7fab081477c0 2024-03-16T17:47:55.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fc296ffd640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:6800/119971439,v1:172.21.15.132:6801/119971439] conn(0x7fc284073620 0x7fc284075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fd067fff640 1 -- 172.21.15.132:0/2655922987 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0740abf20 con 0x7fd0800b33e0 2024-03-16T17:47:55.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fab07fff640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab081477c0 0x7fab080b1490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab08071d10 tx=0x7fab00010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f6b1b7fe640 1 -- 172.21.15.132:0/2392277209 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0408a0 con 0x7f6b2415a510 2024-03-16T17:47:55.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f6b1b7fe640 1 -- 172.21.15.132:0/2392277209 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f6b1c040a40 con 0x7f6b2415a510 2024-03-16T17:47:55.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f5d1bfff640 1 -- 172.21.15.132:0/1591551269 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c005230 con 0x7f5d2803b920 2024-03-16T17:47:55.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2804ec90 con 0x7f5d2803b920 2024-03-16T17:47:55.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2804b6a0 con 0x7f5d2803b920 2024-03-16T17:47:55.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7fc2977fe640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc28406b480 0x7fc28406d940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc29814b3d0 tx=0x7fc288008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7faaeffff640 1 -- 172.21.15.132:0/2995635911 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0000e050 con 0x7fab081477c0 2024-03-16T17:47:55.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7faaeffff640 1 -- 172.21.15.132:0/2995635911 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0000f040 con 0x7fab081477c0 2024-03-16T17:47:55.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab08155060 con 0x7fab081477c0 2024-03-16T17:47:55.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7fc27ffff640 1 -- 172.21.15.132:0/2325566558 --> [v2:172.21.15.132:6800/119971439,v1:172.21.15.132:6801/119971439] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2840760f0 con 0x7fc284073620 2024-03-16T17:47:55.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7f6b1b7fe640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6b0406b4b0 0x7f6b0406d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7f6b22ffd640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6b0406b4b0 0x7f6b0406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7f6b1b7fe640 1 -- 172.21.15.132:0/2392277209 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b1c0aea90 con 0x7f6b2415a510 2024-03-16T17:47:55.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7fc27ffff640 1 -- 172.21.15.132:0/2325566558 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc290007980 con 0x7fc29814bbd0 2024-03-16T17:47:55.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f14f3e0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ec06b9d0 0x7f14ec14a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f14f3e0f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ec0b2bb0 0x7f14ec157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f14f3e0f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ec0cf6b0 0x7f14ec0b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f14f3e0f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1f8cc0 con 0x7f14ec06b9d0 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f14f3e0f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec158a80 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.322+0000 7f14f3e0f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec157f00 con 0x7f14ec0b2bb0 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f14f23ac640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ec0cf6b0 0x7f14ec0b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f14f23ac640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ec0cf6b0 0x7f14ec0b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47622/0 (socket says 172.21.15.132:47622) 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f14f23ac640 1 -- 172.21.15.132:0/3661609127 learned_addr learned my addr 172.21.15.132:0/3661609127 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f14f1bab640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ec06b9d0 0x7f14ec14a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f14f23ac640 1 -- 172.21.15.132:0/3661609127 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ec0b2bb0 msgr2=0x7f14ec157600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f14f23ac640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14ec0b2bb0 0x7f14ec157600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f14f23ac640 1 -- 172.21.15.132:0/3661609127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ec06b9d0 msgr2=0x7f14ec14a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f14f23ac640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14ec06b9d0 0x7f14ec14a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7f14f23ac640 1 -- 172.21.15.132:0/3661609127 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc009400 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7fc296ffd640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:6800/119971439,v1:172.21.15.132:6801/119971439] conn(0x7fc284073620 0x7fc284075a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7f14f23ac640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ec0cf6b0 0x7f14ec0b06b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14dc02b9a0 tx=0x7f14dc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f4c2bfff640 1 -- 172.21.15.132:0/1801072008 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c24031d60 con 0x7f4c2c005e90 2024-03-16T17:47:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7faaeffff640 1 -- 172.21.15.132:0/2995635911 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00015640 con 0x7fab081477c0 2024-03-16T17:47:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab081ef8a0 con 0x7fab081477c0 2024-03-16T17:47:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f14ea7fc640 1 -- 172.21.15.132:0/3661609127 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc03e070 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f6b29708640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:6824/1729300358,v1:172.21.15.194:6825/1729300358] conn(0x7f6b08001650 0x7f6b08003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f6b29708640 1 -- 172.21.15.132:0/2392277209 --> [v2:172.21.15.194:6824/1729300358,v1:172.21.15.194:6825/1729300358] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b08006bb0 con 0x7f6b08001650 2024-03-16T17:47:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f14f3e0f640 1 -- 172.21.15.132:0/3661609127 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec1581e0 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f14f3e0f640 1 -- 172.21.15.132:0/3661609127 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec1587a0 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f6b1bfff640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:6824/1729300358,v1:172.21.15.194:6825/1729300358] conn(0x7f6b08001650 0x7f6b08003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.323+0000 7fd067fff640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:6824/850893211,v1:172.21.15.132:6825/850893211] conn(0x7fd06c073730 0x7fd06c075b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f14ea7fc640 1 -- 172.21.15.132:0/3661609127 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc030da0 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f14ea7fc640 1 -- 172.21.15.132:0/3661609127 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc003830 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f4c3a553640 1 -- 172.21.15.132:0/1801072008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2c005e90 msgr2=0x7f4c2c0062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f4c3a553640 1 --2- 172.21.15.132:0/1801072008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2c005e90 0x7f4c2c0062d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009870 tx=0x7f4c2402b910 comp rx=0 tx=0).stop 2024-03-16T17:47:55.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f4c3a553640 1 -- 172.21.15.132:0/1801072008 shutdown_connections 2024-03-16T17:47:55.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f4c3a553640 1 --2- 172.21.15.132:0/1801072008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2c005e90 0x7f4c2c0062d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f4c3a553640 1 -- 172.21.15.132:0/1801072008 >> 172.21.15.132:0/1801072008 conn(0x7f4c2c009fb0 msgr2=0x7f4c2c00a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.326+0000 7f4c3a553640 1 -- 172.21.15.132:0/1801072008 shutdown_connections 2024-03-16T17:47:55.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7fd07e7fc640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd06c06b4b0 0x7fd06c06d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.324+0000 7fd07e7fc640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd06c06b4b0 0x7fd06c06d970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd0800b3e70 tx=0x7fd070009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7fd067fff640 1 -- 172.21.15.132:0/2655922987 --> [v2:172.21.15.132:6824/850893211,v1:172.21.15.132:6825/850893211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd06c076200 con 0x7fd06c073730 2024-03-16T17:47:55.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7fd067fff640 1 -- 172.21.15.132:0/2655922987 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0740ac2d0 con 0x7fd0800b33e0 2024-03-16T17:47:55.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.325+0000 7f6b22ffd640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6b0406b4b0 0x7f6b0406d970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6b14006fd0 tx=0x7f6b14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.326+0000 7f4c3a553640 1 -- 172.21.15.132:0/1801072008 wait complete. 2024-03-16T17:47:55.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.326+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab080b1310 con 0x7fab081477c0 2024-03-16T17:47:55.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.326+0000 7f6b1bfff640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:6824/1729300358,v1:172.21.15.194:6825/1729300358] conn(0x7f6b08001650 0x7f6b08003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.326+0000 7f5d1bfff640 1 -- 172.21.15.132:0/1591551269 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c005390 con 0x7f5d2803b920 2024-03-16T17:47:55.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.326+0000 7f5d1bfff640 1 -- 172.21.15.132:0/1591551269 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c004830 con 0x7f5d2803b920 2024-03-16T17:47:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.326+0000 7faaeffff640 1 -- 172.21.15.132:0/2995635911 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fab000157a0 con 0x7fab081477c0 2024-03-16T17:47:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7fc27ffff640 1 -- 172.21.15.132:0/2325566558 <== osd.2 v2:172.21.15.132:6800/119971439 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc2840760f0 con 0x7fc284073620 2024-03-16T17:47:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.326+0000 7fd07f7fe640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:6824/850893211,v1:172.21.15.132:6825/850893211] conn(0x7fd06c073730 0x7fd06c075b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7f6b1b7fe640 1 -- 172.21.15.132:0/2392277209 <== osd.6 v2:172.21.15.194:6824/1729300358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6b08006bb0 con 0x7f6b08001650 2024-03-16T17:47:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7faaeffff640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faaf406b400 0x7faaf406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7f14f3e0f640 1 -- 172.21.15.132:0/3661609127 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14cc001030 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d10001030 con 0x7f5d2803b920 2024-03-16T17:47:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7faaeffff640 1 -- 172.21.15.132:0/2995635911 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab0008a8c0 con 0x7fab081477c0 2024-03-16T17:47:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7faaeffff640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:6814/3891166784,v1:172.21.15.132:6816/3891166784] conn(0x7faaf4073620 0x7faaf4075a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7faaeffff640 1 -- 172.21.15.132:0/2995635911 --> [v2:172.21.15.132:6814/3891166784,v1:172.21.15.132:6816/3891166784] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faaf40760f0 con 0x7faaf4073620 2024-03-16T17:47:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7faaeffff640 1 -- 172.21.15.132:0/2995635911 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab0008f2c0 con 0x7fab081477c0 2024-03-16T17:47:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7fab077fe640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faaf406b400 0x7faaf406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7fab06ffd640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:6814/3891166784,v1:172.21.15.132:6816/3891166784] conn(0x7faaf4073620 0x7faaf4075a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.327+0000 7f14ea7fc640 1 -- 172.21.15.132:0/3661609127 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f14dc003990 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.328+0000 7fd07f7fe640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:6824/850893211,v1:172.21.15.132:6825/850893211] conn(0x7fd06c073730 0x7fd06c075b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.328+0000 7fab06ffd640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:6814/3891166784,v1:172.21.15.132:6816/3891166784] conn(0x7faaf4073620 0x7faaf4075a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.328+0000 7f5d1bfff640 1 -- 172.21.15.132:0/1591551269 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f5d1c004990 con 0x7f5d2803b920 2024-03-16T17:47:55.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.328+0000 7fab077fe640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faaf406b400 0x7faaf406d8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faaf8000fb0 tx=0x7faaf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.328+0000 7f5d1bfff640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5d1406b480 0x7f5d1406d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f4c3a553640 1 Processor -- start 2024-03-16T17:47:55.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f5d2effd640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5d1406b480 0x7f5d1406d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f5d1bfff640 1 -- 172.21.15.132:0/1591551269 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d1c0890e0 con 0x7f5d2803b920 2024-03-16T17:47:55.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7fd067fff640 1 -- 172.21.15.132:0/2655922987 <== osd.3 v2:172.21.15.132:6824/850893211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd06c076200 con 0x7fd06c073730 2024-03-16T17:47:55.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f5d1bfff640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:6800/2457236308,v1:172.21.15.194:6802/2457236308] conn(0x7f5d14073700 0x7f5d14075b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f5d1bfff640 1 -- 172.21.15.132:0/1591551269 --> [v2:172.21.15.194:6800/2457236308,v1:172.21.15.194:6802/2457236308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d140761d0 con 0x7f5d14073700 2024-03-16T17:47:55.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f5d1bfff640 1 -- 172.21.15.132:0/1591551269 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d1c08b700 con 0x7f5d2803b920 2024-03-16T17:47:55.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f4c3a553640 1 -- start start 2024-03-16T17:47:55.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f14ea7fc640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f14d806b480 0x7f14d806d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f5d2effd640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5d1406b480 0x7f5d1406d940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d24036000 tx=0x7f5d24008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f14f1bab640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f14d806b480 0x7f14d806d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.329+0000 7f14ea7fc640 1 -- 172.21.15.132:0/3661609127 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14dc0abb10 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.330+0000 7f14ea7fc640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.194:6801/1028694518,v1:172.21.15.194:6803/1028694518] conn(0x7f14d80736a0 0x7f14d8075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.330+0000 7f14ea7fc640 1 -- 172.21.15.132:0/3661609127 --> [v2:172.21.15.194:6801/1028694518,v1:172.21.15.194:6803/1028694518] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14d8076170 con 0x7f14d80736a0 2024-03-16T17:47:55.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.330+0000 7f14ea7fc640 1 -- 172.21.15.132:0/3661609127 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14dc0b02a0 con 0x7f14ec0cf6b0 2024-03-16T17:47:55.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.330+0000 7f14f1bab640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f14d806b480 0x7f14d806d940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f14e00011e0 tx=0x7f14e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.330+0000 7faaeffff640 1 -- 172.21.15.132:0/2995635911 <== osd.1 v2:172.21.15.132:6814/3891166784 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faaf40760f0 con 0x7faaf4073620 2024-03-16T17:47:55.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.330+0000 7f5d2ffff640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:6800/2457236308,v1:172.21.15.194:6802/2457236308] conn(0x7f5d14073700 0x7f5d14075b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f14f13aa640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.194:6801/1028694518,v1:172.21.15.194:6803/1028694518] conn(0x7f14d80736a0 0x7f14d8075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f4c3a553640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c2c005e90 0x7f4c2c0deeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f4c3a553640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2c006810 0x7f4c2c049ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f4c3a553640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c2c0ead00 0x7f4c2c04a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f4c3a553640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c036c10 con 0x7f4c2c0ead00 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f4c38d50640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2c006810 0x7f4c2c049ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f4c38d50640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2c006810 0x7f4c2c049ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47638/0 (socket says 172.21.15.132:47638) 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f4c38d50640 1 -- 172.21.15.132:0/2937035066 learned_addr learned my addr 172.21.15.132:0/2937035066 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f4c3a553640 1 -- 172.21.15.132:0/2937035066 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0e83f0 con 0x7f4c2c006810 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f4c39d52640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c2c0ead00 0x7f4c2c04a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.331+0000 7f4c3a553640 1 -- 172.21.15.132:0/2937035066 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c043820 con 0x7f4c2c005e90 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.332+0000 7f4c39551640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c2c005e90 0x7f4c2c0deeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.332+0000 7f4c38d50640 1 -- 172.21.15.132:0/2937035066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c2c005e90 msgr2=0x7f4c2c0deeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.332+0000 7f4c38d50640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c2c005e90 0x7f4c2c0deeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.332+0000 7f4c38d50640 1 -- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c2c0ead00 msgr2=0x7f4c2c04a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.332+0000 7f4c38d50640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c2c0ead00 0x7f4c2c04a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.332+0000 7f4c38d50640 1 -- 172.21.15.132:0/2937035066 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240094d0 con 0x7f4c2c006810 2024-03-16T17:47:55.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.332+0000 7f4c39551640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c2c005e90 0x7f4c2c0deeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:55.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.332+0000 7f14f13aa640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.194:6801/1028694518,v1:172.21.15.194:6803/1028694518] conn(0x7f14d80736a0 0x7f14d8075ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.332+0000 7f4c38d50640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2c006810 0x7f4c2c049ae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009870 tx=0x7f4c240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.333+0000 7f4c29ffb640 1 -- 172.21.15.132:0/2937035066 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2403adf0 con 0x7f4c2c006810 2024-03-16T17:47:55.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.333+0000 7f4c29ffb640 1 -- 172.21.15.132:0/2937035066 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c240443f0 con 0x7f4c2c006810 2024-03-16T17:47:55.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.333+0000 7f4c3a553640 1 -- 172.21.15.132:0/2937035066 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c043b00 con 0x7f4c2c006810 2024-03-16T17:47:55.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.334+0000 7f4c3a553640 1 -- 172.21.15.132:0/2937035066 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c0440c0 con 0x7f4c2c006810 2024-03-16T17:47:55.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.335+0000 7f4c177fe640 1 -- 172.21.15.132:0/2937035066 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c10001030 con 0x7f4c2c006810 2024-03-16T17:47:55.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.335+0000 7f4c29ffb640 1 -- 172.21.15.132:0/2937035066 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c24044780 con 0x7f4c2c006810 2024-03-16T17:47:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.336+0000 7f14ea7fc640 1 -- 172.21.15.132:0/3661609127 <== osd.4 v2:172.21.15.194:6801/1028694518 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f14d8076170 con 0x7f14d80736a0 2024-03-16T17:47:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.336+0000 7f5d2ffff640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:6800/2457236308,v1:172.21.15.194:6802/2457236308] conn(0x7f5d14073700 0x7f5d14075b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.336+0000 7f4c29ffb640 1 -- 172.21.15.132:0/2937035066 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4c2404d450 con 0x7f4c2c006810 2024-03-16T17:47:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.337+0000 7f4c29ffb640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c1806b3b0 0x7f4c1806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.337+0000 7f4c29ffb640 1 -- 172.21.15.132:0/2937035066 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c2402d040 con 0x7f4c2c006810 2024-03-16T17:47:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.337+0000 7f4c29ffb640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:6808/2901901742,v1:172.21.15.132:6809/2901901742] conn(0x7f4c180733e0 0x7f4c18075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.337+0000 7f4c29ffb640 1 -- 172.21.15.132:0/2937035066 --> [v2:172.21.15.132:6808/2901901742,v1:172.21.15.132:6809/2901901742] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c18075eb0 con 0x7f4c180733e0 2024-03-16T17:47:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.337+0000 7f4c29ffb640 1 -- 172.21.15.132:0/2937035066 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c24076ee0 con 0x7f4c2c006810 2024-03-16T17:47:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.337+0000 7f4c39d52640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:6808/2901901742,v1:172.21.15.132:6809/2901901742] conn(0x7f4c180733e0 0x7f4c18075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.337+0000 7f5d1bfff640 1 -- 172.21.15.132:0/1591551269 <== osd.5 v2:172.21.15.194:6800/2457236308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5d140761d0 con 0x7f5d14073700 2024-03-16T17:47:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.338+0000 7f4c39551640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c1806b3b0 0x7f4c1806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.338+0000 7f4c39d52640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:6808/2901901742,v1:172.21.15.132:6809/2901901742] conn(0x7f4c180733e0 0x7f4c18075800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.338+0000 7f4c39551640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c1806b3b0 0x7f4c1806d870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c34000b60 tx=0x7f4c3406d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.339+0000 7f4c29ffb640 1 -- 172.21.15.132:0/2937035066 <== osd.0 v2:172.21.15.132:6808/2901901742 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4c18075eb0 con 0x7f4c180733e0 2024-03-16T17:47:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.361+0000 7f6b29708640 1 -- 172.21.15.132:0/2392277209 --> [v2:172.21.15.194:6824/1729300358,v1:172.21.15.194:6825/1729300358] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6b08005c90 con 0x7f6b08001650 2024-03-16T17:47:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.361+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 --> [v2:172.21.15.132:6814/3891166784,v1:172.21.15.132:6816/3891166784] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab080b6a60 con 0x7faaf4073620 2024-03-16T17:47:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.361+0000 7f6b1b7fe640 1 -- 172.21.15.132:0/2392277209 <== osd.6 v2:172.21.15.194:6824/1729300358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6b08005c90 con 0x7f6b08001650 2024-03-16T17:47:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.362+0000 7f6b197fa640 1 -- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:6824/1729300358,v1:172.21.15.194:6825/1729300358] conn(0x7f6b08001650 msgr2=0x7f6b08003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.362+0000 7f6b197fa640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:6824/1729300358,v1:172.21.15.194:6825/1729300358] conn(0x7f6b08001650 0x7f6b08003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.362+0000 7faaeffff640 1 -- 172.21.15.132:0/2995635911 <== osd.1 v2:172.21.15.132:6814/3891166784 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faafc02f610 con 0x7faaf4073620 2024-03-16T17:47:55.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.362+0000 7fd08591e640 1 -- 172.21.15.132:0/2655922987 --> [v2:172.21.15.132:6824/850893211,v1:172.21.15.132:6825/850893211] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd080142590 con 0x7fd06c073730 2024-03-16T17:47:55.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.362+0000 7f6b197fa640 1 -- 172.21.15.132:0/2392277209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6b0406b4b0 msgr2=0x7f6b0406d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.362+0000 7f6b197fa640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6b0406b4b0 0x7f6b0406d970 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6b14006fd0 tx=0x7f6b14008040 comp rx=0 tx=0).stop 2024-03-16T17:47:55.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.362+0000 7f6b197fa640 1 -- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b2415a510 msgr2=0x7f6b240add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.362+0000 7f6b197fa640 1 --2- 172.21.15.132:0/2392277209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b2415a510 0x7f6b240add50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b2415aa30 tx=0x7f6b1c004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:55.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.363+0000 7fd067fff640 1 -- 172.21.15.132:0/2655922987 <== osd.3 v2:172.21.15.132:6824/850893211 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd080142590 con 0x7fd06c073730 2024-03-16T17:47:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.363+0000 7fd065ffb640 1 -- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:6824/850893211,v1:172.21.15.132:6825/850893211] conn(0x7fd06c073730 msgr2=0x7fd06c075b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.363+0000 7fd065ffb640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:6824/850893211,v1:172.21.15.132:6825/850893211] conn(0x7fd06c073730 0x7fd06c075b50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.363+0000 7fd065ffb640 1 -- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd06c06b4b0 msgr2=0x7fd06c06d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.363+0000 7fd065ffb640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd06c06b4b0 0x7fd06c06d970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd0800b3e70 tx=0x7fd070009040 comp rx=0 tx=0).stop 2024-03-16T17:47:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.363+0000 7fd065ffb640 1 -- 172.21.15.132:0/2655922987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0800b33e0 msgr2=0x7fd080146170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.363+0000 7fd065ffb640 1 --2- 172.21.15.132:0/2655922987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0800b33e0 0x7fd080146170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd074034040 tx=0x7fd0740046c0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.363+0000 7fd07f7fe640 1 -- 172.21.15.132:0/2655922987 reap_dead start 2024-03-16T17:47:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fd065ffb640 1 -- 172.21.15.132:0/2655922987 shutdown_connections 2024-03-16T17:47:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7f6b237fe640 1 -- 172.21.15.132:0/2392277209 reap_dead start 2024-03-16T17:47:55.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fd065ffb640 1 -- 172.21.15.132:0/2655922987 >> 172.21.15.132:0/2655922987 conn(0x7fd0800b16d0 msgr2=0x7fd0800b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7f6b197fa640 1 -- 172.21.15.132:0/2392277209 shutdown_connections 2024-03-16T17:47:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7f6b197fa640 1 -- 172.21.15.132:0/2392277209 >> 172.21.15.132:0/2392277209 conn(0x7f6b24071900 msgr2=0x7f6b2406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:6814/3891166784,v1:172.21.15.132:6816/3891166784] conn(0x7faaf4073620 msgr2=0x7faaf4075a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fab0ccaa640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:6814/3891166784,v1:172.21.15.132:6816/3891166784] conn(0x7faaf4073620 0x7faaf4075a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faaf406b400 msgr2=0x7faaf406d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fab0ccaa640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faaf406b400 0x7faaf406d8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faaf8000fb0 tx=0x7faaf8009040 comp rx=0 tx=0).stop 2024-03-16T17:47:55.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab081477c0 msgr2=0x7fab080b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fab0ccaa640 1 --2- 172.21.15.132:0/2995635911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab081477c0 0x7fab080b1490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab08071d10 tx=0x7fab00010650 comp rx=0 tx=0).stop 2024-03-16T17:47:55.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fd065ffb640 1 -- 172.21.15.132:0/2655922987 shutdown_connections 2024-03-16T17:47:55.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fd065ffb640 1 -- 172.21.15.132:0/2655922987 wait complete. 2024-03-16T17:47:55.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fab07fff640 1 -- 172.21.15.132:0/2995635911 reap_dead start 2024-03-16T17:47:55.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 shutdown_connections 2024-03-16T17:47:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 >> 172.21.15.132:0/2995635911 conn(0x7fab0809aa70 msgr2=0x7fab0806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.364+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 shutdown_connections 2024-03-16T17:47:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.365+0000 7fab0ccaa640 1 -- 172.21.15.132:0/2995635911 wait complete. 2024-03-16T17:47:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.365+0000 7f6b197fa640 1 -- 172.21.15.132:0/2392277209 shutdown_connections 2024-03-16T17:47:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.365+0000 7f6b197fa640 1 -- 172.21.15.132:0/2392277209 wait complete. 2024-03-16T17:47:55.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.365+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 --> [v2:172.21.15.194:6800/2457236308,v1:172.21.15.194:6802/2457236308] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d10002d30 con 0x7f5d14073700 2024-03-16T17:47:55.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.366+0000 7f5d1bfff640 1 -- 172.21.15.132:0/1591551269 <== osd.5 v2:172.21.15.194:6800/2457236308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5d10002d30 con 0x7f5d14073700 2024-03-16T17:47:55.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.368+0000 7f14f3e0f640 1 -- 172.21.15.132:0/3661609127 --> [v2:172.21.15.194:6801/1028694518,v1:172.21.15.194:6803/1028694518] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14cc002d30 con 0x7f14d80736a0 2024-03-16T17:47:55.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.369+0000 7f14ea7fc640 1 -- 172.21.15.132:0/3661609127 <== osd.4 v2:172.21.15.194:6801/1028694518 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14cc002d30 con 0x7f14d80736a0 2024-03-16T17:47:55.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:6800/2457236308,v1:172.21.15.194:6802/2457236308] conn(0x7f5d14073700 msgr2=0x7f5d14075b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f5d3495a640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:6800/2457236308,v1:172.21.15.194:6802/2457236308] conn(0x7f5d14073700 0x7f5d14075b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f14cbfff640 1 -- 172.21.15.132:0/3661609127 >> [v2:172.21.15.194:6801/1028694518,v1:172.21.15.194:6803/1028694518] conn(0x7f14d80736a0 msgr2=0x7f14d8075ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f14cbfff640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.194:6801/1028694518,v1:172.21.15.194:6803/1028694518] conn(0x7f14d80736a0 0x7f14d8075ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f14cbfff640 1 -- 172.21.15.132:0/3661609127 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f14d806b480 msgr2=0x7f14d806d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f14cbfff640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f14d806b480 0x7f14d806d940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f14e00011e0 tx=0x7f14e0009040 comp rx=0 tx=0).stop 2024-03-16T17:47:55.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f14cbfff640 1 -- 172.21.15.132:0/3661609127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ec0cf6b0 msgr2=0x7f14ec0b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f14cbfff640 1 --2- 172.21.15.132:0/3661609127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14ec0cf6b0 0x7f14ec0b06b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14dc02b9a0 tx=0x7f14dc0046c0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.371+0000 7f14f23ac640 1 -- 172.21.15.132:0/3661609127 reap_dead start 2024-03-16T17:47:55.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.371+0000 7f14cbfff640 1 -- 172.21.15.132:0/3661609127 shutdown_connections 2024-03-16T17:47:55.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.371+0000 7f14cbfff640 1 -- 172.21.15.132:0/3661609127 >> 172.21.15.132:0/3661609127 conn(0x7f14ec06aee0 msgr2=0x7f14ec06b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5d1406b480 msgr2=0x7f5d1406d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f5d3495a640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5d1406b480 0x7f5d1406d940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d24036000 tx=0x7f5d24008030 comp rx=0 tx=0).stop 2024-03-16T17:47:55.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 msgr2=0x7f5d2804de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.370+0000 7f5d3495a640 1 --2- 172.21.15.132:0/1591551269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5d2803b920 0x7f5d2804de20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c410 tx=0x7f5d1c00c8d0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.371+0000 7f14cbfff640 1 -- 172.21.15.132:0/3661609127 shutdown_connections 2024-03-16T17:47:55.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.371+0000 7f5d2ffff640 1 -- 172.21.15.132:0/1591551269 reap_dead start 2024-03-16T17:47:55.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.371+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 shutdown_connections 2024-03-16T17:47:55.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.371+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 >> 172.21.15.132:0/1591551269 conn(0x7f5d28052650 msgr2=0x7f5d280d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.371+0000 7f14cbfff640 1 -- 172.21.15.132:0/3661609127 wait complete. 2024-03-16T17:47:55.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.372+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 shutdown_connections 2024-03-16T17:47:55.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.372+0000 7f5d3495a640 1 -- 172.21.15.132:0/1591551269 wait complete. 2024-03-16T17:47:55.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.376+0000 7f4c177fe640 1 -- 172.21.15.132:0/2937035066 --> [v2:172.21.15.132:6808/2901901742,v1:172.21.15.132:6809/2901901742] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4c10002d30 con 0x7f4c180733e0 2024-03-16T17:47:55.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.377+0000 7f4c29ffb640 1 -- 172.21.15.132:0/2937035066 <== osd.0 v2:172.21.15.132:6808/2901901742 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4c10002d30 con 0x7f4c180733e0 2024-03-16T17:47:55.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.378+0000 7f4c177fe640 1 -- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:6808/2901901742,v1:172.21.15.132:6809/2901901742] conn(0x7f4c180733e0 msgr2=0x7f4c18075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.378+0000 7f4c177fe640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:6808/2901901742,v1:172.21.15.132:6809/2901901742] conn(0x7f4c180733e0 0x7f4c18075800 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.378+0000 7f4c177fe640 1 -- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c1806b3b0 msgr2=0x7f4c1806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.378+0000 7f4c177fe640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4c1806b3b0 0x7f4c1806d870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4c34000b60 tx=0x7f4c3406d040 comp rx=0 tx=0).stop 2024-03-16T17:47:55.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.378+0000 7f4c177fe640 1 -- 172.21.15.132:0/2937035066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2c006810 msgr2=0x7f4c2c049ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.378+0000 7f4c177fe640 1 --2- 172.21.15.132:0/2937035066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c2c006810 0x7f4c2c049ae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009870 tx=0x7f4c240046c0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.378+0000 7f4c39d52640 1 -- 172.21.15.132:0/2937035066 reap_dead start 2024-03-16T17:47:55.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.378+0000 7f4c177fe640 1 -- 172.21.15.132:0/2937035066 shutdown_connections 2024-03-16T17:47:55.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.378+0000 7f4c177fe640 1 -- 172.21.15.132:0/2937035066 >> 172.21.15.132:0/2937035066 conn(0x7f4c2c009fb0 msgr2=0x7f4c2c04dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.379+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 --> [v2:172.21.15.132:6800/119971439,v1:172.21.15.132:6801/119971439] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc278002cb0 con 0x7fc284073620 2024-03-16T17:47:55.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.379+0000 7fc27ffff640 1 -- 172.21.15.132:0/2325566558 <== osd.2 v2:172.21.15.132:6800/119971439 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc278002cb0 con 0x7fc284073620 2024-03-16T17:47:55.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.381+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:6800/119971439,v1:172.21.15.132:6801/119971439] conn(0x7fc284073620 msgr2=0x7fc284075a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.381+0000 7fc29cb31640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:6800/119971439,v1:172.21.15.132:6801/119971439] conn(0x7fc284073620 0x7fc284075a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.381+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc28406b480 msgr2=0x7fc28406d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.381+0000 7fc29cb31640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc28406b480 0x7fc28406d940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc29814b3d0 tx=0x7fc288008040 comp rx=0 tx=0).stop 2024-03-16T17:47:55.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.381+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29814bbd0 msgr2=0x7fc2981322b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.381+0000 7fc29cb31640 1 --2- 172.21.15.132:0/2325566558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc29814bbd0 0x7fc2981322b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc29000cef0 tx=0x7fc29000a710 comp rx=0 tx=0).stop 2024-03-16T17:47:55.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.381+0000 7fc297fff640 1 -- 172.21.15.132:0/2325566558 reap_dead start 2024-03-16T17:47:55.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.382+0000 7f4c177fe640 1 -- 172.21.15.132:0/2937035066 shutdown_connections 2024-03-16T17:47:55.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.382+0000 7f4c177fe640 1 -- 172.21.15.132:0/2937035066 wait complete. 2024-03-16T17:47:55.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.383+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 shutdown_connections 2024-03-16T17:47:55.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.383+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 >> 172.21.15.132:0/2325566558 conn(0x7fc2980b1740 msgr2=0x7fc29813de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.383+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 shutdown_connections 2024-03-16T17:47:55.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.383+0000 7fc29cb31640 1 -- 172.21.15.132:0/2325566558 wait complete. 2024-03-16T17:47:55.411 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:55.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-16T17:47:55.412 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:55.413 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:55.413 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-16T17:47:55.413 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-16T17:47:55.414 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:55.415 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-16T17:47:55.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.396+0000 7fac791d7640 1 Processor -- start 2024-03-16T17:47:55.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.396+0000 7fac791d7640 1 -- start start 2024-03-16T17:47:55.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.397+0000 7fac791d7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fac74161710 0x7fac740d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac791d7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac740d2960 con 0x7fac740d4a10 2024-03-16T17:47:55.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac791d7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac740d2bb0 con 0x7fac740b4730 2024-03-16T17:47:55.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac791d7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac740d0ce0 con 0x7fac74161710 2024-03-16T17:47:55.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac7259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fac740d4a10 0x7fac740d2250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49950/0 (socket says 172.21.15.132:49950) 2024-03-16T17:47:55.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac7259c640 1 -- 172.21.15.132:0/561623075 learned_addr learned my addr 172.21.15.132:0/561623075 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:55.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac72d9d640 1 --2- 172.21.15.132:0/561623075 >> v2:172.21.15.194:3300/0 conn(0x7fac74161710 0x7fac740d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac71d9b640 1 -- 172.21.15.132:0/561623075 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222406263 0 0) 0x7fac740d2bb0 con 0x7fac740b4730 2024-03-16T17:47:55.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac71d9b640 1 -- 172.21.15.132:0/561623075 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac5c003520 con 0x7fac740b4730 2024-03-16T17:47:55.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac71d9b640 1 -- 172.21.15.132:0/561623075 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543009496 0 0) 0x7fac740d2960 con 0x7fac740d4a10 2024-03-16T17:47:55.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac71d9b640 1 -- 172.21.15.132:0/561623075 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac740d2bb0 con 0x7fac740d4a10 2024-03-16T17:47:55.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac72d9d640 1 -- 172.21.15.132:0/561623075 >> v1:172.21.15.194:6789/0 conn(0x7fac740b4730 legacy=0x7fac740cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac72d9d640 1 -- 172.21.15.132:0/561623075 >> v1:172.21.15.132:6789/0 conn(0x7fac740d4a10 legacy=0x7fac740d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.398+0000 7fac72d9d640 1 -- 172.21.15.132:0/561623075 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac740d2e90 con 0x7fac74161710 2024-03-16T17:47:55.418 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:55.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-16T17:47:55.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.399+0000 7fac72d9d640 1 --2- 172.21.15.132:0/561623075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac74161710 0x7fac740d1d10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac640097a0 tx=0x7fac6402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfe69de57b78e6df server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.399+0000 7fac71d9b640 1 -- 172.21.15.132:0/561623075 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6402f810 con 0x7fac74161710 2024-03-16T17:47:55.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.399+0000 7fac71d9b640 1 -- 172.21.15.132:0/561623075 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6402f970 con 0x7fac74161710 2024-03-16T17:47:55.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.399+0000 7fac71d9b640 1 -- 172.21.15.132:0/561623075 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6402fd00 con 0x7fac74161710 2024-03-16T17:47:55.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.400+0000 7fac791d7640 1 -- 172.21.15.132:0/561623075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac74161710 msgr2=0x7fac740d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.400+0000 7fac791d7640 1 --2- 172.21.15.132:0/561623075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac74161710 0x7fac740d1d10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac640097a0 tx=0x7fac6402b9f0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.400+0000 7fac791d7640 1 -- 172.21.15.132:0/561623075 shutdown_connections 2024-03-16T17:47:55.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.400+0000 7fac791d7640 1 --2- 172.21.15.132:0/561623075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac74161710 0x7fac740d1d10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.400+0000 7fac791d7640 1 -- 172.21.15.132:0/561623075 >> 172.21.15.132:0/561623075 conn(0x7fac740d3e10 msgr2=0x7fac740d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.400+0000 7fac791d7640 1 -- 172.21.15.132:0/561623075 shutdown_connections 2024-03-16T17:47:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.400+0000 7fac791d7640 1 -- 172.21.15.132:0/561623075 wait complete. 2024-03-16T17:47:55.420 INFO:teuthology.orchestra.run.smithi132.stdout:55834574856 2024-03-16T17:47:55.420 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-16T17:47:55.421 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:55.422 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-16T17:47:55.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.402+0000 7fac791d7640 1 Processor -- start 2024-03-16T17:47:55.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.402+0000 7fac791d7640 1 -- start start 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac791d7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac740b4730 0x7fac740ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac791d7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac740d4a10 0x7fac740cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac791d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac74161710 0x7fac740cff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac791d7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac740ca780 con 0x7fac740b4730 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac791d7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac740b9c90 con 0x7fac740d4a10 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac791d7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac740b99b0 con 0x7fac74161710 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac72d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac740b4730 0x7fac740ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac72d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac740b4730 0x7fac740ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53762/0 (socket says 172.21.15.132:53762) 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac72d9d640 1 -- 172.21.15.132:0/56542538 learned_addr learned my addr 172.21.15.132:0/56542538 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac7259c640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac740d4a10 0x7fac740cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac7359e640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac74161710 0x7fac740cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac72d9d640 1 -- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac74161710 msgr2=0x7fac740cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac72d9d640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac74161710 0x7fac740cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac72d9d640 1 -- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac740d4a10 msgr2=0x7fac740cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac72d9d640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac740d4a10 0x7fac740cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac72d9d640 1 -- 172.21.15.132:0/56542538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac64009400 con 0x7fac740b4730 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.403+0000 7fac7359e640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac74161710 0x7fac740cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.404+0000 7fac72d9d640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac740b4730 0x7fac740ca240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fac6402c000 tx=0x7fac64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.404+0000 7fac5b7fe640 1 -- 172.21.15.132:0/56542538 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6403c040 con 0x7fac740b4730 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.404+0000 7fac5b7fe640 1 -- 172.21.15.132:0/56542538 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac64037830 con 0x7fac740b4730 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.404+0000 7fac5b7fe640 1 -- 172.21.15.132:0/56542538 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64037be0 con 0x7fac740b4730 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.404+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac74144f50 con 0x7fac740b4730 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.404+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac74145510 con 0x7fac740b4730 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.405+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fac740d1490 con 0x7fac740b4730 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.405+0000 7fac5b7fe640 1 -- 172.21.15.132:0/56542538 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fac64037d40 con 0x7fac740b4730 2024-03-16T17:47:55.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.406+0000 7fac5b7fe640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fac6006b3b0 0x7fac6006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.406+0000 7fac5b7fe640 1 -- 172.21.15.132:0/56542538 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac640abb00 con 0x7fac740b4730 2024-03-16T17:47:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.406+0000 7fac7259c640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fac6006b3b0 0x7fac6006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.406+0000 7fac5b7fe640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:6816/2053250559,v1:172.21.15.194:6817/2053250559] conn(0x7fac60073550 0x7fac60075970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.406+0000 7fac5b7fe640 1 -- 172.21.15.132:0/56542538 --> [v2:172.21.15.194:6816/2053250559,v1:172.21.15.194:6817/2053250559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac60076020 con 0x7fac60073550 2024-03-16T17:47:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.406+0000 7fac5b7fe640 1 -- 172.21.15.132:0/56542538 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac640b02c0 con 0x7fac740b4730 2024-03-16T17:47:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.406+0000 7fac7359e640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:6816/2053250559,v1:172.21.15.194:6817/2053250559] conn(0x7fac60073550 0x7fac60075970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.406+0000 7fac7259c640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fac6006b3b0 0x7fac6006d870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac68007fd0 tx=0x7fac68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.406+0000 7fac7359e640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:6816/2053250559,v1:172.21.15.194:6817/2053250559] conn(0x7fac60073550 0x7fac60075970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.407+0000 7fac5b7fe640 1 -- 172.21.15.132:0/56542538 <== osd.7 v2:172.21.15.194:6816/2053250559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fac60076020 con 0x7fac60073550 2024-03-16T17:47:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 --> [v2:172.21.15.194:6816/2053250559,v1:172.21.15.194:6817/2053250559] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fac740d11b0 con 0x7fac60073550 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac5b7fe640 1 -- 172.21.15.132:0/56542538 <== osd.7 v2:172.21.15.194:6816/2053250559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fac6c0019d0 con 0x7fac60073550 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:6816/2053250559,v1:172.21.15.194:6817/2053250559] conn(0x7fac60073550 msgr2=0x7fac60075970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac791d7640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.194:6816/2053250559,v1:172.21.15.194:6817/2053250559] conn(0x7fac60073550 0x7fac60075970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fac6006b3b0 msgr2=0x7fac6006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac791d7640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fac6006b3b0 0x7fac6006d870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac68007fd0 tx=0x7fac68009040 comp rx=0 tx=0).stop 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac740b4730 msgr2=0x7fac740ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac791d7640 1 --2- 172.21.15.132:0/56542538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac740b4730 0x7fac740ca240 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fac6402c000 tx=0x7fac64004730 comp rx=0 tx=0).stop 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac7359e640 1 -- 172.21.15.132:0/56542538 reap_dead start 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 shutdown_connections 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.422+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 >> 172.21.15.132:0/56542538 conn(0x7fac740d3e10 msgr2=0x7fac740b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.423+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 shutdown_connections 2024-03-16T17:47:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.423+0000 7fac791d7640 1 -- 172.21.15.132:0/56542538 wait complete. 2024-03-16T17:47:55.443 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-03-16T17:47:55.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-16T17:47:55.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.587+0000 7f2d8b495640 1 Processor -- start 2024-03-16T17:47:55.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.588+0000 7f2d8b495640 1 -- start start 2024-03-16T17:47:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.589+0000 7f2d8b495640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415eb30 0x7f2d840b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.589+0000 7f2d8b495640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d8415b510 0x7f2d8406e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.589+0000 7f2d8b495640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d840b5200 con 0x7f2d8415a120 2024-03-16T17:47:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.589+0000 7f2d8b495640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d840b5440 con 0x7f2d8415b510 2024-03-16T17:47:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.589+0000 7f2d8b495640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840b34d0 con 0x7f2d8415eb30 2024-03-16T17:47:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.590+0000 7f2d89a32640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d8415b510 0x7f2d8406e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.591+0000 7f2d89a32640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d8415b510 0x7f2d8406e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47662/0 (socket says 172.21.15.132:47662) 2024-03-16T17:47:55.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.591+0000 7f2d89a32640 1 -- 172.21.15.132:0/1676898966 learned_addr learned my addr 172.21.15.132:0/1676898966 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.593+0000 7f2d89a32640 1 -- 172.21.15.132:0/1676898966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415eb30 msgr2=0x7f2d840b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.593+0000 7f2d88a30640 1 --2- 172.21.15.132:0/1676898966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415eb30 0x7f2d840b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.593+0000 7f2d89a32640 1 --2- 172.21.15.132:0/1676898966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415eb30 0x7f2d840b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.594+0000 7f2d89a32640 1 -- 172.21.15.132:0/1676898966 >> v1:172.21.15.132:6789/0 conn(0x7f2d8415a120 legacy=0x7f2d840b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.594+0000 7f2d89a32640 1 -- 172.21.15.132:0/1676898966 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d840b37b0 con 0x7f2d8415b510 2024-03-16T17:47:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.595+0000 7f2d88a30640 1 --2- 172.21.15.132:0/1676898966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415eb30 0x7f2d840b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.595+0000 7f6c3ab2c640 1 Processor -- start 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.596+0000 7f6c3ab2c640 1 -- start start 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c3ab2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c3414bd50 0x7f6c3406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c3ab2c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c34072550 0x7f6c3406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c3ab2c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340b4460 con 0x7f6c3406b420 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c3ab2c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3406b890 con 0x7f6c3414bd50 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c3ab2c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3406f9b0 con 0x7f6c34072550 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c388c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c3414bd50 0x7f6c3406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c390c9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6c3406b420 0x7f6c3406d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49966/0 (socket says 172.21.15.132:49966) 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c390c9640 1 -- 172.21.15.132:0/3643030961 learned_addr learned my addr 172.21.15.132:0/3643030961 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c33fff640 1 --2- 172.21.15.132:0/3643030961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c34072550 0x7f6c3406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c388c8640 1 -- 172.21.15.132:0/3643030961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c34072550 msgr2=0x7f6c3406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c388c8640 1 --2- 172.21.15.132:0/3643030961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c34072550 0x7f6c3406aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.597+0000 7f6c388c8640 1 -- 172.21.15.132:0/3643030961 >> v1:172.21.15.132:6789/0 conn(0x7f6c3406b420 legacy=0x7f6c3406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.598+0000 7f6c388c8640 1 -- 172.21.15.132:0/3643030961 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340b3bc0 con 0x7f6c3414bd50 2024-03-16T17:47:55.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.598+0000 7f3fd6288640 1 Processor -- start 2024-03-16T17:47:55.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.599+0000 7f6c388c8640 1 --2- 172.21.15.132:0/3643030961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3414bd50 0x7f6c3406f470 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097a0 tx=0x7f6c2802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d39e7851437a351 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.598+0000 7f3fd6288640 1 -- start start 2024-03-16T17:47:55.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.599+0000 7f6c337fe640 1 -- 172.21.15.132:0/3643030961 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2802d040 con 0x7f6c3414bd50 2024-03-16T17:47:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.599+0000 7f6c337fe640 1 -- 172.21.15.132:0/3643030961 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c28031810 con 0x7f6c3414bd50 2024-03-16T17:47:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.599+0000 7f6c337fe640 1 -- 172.21.15.132:0/3643030961 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2802d040 con 0x7f6c3414bd50 2024-03-16T17:47:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f2d89a32640 1 --2- 172.21.15.132:0/1676898966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d8415b510 0x7f2d8406e7b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009e50 tx=0x7f2d7c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0283d5f630c0bee server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f3fd6288640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fd00cd3e0 0x7f3fd00acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f3fd6288640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3fd015a7f0 0x7f3fd015ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f3fd6288640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd006d3d0 con 0x7f3fd0159ff0 2024-03-16T17:47:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f3fd6288640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd006d6b0 con 0x7f3fd00cd3e0 2024-03-16T17:47:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f3fd6288640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd006d990 con 0x7f3fd015a7f0 2024-03-16T17:47:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f3fd4825640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3fd015a7f0 0x7f3fd015ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f3fcffff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3fd0159ff0 0x7f3fd00cccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46766/0 (socket says 172.21.15.132:46766) 2024-03-16T17:47:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f3fcffff640 1 -- 172.21.15.132:0/1067358788 learned_addr learned my addr 172.21.15.132:0/1067358788 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f2d7bfff640 1 -- 172.21.15.132:0/1676898966 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c02cb00 con 0x7f2d8415b510 2024-03-16T17:47:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/3643030961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3414bd50 msgr2=0x7f6c3406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f6c3ab2c640 1 --2- 172.21.15.132:0/3643030961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3414bd50 0x7f6c3406f470 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097a0 tx=0x7f6c2802b8b0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f2d7bfff640 1 -- 172.21.15.132:0/1676898966 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c02cc60 con 0x7f2d8415b510 2024-03-16T17:47:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f2d7bfff640 1 -- 172.21.15.132:0/1676898966 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0343f0 con 0x7f2d8415b510 2024-03-16T17:47:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f3fceffd640 1 -- 172.21.15.132:0/1067358788 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252667077 0 0) 0x7f3fd006d3d0 con 0x7f3fd0159ff0 2024-03-16T17:47:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f3fceffd640 1 -- 172.21.15.132:0/1067358788 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb8003520 con 0x7f3fd0159ff0 2024-03-16T17:47:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/3643030961 shutdown_connections 2024-03-16T17:47:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f6c3ab2c640 1 --2- 172.21.15.132:0/3643030961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c34072550 0x7f6c3406aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f6c3ab2c640 1 --2- 172.21.15.132:0/3643030961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3414bd50 0x7f6c3406f470 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/3643030961 >> 172.21.15.132:0/3643030961 conn(0x7f6c340b28c0 msgr2=0x7f6c340b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/3643030961 shutdown_connections 2024-03-16T17:47:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/3643030961 wait complete. 2024-03-16T17:47:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f3fd4825640 1 -- 172.21.15.132:0/1067358788 >> v2:172.21.15.132:3300/0 conn(0x7f3fd00cd3e0 msgr2=0x7f3fd00acef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T17:47:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f3fd4825640 1 --2- 172.21.15.132:0/1067358788 >> v2:172.21.15.132:3300/0 conn(0x7f3fd00cd3e0 0x7f3fd00acef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f3fd4825640 1 -- 172.21.15.132:0/1067358788 >> v1:172.21.15.194:6789/0 conn(0x7f3fd0159ff0 legacy=0x7f3fd00cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f3fd4825640 1 -- 172.21.15.132:0/1067358788 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd006dc70 con 0x7f3fd015a7f0 2024-03-16T17:47:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f2d8b495640 1 -- 172.21.15.132:0/1676898966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d8415b510 msgr2=0x7f2d8406e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f2d8b495640 1 --2- 172.21.15.132:0/1676898966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d8415b510 0x7f2d8406e7b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009e50 tx=0x7f2d7c02bf60 comp rx=0 tx=0).stop 2024-03-16T17:47:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f2d8b495640 1 -- 172.21.15.132:0/1676898966 shutdown_connections 2024-03-16T17:47:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f2d8b495640 1 --2- 172.21.15.132:0/1676898966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d8415b510 0x7f2d8406e7b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f2d8b495640 1 --2- 172.21.15.132:0/1676898966 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415eb30 0x7f2d840b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f2d8b495640 1 -- 172.21.15.132:0/1676898966 >> 172.21.15.132:0/1676898966 conn(0x7f2d840b2520 msgr2=0x7f2d840b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.602+0000 7f2d8b495640 1 -- 172.21.15.132:0/1676898966 shutdown_connections 2024-03-16T17:47:55.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.602+0000 7f2d8b495640 1 -- 172.21.15.132:0/1676898966 wait complete. 2024-03-16T17:47:55.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.598+0000 7f958531e640 1 Processor -- start 2024-03-16T17:47:55.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.598+0000 7f958531e640 1 -- start start 2024-03-16T17:47:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.602+0000 7f6c3ab2c640 1 Processor -- start 2024-03-16T17:47:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.602+0000 7f6c3ab2c640 1 -- start start 2024-03-16T17:47:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.599+0000 7f958531e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95800b32c0 0x7f958006d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.599+0000 7f958531e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9580149170 con 0x7f95800cee00 2024-03-16T17:47:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.599+0000 7f958531e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958006dc80 con 0x7f9580148d90 2024-03-16T17:47:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.599+0000 7f958531e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9580070ba0 con 0x7f95800b32c0 2024-03-16T17:47:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.599+0000 7f957effd640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f9580148d90 0x7f95800b2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46760/0 (socket says 172.21.15.132:46760) 2024-03-16T17:47:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.599+0000 7f957effd640 1 -- 172.21.15.132:0/1450337754 learned_addr learned my addr 172.21.15.132:0/1450337754 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.600+0000 7f957e7fc640 1 --2- 172.21.15.132:0/1450337754 >> v2:172.21.15.194:3300/0 conn(0x7f95800b32c0 0x7f958006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f957e7fc640 1 -- 172.21.15.132:0/1450337754 >> v1:172.21.15.194:6789/0 conn(0x7f9580148d90 legacy=0x7f95800b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f957e7fc640 1 -- 172.21.15.132:0/1450337754 >> v1:172.21.15.132:6789/0 conn(0x7f95800cee00 legacy=0x7f9580070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.603+0000 7f3fd4825640 1 --2- 172.21.15.132:0/1067358788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fd015a7f0 0x7f3fd015ac40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0073390 tx=0x7f3fc802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a66be00f4ef3516 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.601+0000 7f957e7fc640 1 -- 172.21.15.132:0/1450337754 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958006df60 con 0x7f95800b32c0 2024-03-16T17:47:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.602+0000 7f957e7fc640 1 --2- 172.21.15.132:0/1450337754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95800b32c0 0x7f958006d610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9578009d90 tx=0x7f957802bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ac9e5dfaf3ac3b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.603+0000 7f957dffb640 1 -- 172.21.15.132:0/1450337754 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957802ca30 con 0x7f95800b32c0 2024-03-16T17:47:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.603+0000 7f957dffb640 1 -- 172.21.15.132:0/1450337754 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957802cb90 con 0x7f95800b32c0 2024-03-16T17:47:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.603+0000 7f957dffb640 1 -- 172.21.15.132:0/1450337754 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578034440 con 0x7f95800b32c0 2024-03-16T17:47:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.603+0000 7f3fceffd640 1 -- 172.21.15.132:0/1067358788 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc802cc90 con 0x7f3fd015a7f0 2024-03-16T17:47:55.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.603+0000 7f3fceffd640 1 -- 172.21.15.132:0/1067358788 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc802cdf0 con 0x7f3fd015a7f0 2024-03-16T17:47:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.603+0000 7f3fceffd640 1 -- 172.21.15.132:0/1067358788 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8034660 con 0x7f3fd015a7f0 2024-03-16T17:47:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f958531e640 1 -- 172.21.15.132:0/1450337754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95800b32c0 msgr2=0x7f958006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f958531e640 1 --2- 172.21.15.132:0/1450337754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95800b32c0 0x7f958006d610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9578009d90 tx=0x7f957802bd00 comp rx=0 tx=0).stop 2024-03-16T17:47:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f958531e640 1 -- 172.21.15.132:0/1450337754 shutdown_connections 2024-03-16T17:47:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f958531e640 1 --2- 172.21.15.132:0/1450337754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95800b32c0 0x7f958006d610 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f958531e640 1 -- 172.21.15.132:0/1450337754 >> 172.21.15.132:0/1450337754 conn(0x7f958006aee0 msgr2=0x7f958006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f6c3ab2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3406b420 0x7f6c341661a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f6c3ab2c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c34072550 0x7f6c34138d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f6c3ab2c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c3415a7f0 0x7f6c34139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f6c3ab2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3415ad90 con 0x7f6c3406b420 2024-03-16T17:47:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f6c3ab2c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3415b070 con 0x7f6c3415a7f0 2024-03-16T17:47:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f6c3ab2c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3415b350 con 0x7f6c34072550 2024-03-16T17:47:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f6c388c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3406b420 0x7f6c341661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f6c388c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3406b420 0x7f6c341661a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53776/0 (socket says 172.21.15.132:53776) 2024-03-16T17:47:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f6c388c8640 1 -- 172.21.15.132:0/1543625622 learned_addr learned my addr 172.21.15.132:0/1543625622 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f6c390c9640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c3415a7f0 0x7f6c34139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f6c33fff640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c34072550 0x7f6c34138d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7fd71dae6640 1 Processor -- start 2024-03-16T17:47:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f6c390c9640 1 -- 172.21.15.132:0/1543625622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c34072550 msgr2=0x7f6c34138d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f6c390c9640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c34072550 0x7f6c34138d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f6c390c9640 1 -- 172.21.15.132:0/1543625622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3406b420 msgr2=0x7f6c341661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f6c390c9640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3406b420 0x7f6c341661a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f6c390c9640 1 -- 172.21.15.132:0/1543625622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c28009400 con 0x7f6c3415a7f0 2024-03-16T17:47:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f3fd6288640 1 -- 172.21.15.132:0/1067358788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fd015a7f0 msgr2=0x7f3fd015ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f3fd6288640 1 --2- 172.21.15.132:0/1067358788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fd015a7f0 0x7f3fd015ac40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0073390 tx=0x7f3fc802bee0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f6c390c9640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c3415a7f0 0x7f6c34139290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00ca70 tx=0x7f6c2c00cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f3fd6288640 1 -- 172.21.15.132:0/1067358788 shutdown_connections 2024-03-16T17:47:55.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f3fd6288640 1 --2- 172.21.15.132:0/1067358788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fd015a7f0 0x7f3fd015ac40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f3fd6288640 1 --2- 172.21.15.132:0/1067358788 >> v2:172.21.15.132:3300/0 conn(0x7f3fd00cd3e0 0x7f3fd00acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f3fd6288640 1 -- 172.21.15.132:0/1067358788 >> 172.21.15.132:0/1067358788 conn(0x7f3fd006b0c0 msgr2=0x7f3fd006b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f2d8b495640 1 Processor -- start 2024-03-16T17:47:55.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7f2d8b495640 1 -- start start 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d8b495640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d8415a120 0x7f2d8415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d8b495640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415b510 0x7f2d841f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d8b495640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d8415eb30 0x7f2d840b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d8b495640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8415c920 con 0x7f2d8415a120 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d8b495640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d841f8280 con 0x7f2d8415eb30 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d8b495640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d841574b0 con 0x7f2d8415b510 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d89a32640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d8415eb30 0x7f2d840b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d89a32640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d8415eb30 0x7f2d840b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47690/0 (socket says 172.21.15.132:47690) 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d89a32640 1 -- 172.21.15.132:0/4255748719 learned_addr learned my addr 172.21.15.132:0/4255748719 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f6c317fa640 1 -- 172.21.15.132:0/1543625622 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00ab70 con 0x7f6c3415a7f0 2024-03-16T17:47:55.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f6c317fa640 1 -- 172.21.15.132:0/1543625622 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c00acd0 con 0x7f6c3415a7f0 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f6c317fa640 1 -- 172.21.15.132:0/1543625622 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c012640 con 0x7f6c3415a7f0 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/1543625622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3415b630 con 0x7f6c3415a7f0 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/1543625622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c341666e0 con 0x7f6c3415a7f0 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f6c388c8640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3406b420 0x7f6c341661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.605+0000 7fd71dae6640 1 -- start start 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7fd71dae6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd710057480 0x7fd710036db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7fd71dae6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100513c0 con 0x7fd710049fb0 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7fd71dae6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100545c0 con 0x7fd71004a390 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7fd71dae6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd710007c60 con 0x7fd710057480 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7fd71d2e5640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd71004a390 0x7fd710051f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46772/0 (socket says 172.21.15.132:46772) 2024-03-16T17:47:55.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7fd71d2e5640 1 -- 172.21.15.132:0/1774289855 learned_addr learned my addr 172.21.15.132:0/1774289855 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:55.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7fd717fff640 1 --2- 172.21.15.132:0/1774289855 >> v2:172.21.15.194:3300/0 conn(0x7fd710057480 0x7fd710036db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7fd7177fe640 1 -- 172.21.15.132:0/1774289855 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943144754 0 0) 0x7fd7100545c0 con 0x7fd71004a390 2024-03-16T17:47:55.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7fd7177fe640 1 -- 172.21.15.132:0/1774289855 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd708003520 con 0x7fd71004a390 2024-03-16T17:47:55.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f958531e640 1 -- 172.21.15.132:0/1450337754 shutdown_connections 2024-03-16T17:47:55.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.604+0000 7f958531e640 1 -- 172.21.15.132:0/1450337754 wait complete. 2024-03-16T17:47:55.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f958531e640 1 Processor -- start 2024-03-16T17:47:55.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f958531e640 1 -- start start 2024-03-16T17:47:55.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f958531e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95800cee00 0x7f958014c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7fd717fff640 1 -- 172.21.15.132:0/1774289855 >> v1:172.21.15.194:6789/0 conn(0x7fd71004a390 legacy=0x7fd710051f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7fd717fff640 1 -- 172.21.15.132:0/1774289855 >> v1:172.21.15.132:6789/0 conn(0x7fd710049fb0 legacy=0x7fd710051850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7fd717fff640 1 -- 172.21.15.132:0/1774289855 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710007f40 con 0x7fd710057480 2024-03-16T17:47:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f958531e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9580148d90 0x7f95800b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f958531e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958014c920 0x7f95800b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f958531e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958014d3f0 con 0x7f95800cee00 2024-03-16T17:47:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f3fd6288640 1 -- 172.21.15.132:0/1067358788 shutdown_connections 2024-03-16T17:47:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f958531e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958014da90 con 0x7f958014c920 2024-03-16T17:47:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f957f7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958014c920 0x7f95800b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f957f7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958014c920 0x7f95800b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47700/0 (socket says 172.21.15.132:47700) 2024-03-16T17:47:55.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f957f7fe640 1 -- 172.21.15.132:0/3368781239 learned_addr learned my addr 172.21.15.132:0/3368781239 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958014ce30 con 0x7f9580148d90 2024-03-16T17:47:55.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f3fd6288640 1 -- 172.21.15.132:0/1067358788 wait complete. 2024-03-16T17:47:55.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f957e7fc640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9580148d90 0x7f95800b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d88a30640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415b510 0x7f2d841f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.606+0000 7f2d89231640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d8415a120 0x7f2d8415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7f2d89231640 1 -- 172.21.15.132:0/4255748719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415b510 msgr2=0x7f2d841f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7f2d89231640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415b510 0x7f2d841f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7f2d89231640 1 -- 172.21.15.132:0/4255748719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d8415eb30 msgr2=0x7f2d840b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7f2d89231640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d8415eb30 0x7f2d840b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7f2d89231640 1 -- 172.21.15.132:0/4255748719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c009b30 con 0x7f2d8415a120 2024-03-16T17:47:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7f2d89231640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d8415a120 0x7f2d8415c3e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400c390 tx=0x7f2d7400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f2d79ffb640 1 -- 172.21.15.132:0/4255748719 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74005220 con 0x7f2d8415a120 2024-03-16T17:47:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f2d8b495640 1 -- 172.21.15.132:0/4255748719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d84157790 con 0x7f2d8415a120 2024-03-16T17:47:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f2d8b495640 1 -- 172.21.15.132:0/4255748719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d84157d50 con 0x7f2d8415a120 2024-03-16T17:47:55.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.609+0000 7f957effd640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95800cee00 0x7f958014c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.609+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/1543625622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c14005290 con 0x7f6c3415a7f0 2024-03-16T17:47:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.609+0000 7f6c317fa640 1 -- 172.21.15.132:0/1543625622 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f6c2c007070 con 0x7f6c3415a7f0 2024-03-16T17:47:55.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f2d6f7fe640 1 -- 172.21.15.132:0/4255748719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d64005290 con 0x7f2d8415a120 2024-03-16T17:47:55.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f6c317fa640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6c2006b480 0x7f6c2006d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f6c317fa640 1 -- 172.21.15.132:0/1543625622 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c2c089a20 con 0x7f6c3415a7f0 2024-03-16T17:47:55.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f2d79ffb640 1 -- 172.21.15.132:0/4255748719 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74005380 con 0x7f2d8415a120 2024-03-16T17:47:55.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7fd717fff640 1 --2- 172.21.15.132:0/1774289855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd710057480 0x7fd710036db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd71807aae0 tx=0x7fd7180a6800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3907f3078dadad4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f2d79ffb640 1 -- 172.21.15.132:0/4255748719 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d740054f0 con 0x7f2d8415a120 2024-03-16T17:47:55.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f957e7fc640 1 -- 172.21.15.132:0/3368781239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958014c920 msgr2=0x7f95800b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f957e7fc640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958014c920 0x7f95800b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f957e7fc640 1 -- 172.21.15.132:0/3368781239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95800cee00 msgr2=0x7f958014c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f6c388c8640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6c2006b480 0x7f6c2006d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f957e7fc640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95800cee00 0x7f958014c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.610+0000 7f957e7fc640 1 -- 172.21.15.132:0/3368781239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578009a70 con 0x7f9580148d90 2024-03-16T17:47:55.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.611+0000 7f957e7fc640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9580148d90 0x7f95800b0ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f958006ca10 tx=0x7f9578004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.611+0000 7f95677fe640 1 -- 172.21.15.132:0/3368781239 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957803f420 con 0x7f9580148d90 2024-03-16T17:47:55.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.611+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958014d110 con 0x7f9580148d90 2024-03-16T17:47:55.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.611+0000 7f6c388c8640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6c2006b480 0x7f6c2006d940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097a0 tx=0x7f6c2803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.611+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95800ca110 con 0x7f9580148d90 2024-03-16T17:47:55.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7f4e1a5b5640 1 Processor -- start 2024-03-16T17:47:55.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.607+0000 7f4e1a5b5640 1 -- start start 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f4e1a5b5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e14159ff0 0x7f4e140acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f4e1a5b5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1406d3d0 con 0x7f4e1415af00 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f4e1a5b5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1406d6b0 con 0x7f4e140cccd0 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.608+0000 7f4e1a5b5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1415b330 con 0x7f4e14159ff0 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.609+0000 7f4e13fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e14159ff0 0x7f4e140acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.609+0000 7f4e13fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e14159ff0 0x7f4e140acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:54158/0 (socket says 172.21.15.132:54158) 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.609+0000 7f4e13fff640 1 -- 172.21.15.132:0/904966570 learned_addr learned my addr 172.21.15.132:0/904966570 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.609+0000 7f4e13fff640 1 -- 172.21.15.132:0/904966570 >> v1:172.21.15.194:6789/0 conn(0x7f4e140cccd0 legacy=0x7f4e1415a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.609+0000 7f4e13fff640 1 -- 172.21.15.132:0/904966570 >> v1:172.21.15.132:6789/0 conn(0x7f4e1415af00 legacy=0x7f4e1406e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.609+0000 7f4e13fff640 1 -- 172.21.15.132:0/904966570 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1406d990 con 0x7f4e14159ff0 2024-03-16T17:47:55.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.611+0000 7f4e13fff640 1 --2- 172.21.15.132:0/904966570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e14159ff0 0x7f4e140acef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009820 tx=0x7f4e0402b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=813b8de254d3f96e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.611+0000 7f95677fe640 1 -- 172.21.15.132:0/3368781239 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957803f580 con 0x7f9580148d90 2024-03-16T17:47:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.612+0000 7f4e12ffd640 1 -- 172.21.15.132:0/904966570 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04030710 con 0x7f4e14159ff0 2024-03-16T17:47:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.612+0000 7f4e12ffd640 1 -- 172.21.15.132:0/904966570 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0402e050 con 0x7f4e14159ff0 2024-03-16T17:47:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.612+0000 7f4e12ffd640 1 -- 172.21.15.132:0/904966570 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04030a90 con 0x7f4e14159ff0 2024-03-16T17:47:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.612+0000 7f2d79ffb640 1 -- 172.21.15.132:0/4255748719 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f2d74007230 con 0x7f2d8415a120 2024-03-16T17:47:55.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.612+0000 7f2d79ffb640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2d6806b3b0 0x7f2d6806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f95677fe640 1 -- 172.21.15.132:0/3368781239 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957803f910 con 0x7f9580148d90 2024-03-16T17:47:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9560005290 con 0x7f9580148d90 2024-03-16T17:47:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/904966570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e14159ff0 msgr2=0x7f4e140acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f4e1a5b5640 1 --2- 172.21.15.132:0/904966570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e14159ff0 0x7f4e140acef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009820 tx=0x7f4e0402b730 comp rx=0 tx=0).stop 2024-03-16T17:47:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f3fd6288640 1 Processor -- start 2024-03-16T17:47:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f2d88a30640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2d6806b3b0 0x7f2d6806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f2d79ffb640 1 -- 172.21.15.132:0/4255748719 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d740891c0 con 0x7f2d8415a120 2024-03-16T17:47:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f3fd6288640 1 -- start start 2024-03-16T17:47:55.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/904966570 shutdown_connections 2024-03-16T17:47:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f4e1a5b5640 1 --2- 172.21.15.132:0/904966570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e14159ff0 0x7f4e140acef0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.613+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/904966570 >> 172.21.15.132:0/904966570 conn(0x7f4e1406b0c0 msgr2=0x7f4e1406b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f2d88a30640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2d6806b3b0 0x7f2d6806d870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d840ce4c0 tx=0x7f2d80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/904966570 shutdown_connections 2024-03-16T17:47:55.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f3fd6288640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fd00cd3e0 0x7f3fd013e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f95677fe640 1 -- 172.21.15.132:0/3368781239 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f957803faf0 con 0x7f9580148d90 2024-03-16T17:47:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f3fd6288640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fd0159ff0 0x7f3fd01f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f3fd6288640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd015a7f0 0x7f3fd0159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f3fd6288640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0156ea0 con 0x7f3fd015a7f0 2024-03-16T17:47:55.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f3fd6288640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd009be10 con 0x7f3fd0159ff0 2024-03-16T17:47:55.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f3fd6288640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd009c0f0 con 0x7f3fd00cd3e0 2024-03-16T17:47:55.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f9d92abb640 1 Processor -- start 2024-03-16T17:47:55.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f9d92abb640 1 -- start start 2024-03-16T17:47:55.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fd00cd3e0 0x7f3fd013e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f3fcffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fd00cd3e0 0x7f3fd013e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:54178/0 (socket says 172.21.15.132:54178) 2024-03-16T17:47:55.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f3fcffff640 1 -- 172.21.15.132:0/3468621843 learned_addr learned my addr 172.21.15.132:0/3468621843 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f3fcf7fe640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fd0159ff0 0x7f3fd01f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f3fd4825640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd015a7f0 0x7f3fd0159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f6c317fa640 1 -- 172.21.15.132:0/1543625622 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6c2c054710 con 0x7f6c3415a7f0 2024-03-16T17:47:55.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7fd7177fe640 1 -- 172.21.15.132:0/1774289855 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7180ab7d0 con 0x7fd710057480 2024-03-16T17:47:55.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7fd7177fe640 1 -- 172.21.15.132:0/1774289855 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7180a9050 con 0x7fd710057480 2024-03-16T17:47:55.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7fd7177fe640 1 -- 172.21.15.132:0/1774289855 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7180abbf0 con 0x7fd710057480 2024-03-16T17:47:55.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f3fd4825640 1 -- 172.21.15.132:0/3468621843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fd00cd3e0 msgr2=0x7f3fd013e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f3fd4825640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fd00cd3e0 0x7f3fd013e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f3fd4825640 1 -- 172.21.15.132:0/3468621843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fd0159ff0 msgr2=0x7f3fd01f0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f3fd4825640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fd0159ff0 0x7f3fd01f0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f3fd4825640 1 -- 172.21.15.132:0/3468621843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc8009a70 con 0x7f3fd015a7f0 2024-03-16T17:47:55.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f3fd4825640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd015a7f0 0x7f3fd0159520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3fd006dad0 tx=0x7f3fc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f9d92abb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d8c1622c0 0x7f9d8c06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f9d92abb640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9d8c06d870 0x7f9d8c06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f9d92abb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c06af80 con 0x7f9d8c06c560 2024-03-16T17:47:55.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.615+0000 7f9d92abb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8c0b5010 con 0x7f9d8c1622c0 2024-03-16T17:47:55.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f9d92abb640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8c1626a0 con 0x7f9d8c06d870 2024-03-16T17:47:55.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.614+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/904966570 wait complete. 2024-03-16T17:47:55.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f9d90857640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d8c1622c0 0x7f9d8c06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f9d8bfff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9d8c06d870 0x7f9d8c06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f9d90857640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d8c1622c0 0x7f9d8c06eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53828/0 (socket says 172.21.15.132:53828) 2024-03-16T17:47:55.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f9d90857640 1 -- 172.21.15.132:0/2923220701 learned_addr learned my addr 172.21.15.132:0/2923220701 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f4e1a5b5640 1 Processor -- start 2024-03-16T17:47:55.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f9d90857640 1 -- 172.21.15.132:0/2923220701 >> v2:172.21.15.194:3300/0 conn(0x7f9d8c06d870 msgr2=0x7f9d8c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f9d90857640 1 --2- 172.21.15.132:0/2923220701 >> v2:172.21.15.194:3300/0 conn(0x7f9d8c06d870 0x7f9d8c06c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f9d90857640 1 -- 172.21.15.132:0/2923220701 >> v1:172.21.15.132:6789/0 conn(0x7f9d8c06c560 legacy=0x7f9d8c0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f9d90857640 1 -- 172.21.15.132:0/2923220701 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c06b260 con 0x7f9d8c1622c0 2024-03-16T17:47:55.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f9d8bfff640 1 --2- 172.21.15.132:0/2923220701 >> v2:172.21.15.194:3300/0 conn(0x7f9d8c06d870 0x7f9d8c06c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:55.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7fd71dae6640 1 -- 172.21.15.132:0/1774289855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd710057480 msgr2=0x7fd710036db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7fd71dae6640 1 --2- 172.21.15.132:0/1774289855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd710057480 0x7fd710036db0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd71807aae0 tx=0x7fd7180a6800 comp rx=0 tx=0).stop 2024-03-16T17:47:55.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f9d90857640 1 --2- 172.21.15.132:0/2923220701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c1622c0 0x7f9d8c06eac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0b3750 tx=0x7f9d8002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1071eab50c08c9d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.616+0000 7f4e1a5b5640 1 -- start start 2024-03-16T17:47:55.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e1a5b5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e140cccd0 0x7f4e141f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e1a5b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e14159ff0 0x7f4e140c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e1a5b5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e1415af00 0x7f4e141fb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7fd71dae6640 1 -- 172.21.15.132:0/1774289855 shutdown_connections 2024-03-16T17:47:55.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7fd71dae6640 1 --2- 172.21.15.132:0/1774289855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd710057480 0x7fd710036db0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e1a5b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e141f2470 con 0x7f4e14159ff0 2024-03-16T17:47:55.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e1a5b5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e141f9440 con 0x7f4e140cccd0 2024-03-16T17:47:55.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e1a5b5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e141559e0 con 0x7f4e1415af00 2024-03-16T17:47:55.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7fd71dae6640 1 -- 172.21.15.132:0/1774289855 >> 172.21.15.132:0/1774289855 conn(0x7fd710020040 msgr2=0x7fd710056d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e18b52640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e1415af00 0x7f4e141fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e13fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e140cccd0 0x7f4e141f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e18b52640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e1415af00 0x7f4e141fb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:54190/0 (socket says 172.21.15.132:54190) 2024-03-16T17:47:55.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e18b52640 1 -- 172.21.15.132:0/2554160037 learned_addr learned my addr 172.21.15.132:0/2554160037 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.617+0000 7f4e137fe640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e14159ff0 0x7f4e140c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7fd71dae6640 1 -- 172.21.15.132:0/1774289855 shutdown_connections 2024-03-16T17:47:55.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7fd71dae6640 1 -- 172.21.15.132:0/1774289855 wait complete. 2024-03-16T17:47:55.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7f95677fe640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f956c06b430 0x7f956c06d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7f957effd640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f956c06b430 0x7f956c06d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7f4e18b52640 1 -- 172.21.15.132:0/2554160037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e140cccd0 msgr2=0x7f4e141f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7f4e18b52640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e140cccd0 0x7f4e141f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7f4e18b52640 1 -- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e14159ff0 msgr2=0x7f4e140c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7f4e18b52640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e14159ff0 0x7f4e140c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7f4e18b52640 1 -- 172.21.15.132:0/2554160037 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040094d0 con 0x7f4e1415af00 2024-03-16T17:47:55.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7f4e137fe640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e14159ff0 0x7f4e140c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:55.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.618+0000 7f4e18b52640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e1415af00 0x7f4e141fb590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00c7b0 tx=0x7f4e0c00cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.619+0000 7f2d79ffb640 1 -- 172.21.15.132:0/4255748719 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2d74053e90 con 0x7f2d8415a120 2024-03-16T17:47:55.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.619+0000 7f9d8b7fe640 1 -- 172.21.15.132:0/2923220701 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80030860 con 0x7f9d8c1622c0 2024-03-16T17:47:55.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.619+0000 7f3fccff9640 1 -- 172.21.15.132:0/3468621843 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8043ca0 con 0x7f3fd015a7f0 2024-03-16T17:47:55.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.619+0000 7f3fccff9640 1 -- 172.21.15.132:0/3468621843 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc8047070 con 0x7f3fd015a7f0 2024-03-16T17:47:55.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.619+0000 7f9d8b7fe640 1 -- 172.21.15.132:0/2923220701 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d800309c0 con 0x7f9d8c1622c0 2024-03-16T17:47:55.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.619+0000 7f9d8b7fe640 1 -- 172.21.15.132:0/2923220701 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80030d50 con 0x7f9d8c1622c0 2024-03-16T17:47:55.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.619+0000 7f3fd6288640 1 -- 172.21.15.132:0/3468621843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd009c3d0 con 0x7f3fd015a7f0 2024-03-16T17:47:55.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.619+0000 7f3fd6288640 1 -- 172.21.15.132:0/3468621843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd013eb30 con 0x7f3fd015a7f0 2024-03-16T17:47:55.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.619+0000 7f3fccff9640 1 -- 172.21.15.132:0/3468621843 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8009450 con 0x7f3fd015a7f0 2024-03-16T17:47:55.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.620+0000 7f957effd640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f956c06b430 0x7f956c06d8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9574005880 tx=0x7f9574009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.619+0000 7f95677fe640 1 -- 172.21.15.132:0/3368781239 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95780ac6d0 con 0x7f9580148d90 2024-03-16T17:47:55.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.620+0000 7f9d92abb640 1 -- 172.21.15.132:0/2923220701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c1622c0 msgr2=0x7f9d8c06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.620+0000 7f9d92abb640 1 --2- 172.21.15.132:0/2923220701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c1622c0 0x7f9d8c06eac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0b3750 tx=0x7f9d8002b9a0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f9d92abb640 1 -- 172.21.15.132:0/2923220701 shutdown_connections 2024-03-16T17:47:55.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f9d92abb640 1 --2- 172.21.15.132:0/2923220701 >> v2:172.21.15.194:3300/0 conn(0x7f9d8c06d870 0x7f9d8c06c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f9d92abb640 1 --2- 172.21.15.132:0/2923220701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c1622c0 0x7f9d8c06eac0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0b3750 tx=0x7f9d8002b9a0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f9d92abb640 1 -- 172.21.15.132:0/2923220701 >> 172.21.15.132:0/2923220701 conn(0x7f9d8c0b2520 msgr2=0x7f9d8c0b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.620+0000 7fd71dae6640 1 Processor -- start 2024-03-16T17:47:55.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.620+0000 7fd71dae6640 1 -- start start 2024-03-16T17:47:55.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.620+0000 7f95677fe640 1 -- 172.21.15.132:0/3368781239 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f95780774e0 con 0x7f9580148d90 2024-03-16T17:47:55.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f3fd6288640 1 -- 172.21.15.132:0/3468621843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd009bf50 con 0x7f3fd015a7f0 2024-03-16T17:47:55.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f4e10ff9640 1 -- 172.21.15.132:0/2554160037 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c003d80 con 0x7f4e1415af00 2024-03-16T17:47:55.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f4e10ff9640 1 -- 172.21.15.132:0/2554160037 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c005070 con 0x7f4e1415af00 2024-03-16T17:47:55.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f4e10ff9640 1 -- 172.21.15.132:0/2554160037 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c005420 con 0x7f4e1415af00 2024-03-16T17:47:55.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/2554160037 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e14155c80 con 0x7f4e1415af00 2024-03-16T17:47:55.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/2554160037 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e141f90b0 con 0x7f4e1415af00 2024-03-16T17:47:55.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f9d92abb640 1 -- 172.21.15.132:0/2923220701 shutdown_connections 2024-03-16T17:47:55.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.621+0000 7f9d92abb640 1 -- 172.21.15.132:0/2923220701 wait complete. 2024-03-16T17:47:55.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.622+0000 7fd71dae6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd710049fb0 0x7fd71017dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.622+0000 7fd71dae6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd71004a390 0x7fd71004aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.622+0000 7fd71dae6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd710057480 0x7fd71004af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.622+0000 7fd71dae6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71004dbf0 con 0x7fd710049fb0 2024-03-16T17:47:55.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.622+0000 7fd717fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd71004a390 0x7fd71004aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.623+0000 7fd71d2e5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd710057480 0x7fd71004af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.623+0000 7fd71d2e5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd710057480 0x7fd71004af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47722/0 (socket says 172.21.15.132:47722) 2024-03-16T17:47:55.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.623+0000 7fd71d2e5640 1 -- 172.21.15.132:0/2669311972 learned_addr learned my addr 172.21.15.132:0/2669311972 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.623+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/2554160037 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1409e270 con 0x7f4e1415af00 2024-03-16T17:47:55.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.623+0000 7fd71dae6640 1 -- 172.21.15.132:0/2669311972 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710040d60 con 0x7fd710057480 2024-03-16T17:47:55.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.623+0000 7fd71dae6640 1 -- 172.21.15.132:0/2669311972 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71017e520 con 0x7fd71004a390 2024-03-16T17:47:55.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.623+0000 7f9d92abb640 1 Processor -- start 2024-03-16T17:47:55.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.623+0000 7f9d92abb640 1 -- start start 2024-03-16T17:47:55.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.623+0000 7f4e10ff9640 1 -- 172.21.15.132:0/2554160037 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4e0c005580 con 0x7f4e1415af00 2024-03-16T17:47:55.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.624+0000 7f4e10ff9640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4e0006b400 0x7f4e0006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.624+0000 7f4e10ff9640 1 -- 172.21.15.132:0/2554160037 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e0c0893a0 con 0x7f4e1415af00 2024-03-16T17:47:55.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.624+0000 7f4e13fff640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4e0006b400 0x7f4e0006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.624+0000 7fd71cae4640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd710049fb0 0x7fd71017dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f4e13fff640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4e0006b400 0x7f4e0006d8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e04034000 tx=0x7f4e04008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d92abb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c06c560 0x7f9d8c1557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d92abb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d8c06d870 0x7f9d8c14a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d92abb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d8c1577a0 0x7f9d8c15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d92abb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c158190 con 0x7f9d8c06c560 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d92abb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c156730 con 0x7f9d8c1577a0 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d92abb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1590e0 con 0x7f9d8c06d870 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d90857640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c06c560 0x7f9d8c1557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d90857640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c06c560 0x7f9d8c1557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53856/0 (socket says 172.21.15.132:53856) 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d90857640 1 -- 172.21.15.132:0/627529216 learned_addr learned my addr 172.21.15.132:0/627529216 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d91058640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d8c1577a0 0x7f9d8c15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d8bfff640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d8c06d870 0x7f9d8c14a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d90857640 1 -- 172.21.15.132:0/627529216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d8c06d870 msgr2=0x7f9d8c14a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d90857640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d8c06d870 0x7f9d8c14a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d90857640 1 -- 172.21.15.132:0/627529216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d8c1577a0 msgr2=0x7f9d8c15f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d90857640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d8c1577a0 0x7f9d8c15f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.625+0000 7f9d90857640 1 -- 172.21.15.132:0/627529216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800094d0 con 0x7f9d8c06c560 2024-03-16T17:47:55.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.626+0000 7f9d91058640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d8c1577a0 0x7f9d8c15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:55.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.626+0000 7f9d90857640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c06c560 0x7f9d8c1557f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000c00 tx=0x7f9d80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.626+0000 7fd71cae4640 1 -- 172.21.15.132:0/2669311972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd71004a390 msgr2=0x7fd71004aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.626+0000 7fd71cae4640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd71004a390 0x7fd71004aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.626+0000 7fd71cae4640 1 -- 172.21.15.132:0/2669311972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd710057480 msgr2=0x7fd71004af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.626+0000 7fd71cae4640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd710057480 0x7fd71004af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.626+0000 7fd71cae4640 1 -- 172.21.15.132:0/2669311972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd718050140 con 0x7fd710049fb0 2024-03-16T17:47:55.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.626+0000 7fd71cae4640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd710049fb0 0x7fd71017dfe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00c500 tx=0x7fd70c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.627+0000 7f3fccff9640 1 -- 172.21.15.132:0/3468621843 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f3fc80573f0 con 0x7f3fd015a7f0 2024-03-16T17:47:55.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.628+0000 7f3fccff9640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3fbc06b480 0x7f3fbc06d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.628+0000 7f4e10ff9640 1 -- 172.21.15.132:0/2554160037 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4e0c054190 con 0x7f4e1415af00 2024-03-16T17:47:55.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.628+0000 7f3fcffff640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3fbc06b480 0x7f3fbc06d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.629+0000 7f3fccff9640 1 -- 172.21.15.132:0/3468621843 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fc8049070 con 0x7f3fd015a7f0 2024-03-16T17:47:55.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.629+0000 7f3fcffff640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3fbc06b480 0x7f3fbc06d940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4000f60 tx=0x7f3fc4007e10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.632+0000 7f3fccff9640 1 -- 172.21.15.132:0/3468621843 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3fc807f8d0 con 0x7f3fd015a7f0 2024-03-16T17:47:55.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.632+0000 7fd7157fa640 1 -- 172.21.15.132:0/2669311972 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0035f0 con 0x7fd710049fb0 2024-03-16T17:47:55.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.633+0000 7fd7157fa640 1 -- 172.21.15.132:0/2669311972 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c003750 con 0x7fd710049fb0 2024-03-16T17:47:55.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.633+0000 7fd7157fa640 1 -- 172.21.15.132:0/2669311972 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c003b20 con 0x7fd710049fb0 2024-03-16T17:47:55.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.633+0000 7f9d897fa640 1 -- 172.21.15.132:0/627529216 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80047070 con 0x7f9d8c06c560 2024-03-16T17:47:55.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.633+0000 7f9d897fa640 1 -- 172.21.15.132:0/627529216 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80039b60 con 0x7f9d8c06c560 2024-03-16T17:47:55.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.633+0000 7f9d897fa640 1 -- 172.21.15.132:0/627529216 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80043400 con 0x7f9d8c06c560 2024-03-16T17:47:55.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.633+0000 7f9d92abb640 1 -- 172.21.15.132:0/627529216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c155e90 con 0x7f9d8c06c560 2024-03-16T17:47:55.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.633+0000 7f9d92abb640 1 -- 172.21.15.132:0/627529216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c156450 con 0x7f9d8c06c560 2024-03-16T17:47:55.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.633+0000 7fd71dae6640 1 -- 172.21.15.132:0/2669311972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71004cfe0 con 0x7fd710049fb0 2024-03-16T17:47:55.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.633+0000 7fd71dae6640 1 -- 172.21.15.132:0/2669311972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71004d5a0 con 0x7fd710049fb0 2024-03-16T17:47:55.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.634+0000 7f9d92abb640 1 -- 172.21.15.132:0/627529216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c072e20 con 0x7f9d8c06c560 2024-03-16T17:47:55.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.636+0000 7fd702ffd640 1 -- 172.21.15.132:0/2669311972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7100057e0 con 0x7fd710049fb0 2024-03-16T17:47:55.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.638+0000 7fd7157fa640 1 -- 172.21.15.132:0/2669311972 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fd70c003c80 con 0x7fd710049fb0 2024-03-16T17:47:55.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.638+0000 7fd7157fa640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd6fc06b3b0 0x7fd6fc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.638+0000 7fd7157fa640 1 -- 172.21.15.132:0/2669311972 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd70c0891d0 con 0x7fd710049fb0 2024-03-16T17:47:55.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.639+0000 7fd717fff640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd6fc06b3b0 0x7fd6fc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.640+0000 7fd717fff640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd6fc06b3b0 0x7fd6fc06d870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd71000c140 tx=0x7fd71806d030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.637+0000 7f9d897fa640 1 -- 172.21.15.132:0/627529216 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f9d8004c410 con 0x7f9d8c06c560 2024-03-16T17:47:55.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.637+0000 7f9d897fa640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9d7006b4b0 0x7f9d7006d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.637+0000 7f9d897fa640 1 -- 172.21.15.132:0/627529216 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d8003e070 con 0x7f9d8c06c560 2024-03-16T17:47:55.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.640+0000 7f9d8bfff640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9d7006b4b0 0x7f9d7006d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.641+0000 7f9d8bfff640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9d7006b4b0 0x7f9d7006d970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c1574f0 tx=0x7f9d78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.645+0000 7f9d897fa640 1 -- 172.21.15.132:0/627529216 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9d80077830 con 0x7f9d8c06c560 2024-03-16T17:47:55.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.654+0000 7fd7157fa640 1 -- 172.21.15.132:0/2669311972 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd70c053ed0 con 0x7fd710049fb0 2024-03-16T17:47:55.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.698+0000 7fbf6889d640 1 Processor -- start 2024-03-16T17:47:55.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.698+0000 7fbf6889d640 1 -- start start 2024-03-16T17:47:55.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.699+0000 7fbf6889d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbf640ceb90 0x7fbf640cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.700+0000 7fbf6889d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf640c7470 con 0x7fbf640d0190 2024-03-16T17:47:55.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.700+0000 7fbf6889d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf640c7140 con 0x7fbf6415bf90 2024-03-16T17:47:55.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.700+0000 7fbf6259c640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fbf6415bf90 0x7fbf640ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46786/0 (socket says 172.21.15.132:46786) 2024-03-16T17:47:55.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.700+0000 7fbf61d9b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbf640ceb90 0x7fbf640cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.700+0000 7fbf6259c640 1 -- 172.21.15.132:0/2393773837 learned_addr learned my addr 172.21.15.132:0/2393773837 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:55.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.700+0000 7fbf6889d640 1 -- 172.21.15.132:0/2393773837 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf640ce050 con 0x7fbf640ceb90 2024-03-16T17:47:55.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.702+0000 7fbf6159a640 1 -- 172.21.15.132:0/2393773837 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391120032 0 0) 0x7fbf640c7140 con 0x7fbf6415bf90 2024-03-16T17:47:55.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.702+0000 7fbf6159a640 1 -- 172.21.15.132:0/2393773837 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf50003520 con 0x7fbf6415bf90 2024-03-16T17:47:55.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.704+0000 7fbf61d9b640 1 -- 172.21.15.132:0/2393773837 >> v1:172.21.15.194:6789/0 conn(0x7fbf6415bf90 legacy=0x7fbf640ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.704+0000 7fbf61d9b640 1 -- 172.21.15.132:0/2393773837 >> v1:172.21.15.132:6789/0 conn(0x7fbf640d0190 legacy=0x7fbf640d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:55.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.704+0000 7fbf61d9b640 1 -- 172.21.15.132:0/2393773837 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf640c7c80 con 0x7fbf640ceb90 2024-03-16T17:47:55.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.709+0000 7fbf61d9b640 1 --2- 172.21.15.132:0/2393773837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf640ceb90 0x7fbf640cfc50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009d90 tx=0x7fbf5402be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7bb0f9f75147ff8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.713+0000 7fbf6159a640 1 -- 172.21.15.132:0/2393773837 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5402cbf0 con 0x7fbf640ceb90 2024-03-16T17:47:55.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.713+0000 7fbf6159a640 1 -- 172.21.15.132:0/2393773837 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5402cd50 con 0x7fbf640ceb90 2024-03-16T17:47:55.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.713+0000 7fbf6159a640 1 -- 172.21.15.132:0/2393773837 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54034660 con 0x7fbf640ceb90 2024-03-16T17:47:55.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.714+0000 7fbf6889d640 1 -- 172.21.15.132:0/2393773837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf640ceb90 msgr2=0x7fbf640cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.714+0000 7fbf6889d640 1 --2- 172.21.15.132:0/2393773837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf640ceb90 0x7fbf640cfc50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009d90 tx=0x7fbf5402be40 comp rx=0 tx=0).stop 2024-03-16T17:47:55.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.723+0000 7fbf6889d640 1 -- 172.21.15.132:0/2393773837 shutdown_connections 2024-03-16T17:47:55.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.723+0000 7fbf6889d640 1 --2- 172.21.15.132:0/2393773837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf640ceb90 0x7fbf640cfc50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.723+0000 7fbf6889d640 1 -- 172.21.15.132:0/2393773837 >> 172.21.15.132:0/2393773837 conn(0x7fbf640b3810 msgr2=0x7fbf640b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:55.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.727+0000 7fbf6889d640 1 -- 172.21.15.132:0/2393773837 shutdown_connections 2024-03-16T17:47:55.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.731+0000 7fbf6889d640 1 -- 172.21.15.132:0/2393773837 wait complete. 2024-03-16T17:47:55.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.734+0000 7fbf6889d640 1 Processor -- start 2024-03-16T17:47:55.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.742+0000 7fbf6889d640 1 -- start start 2024-03-16T17:47:55.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.743+0000 7fbf6889d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf640ceb90 0x7fbf64148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.743+0000 7fbf6889d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf640d0190 0x7fbf64149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.743+0000 7fbf6889d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf6415bf90 0x7fbf6415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.744+0000 7fbf6889d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6414ada0 con 0x7fbf640d0190 2024-03-16T17:47:55.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.744+0000 7fbf6889d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6414a190 con 0x7fbf6415bf90 2024-03-16T17:47:55.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.744+0000 7fbf6889d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6414a470 con 0x7fbf640ceb90 2024-03-16T17:47:55.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.744+0000 7fbf62d9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf6415bf90 0x7fbf6415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.744+0000 7fbf62d9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf6415bf90 0x7fbf6415ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:47742/0 (socket says 172.21.15.132:47742) 2024-03-16T17:47:55.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.744+0000 7fbf62d9d640 1 -- 172.21.15.132:0/121907086 learned_addr learned my addr 172.21.15.132:0/121907086 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:55.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.747+0000 7fbf61d9b640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf640d0190 0x7fbf64149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.747+0000 7fbf61d9b640 1 -- 172.21.15.132:0/121907086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf640ceb90 msgr2=0x7fbf64148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.747+0000 7fbf61d9b640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf640ceb90 0x7fbf64148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.747+0000 7fbf61d9b640 1 -- 172.21.15.132:0/121907086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf6415bf90 msgr2=0x7fbf6415ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:55.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.747+0000 7fbf61d9b640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf6415bf90 0x7fbf6415ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:55.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.747+0000 7fbf61d9b640 1 -- 172.21.15.132:0/121907086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf54009a70 con 0x7fbf640d0190 2024-03-16T17:47:55.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.748+0000 7fbf61d9b640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf640d0190 0x7fbf64149740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf54033000 tx=0x7fbf54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.755+0000 7fbf5affd640 1 -- 172.21.15.132:0/121907086 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5403f420 con 0x7fbf640d0190 2024-03-16T17:47:55.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.755+0000 7fbf5affd640 1 -- 172.21.15.132:0/121907086 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5403f580 con 0x7fbf640d0190 2024-03-16T17:47:55.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.755+0000 7fbf5affd640 1 -- 172.21.15.132:0/121907086 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5403f930 con 0x7fbf640d0190 2024-03-16T17:47:55.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.757+0000 7fbf6889d640 1 -- 172.21.15.132:0/121907086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6414a750 con 0x7fbf640d0190 2024-03-16T17:47:55.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.757+0000 7fbf6889d640 1 -- 172.21.15.132:0/121907086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf641493a0 con 0x7fbf640d0190 2024-03-16T17:47:55.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.761+0000 7fbf6889d640 1 -- 172.21.15.132:0/121907086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6409fe00 con 0x7fbf640d0190 2024-03-16T17:47:55.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.762+0000 7fbf5affd640 1 -- 172.21.15.132:0/121907086 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fbf5403fa90 con 0x7fbf640d0190 2024-03-16T17:47:55.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.762+0000 7fbf5affd640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbf4406b480 0x7fbf4406d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:55.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.763+0000 7fbf6259c640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbf4406b480 0x7fbf4406d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:55.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.763+0000 7fbf6259c640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbf4406b480 0x7fbf4406d940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0015c0 tx=0x7fbf5c007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:55.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.763+0000 7fbf5affd640 1 -- 172.21.15.132:0/121907086 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf540ac640 con 0x7fbf640d0190 2024-03-16T17:47:55.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:55.773+0000 7fbf5affd640 1 -- 172.21.15.132:0/121907086 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbf54077330 con 0x7fbf640d0190 2024-03-16T17:47:56.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.030+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/1543625622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c14005540 con 0x7f6c3415a7f0 2024-03-16T17:47:56.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.032+0000 7f6c317fa640 1 -- 172.21.15.132:0/1543625622 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c2c057dd0 con 0x7f6c3415a7f0 2024-03-16T17:47:56.047 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-03-16T17:47:56.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.040+0000 7f2d6f7fe640 1 -- 172.21.15.132:0/4255748719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2d64005810 con 0x7f2d8415a120 2024-03-16T17:47:56.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.044+0000 7f2d79ffb640 1 -- 172.21.15.132:0/4255748719 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d74057550 con 0x7f2d8415a120 2024-03-16T17:47:56.048 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-03-16T17:47:56.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.045+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/1543625622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6c2006b480 msgr2=0x7f6c2006d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.045+0000 7f6c3ab2c640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6c2006b480 0x7f6c2006d940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097a0 tx=0x7f6c2803c040 comp rx=0 tx=0).stop 2024-03-16T17:47:56.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.045+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/1543625622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c3415a7f0 msgr2=0x7f6c34139290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.045+0000 7f6c3ab2c640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c3415a7f0 0x7f6c34139290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00ca70 tx=0x7f6c2c00cf30 comp rx=0 tx=0).stop 2024-03-16T17:47:56.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.045+0000 7f3fd6288640 1 -- 172.21.15.132:0/3468621843 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3fd009c610 con 0x7f3fd015a7f0 2024-03-16T17:47:56.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.046+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/1543625622 shutdown_connections 2024-03-16T17:47:56.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.046+0000 7f6c3ab2c640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6c2006b480 0x7f6c2006d940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.046+0000 7f6c3ab2c640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c3415a7f0 0x7f6c34139290 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.046+0000 7f6c3ab2c640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c34072550 0x7f6c34138d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.046+0000 7f6c3ab2c640 1 --2- 172.21.15.132:0/1543625622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c3406b420 0x7f6c341661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.046+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/1543625622 >> 172.21.15.132:0/1543625622 conn(0x7f6c340b28c0 msgr2=0x7f6c3406e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:56.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.046+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/1543625622 shutdown_connections 2024-03-16T17:47:56.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.046+0000 7f6c3ab2c640 1 -- 172.21.15.132:0/1543625622 wait complete. 2024-03-16T17:47:56.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.047+0000 7f3fccff9640 1 -- 172.21.15.132:0/3468621843 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3fd009c610 con 0x7f3fd015a7f0 2024-03-16T17:47:56.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.047+0000 7f2d6f7fe640 1 -- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2d6806b3b0 msgr2=0x7f2d6806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.047+0000 7f2d6f7fe640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2d6806b3b0 0x7f2d6806d870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d840ce4c0 tx=0x7f2d80008040 comp rx=0 tx=0).stop 2024-03-16T17:47:56.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.047+0000 7f2d6f7fe640 1 -- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d8415a120 msgr2=0x7f2d8415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.047+0000 7f2d6f7fe640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d8415a120 0x7f2d8415c3e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400c390 tx=0x7f2d7400c850 comp rx=0 tx=0).stop 2024-03-16T17:47:56.052 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-03-16T17:47:56.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.050+0000 7f2d6f7fe640 1 -- 172.21.15.132:0/4255748719 shutdown_connections 2024-03-16T17:47:56.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.050+0000 7f2d6f7fe640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2d6806b3b0 0x7f2d6806d870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.050+0000 7f2d6f7fe640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d8415eb30 0x7f2d840b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.050+0000 7f2d6f7fe640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d8415b510 0x7f2d841f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.050+0000 7f2d6f7fe640 1 --2- 172.21.15.132:0/4255748719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d8415a120 0x7f2d8415c3e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.050+0000 7f2d6f7fe640 1 -- 172.21.15.132:0/4255748719 >> 172.21.15.132:0/4255748719 conn(0x7f2d840b2520 msgr2=0x7f2d840ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:56.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.050+0000 7f2d6f7fe640 1 -- 172.21.15.132:0/4255748719 shutdown_connections 2024-03-16T17:47:56.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.051+0000 7f2d6f7fe640 1 -- 172.21.15.132:0/4255748719 wait complete. 2024-03-16T17:47:56.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.056+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/2554160037 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4e141f9580 con 0x7f4e1415af00 2024-03-16T17:47:56.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.056+0000 7f9d92abb640 1 -- 172.21.15.132:0/627529216 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9d8c04f330 con 0x7f9d8c06c560 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 -- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3fbc06b480 msgr2=0x7f3fbc06d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3fbc06b480 0x7f3fbc06d940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4000f60 tx=0x7f3fc4007e10 comp rx=0 tx=0).stop 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 -- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd015a7f0 msgr2=0x7f3fd0159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd015a7f0 0x7f3fd0159520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3fd006dad0 tx=0x7f3fc8004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 -- 172.21.15.132:0/3468621843 shutdown_connections 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3fbc06b480 0x7f3fbc06d940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd015a7f0 0x7f3fd0159520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3fd0159ff0 0x7f3fd01f0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 --2- 172.21.15.132:0/3468621843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3fd00cd3e0 0x7f3fd013e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 -- 172.21.15.132:0/3468621843 >> 172.21.15.132:0/3468621843 conn(0x7f3fd006b0c0 msgr2=0x7f3fd00ad4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:56.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 -- 172.21.15.132:0/3468621843 shutdown_connections 2024-03-16T17:47:56.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f9d897fa640 1 -- 172.21.15.132:0/627529216 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d8007aef0 con 0x7f9d8c06c560 2024-03-16T17:47:56.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.057+0000 7f3fd6288640 1 -- 172.21.15.132:0/3468621843 wait complete. 2024-03-16T17:47:56.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.058+0000 7f4e10ff9640 1 -- 172.21.15.132:0/2554160037 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e0c017020 con 0x7f4e1415af00 2024-03-16T17:47:56.063 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-03-16T17:47:56.064 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.064+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4e0006b400 msgr2=0x7f4e0006d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.064+0000 7f4e1a5b5640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4e0006b400 0x7f4e0006d8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4e04034000 tx=0x7f4e04008030 comp rx=0 tx=0).stop 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.064+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/2554160037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e1415af00 msgr2=0x7f4e141fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.064+0000 7f4e1a5b5640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e1415af00 0x7f4e141fb590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00c7b0 tx=0x7f4e0c00cc70 comp rx=0 tx=0).stop 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/2554160037 shutdown_connections 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f4e1a5b5640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4e0006b400 0x7f4e0006d8c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f4e1a5b5640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e1415af00 0x7f4e141fb590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f4e1a5b5640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e14159ff0 0x7f4e140c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f4e1a5b5640 1 --2- 172.21.15.132:0/2554160037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e140cccd0 0x7f4e141f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/2554160037 >> 172.21.15.132:0/2554160037 conn(0x7f4e1406b0c0 msgr2=0x7f4e140b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:56.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/2554160037 shutdown_connections 2024-03-16T17:47:56.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f9d92abb640 1 -- 172.21.15.132:0/627529216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9d7006b4b0 msgr2=0x7f9d7006d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f4e1a5b5640 1 -- 172.21.15.132:0/2554160037 wait complete. 2024-03-16T17:47:56.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f9d92abb640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9d7006b4b0 0x7f9d7006d970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c1574f0 tx=0x7f9d78008040 comp rx=0 tx=0).stop 2024-03-16T17:47:56.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f9d92abb640 1 -- 172.21.15.132:0/627529216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c06c560 msgr2=0x7f9d8c1557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f9d92abb640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c06c560 0x7f9d8c1557f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000c00 tx=0x7f9d80004730 comp rx=0 tx=0).stop 2024-03-16T17:47:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f9d92abb640 1 -- 172.21.15.132:0/627529216 shutdown_connections 2024-03-16T17:47:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f9d92abb640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9d7006b4b0 0x7f9d7006d970 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f9d92abb640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d8c1577a0 0x7f9d8c15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f9d92abb640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9d8c06d870 0x7f9d8c14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f9d92abb640 1 --2- 172.21.15.132:0/627529216 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8c06c560 0x7f9d8c1557f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.065+0000 7f9d92abb640 1 -- 172.21.15.132:0/627529216 >> 172.21.15.132:0/627529216 conn(0x7f9d8c0b2520 msgr2=0x7f9d8c0b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.066+0000 7f9d92abb640 1 -- 172.21.15.132:0/627529216 shutdown_connections 2024-03-16T17:47:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.066+0000 7f9d92abb640 1 -- 172.21.15.132:0/627529216 wait complete. 2024-03-16T17:47:56.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-03-16T17:47:56.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-03-16T17:47:56.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-03-16T17:47:56.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.081+0000 7fd702ffd640 1 -- 172.21.15.132:0/2669311972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd7100e6a00 con 0x7fd710049fb0 2024-03-16T17:47:56.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.081+0000 7fd7157fa640 1 -- 172.21.15.132:0/2669311972 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd70c057590 con 0x7fd710049fb0 2024-03-16T17:47:56.085 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:56.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-03-16T17:47:56.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.083+0000 7fd702ffd640 1 -- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd6fc06b3b0 msgr2=0x7fd6fc06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.083+0000 7fd702ffd640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd6fc06b3b0 0x7fd6fc06d870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd71000c140 tx=0x7fd71806d030 comp rx=0 tx=0).stop 2024-03-16T17:47:56.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.083+0000 7fd702ffd640 1 -- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd710049fb0 msgr2=0x7fd71017dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.083+0000 7fd702ffd640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd710049fb0 0x7fd71017dfe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00c500 tx=0x7fd70c00c9c0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.084+0000 7fd702ffd640 1 -- 172.21.15.132:0/2669311972 shutdown_connections 2024-03-16T17:47:56.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.084+0000 7fd702ffd640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd6fc06b3b0 0x7fd6fc06d870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.084+0000 7fd702ffd640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd710057480 0x7fd71004af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.084+0000 7fd702ffd640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd71004a390 0x7fd71004aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.084+0000 7fd702ffd640 1 --2- 172.21.15.132:0/2669311972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd710049fb0 0x7fd71017dfe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.084+0000 7fd702ffd640 1 -- 172.21.15.132:0/2669311972 >> 172.21.15.132:0/2669311972 conn(0x7fd710020040 msgr2=0x7fd710054860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:56.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.084+0000 7fd702ffd640 1 -- 172.21.15.132:0/2669311972 shutdown_connections 2024-03-16T17:47:56.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.084+0000 7fd702ffd640 1 -- 172.21.15.132:0/2669311972 wait complete. 2024-03-16T17:47:56.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-03-16T17:47:56.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-03-16T17:47:56.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.110+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9560005540 con 0x7f9580148d90 2024-03-16T17:47:56.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.110+0000 7f95677fe640 1 -- 172.21.15.132:0/3368781239 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f957807aba0 con 0x7f9580148d90 2024-03-16T17:47:56.114 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-03-16T17:47:56.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f956c06b430 msgr2=0x7f956c06d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f956c06b430 0x7f956c06d8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9574005880 tx=0x7f9574009040 comp rx=0 tx=0).stop 2024-03-16T17:47:56.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9580148d90 msgr2=0x7f95800b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9580148d90 0x7f95800b0ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f958006ca10 tx=0x7f9578004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:56.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 shutdown_connections 2024-03-16T17:47:56.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f956c06b430 0x7f956c06d8f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958014c920 0x7f95800b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9580148d90 0x7f95800b0ce0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 --2- 172.21.15.132:0/3368781239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95800cee00 0x7f958014c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 >> 172.21.15.132:0/3368781239 conn(0x7f958006aee0 msgr2=0x7f95800b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:56.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 shutdown_connections 2024-03-16T17:47:56.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.113+0000 7f958531e640 1 -- 172.21.15.132:0/3368781239 wait complete. 2024-03-16T17:47:56.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-03-16T17:47:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.240+0000 7fbf6889d640 1 -- 172.21.15.132:0/121907086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbf6415a350 con 0x7fbf640d0190 2024-03-16T17:47:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.240+0000 7fbf5affd640 1 -- 172.21.15.132:0/121907086 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf54043020 con 0x7fbf640d0190 2024-03-16T17:47:56.244 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.242+0000 7fbf6889d640 1 -- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbf4406b480 msgr2=0x7fbf4406d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbf4406b480 0x7fbf4406d940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0015c0 tx=0x7fbf5c007930 comp rx=0 tx=0).stop 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 -- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf640d0190 msgr2=0x7fbf64149740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf640d0190 0x7fbf64149740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf54033000 tx=0x7fbf54004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 -- 172.21.15.132:0/121907086 shutdown_connections 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbf4406b480 0x7fbf4406d940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf6415bf90 0x7fbf6415ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf640d0190 0x7fbf64149740 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 --2- 172.21.15.132:0/121907086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf640ceb90 0x7fbf64148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 -- 172.21.15.132:0/121907086 >> 172.21.15.132:0/121907086 conn(0x7fbf640b3810 msgr2=0x7fbf640b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 -- 172.21.15.132:0/121907086 shutdown_connections 2024-03-16T17:47:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:56.243+0000 7fbf6889d640 1 -- 172.21.15.132:0/121907086 wait complete. 2024-03-16T17:47:56.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-03-16T17:47:57.074 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-16T17:47:57.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-16T17:47:57.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-16T17:47:57.088 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-16T17:47:57.091 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-16T17:47:57.099 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-16T17:47:57.132 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-16T17:47:57.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.210+0000 7fed5b1c9640 1 Processor -- start 2024-03-16T17:47:57.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.210+0000 7fed5b1c9640 1 -- start start 2024-03-16T17:47:57.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.211+0000 7fed5b1c9640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fed5415bda0 0x7fed540d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.211+0000 7fed5b1c9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5415c180 0x7fed540d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.211+0000 7fed5b1c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed54070080 0x7fed540d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.211+0000 7fed5b1c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed540aef00 con 0x7fed54070080 2024-03-16T17:47:57.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.211+0000 7fed5b1c9640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed54070640 con 0x7fed5415bda0 2024-03-16T17:47:57.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.211+0000 7fed5b1c9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed54070920 con 0x7fed5415c180 2024-03-16T17:47:57.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.211+0000 7fed59766640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed54070080 0x7fed540d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.211+0000 7fed59766640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed54070080 0x7fed540d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38586/0 (socket says 172.21.15.132:38586) 2024-03-16T17:47:57.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.211+0000 7fed59766640 1 -- 172.21.15.132:0/133351364 learned_addr learned my addr 172.21.15.132:0/133351364 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.212+0000 7fed59766640 1 -- 172.21.15.132:0/133351364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5415c180 msgr2=0x7fed540d1be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T17:47:57.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.212+0000 7fed59766640 1 --2- 172.21.15.132:0/133351364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5415c180 0x7fed540d1be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.212+0000 7fed59766640 1 -- 172.21.15.132:0/133351364 >> v2:172.21.15.194:3300/0 conn(0x7fed5415bda0 msgr2=0x7fed540d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.212+0000 7fed58f65640 1 --2- 172.21.15.132:0/133351364 >> v2:172.21.15.194:3300/0 conn(0x7fed5415bda0 0x7fed540d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.213+0000 7fed59766640 1 --2- 172.21.15.132:0/133351364 >> v2:172.21.15.194:3300/0 conn(0x7fed5415bda0 0x7fed540d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.213+0000 7fed59766640 1 -- 172.21.15.132:0/133351364 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540aeb90 con 0x7fed54070080 2024-03-16T17:47:57.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.213+0000 7fed58f65640 1 --2- 172.21.15.132:0/133351364 >> v2:172.21.15.194:3300/0 conn(0x7fed5415bda0 0x7fed540d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:57.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.214+0000 7fed59766640 1 --2- 172.21.15.132:0/133351364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54070080 0x7fed540d2120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fed54067ae0 tx=0x7fed4402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb00f5682c070d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.214+0000 7fed537fe640 1 -- 172.21.15.132:0/133351364 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44031870 con 0x7fed54070080 2024-03-16T17:47:57.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.215+0000 7fed537fe640 1 -- 172.21.15.132:0/133351364 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed440319d0 con 0x7fed54070080 2024-03-16T17:47:57.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.215+0000 7fa277483640 1 Processor -- start 2024-03-16T17:47:57.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.216+0000 7fed5b1c9640 1 -- 172.21.15.132:0/133351364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54070080 msgr2=0x7fed540d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.216+0000 7fed5b1c9640 1 --2- 172.21.15.132:0/133351364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54070080 0x7fed540d2120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fed54067ae0 tx=0x7fed4402b910 comp rx=0 tx=0).stop 2024-03-16T17:47:57.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.215+0000 7fa277483640 1 -- start start 2024-03-16T17:47:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.216+0000 7fed5b1c9640 1 -- 172.21.15.132:0/133351364 shutdown_connections 2024-03-16T17:47:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.216+0000 7fed5b1c9640 1 --2- 172.21.15.132:0/133351364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed54070080 0x7fed540d2120 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.216+0000 7fed5b1c9640 1 --2- 172.21.15.132:0/133351364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5415c180 0x7fed540d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.216+0000 7fed5b1c9640 1 --2- 172.21.15.132:0/133351364 >> v2:172.21.15.194:3300/0 conn(0x7fed5415bda0 0x7fed540d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.216+0000 7fed5b1c9640 1 -- 172.21.15.132:0/133351364 >> 172.21.15.132:0/133351364 conn(0x7fed5409aa70 msgr2=0x7fed5409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fed5b1c9640 1 -- 172.21.15.132:0/133351364 shutdown_connections 2024-03-16T17:47:57.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa277483640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa2700b2bb0 0x7fa2700b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa277483640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2700cdf10 0x7fa2700b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa277483640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2700b34d0 con 0x7fa270070ba0 2024-03-16T17:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa277483640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27014bfc0 con 0x7fa2700b2bb0 2024-03-16T17:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa277483640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27006cda0 con 0x7fa2700cdf10 2024-03-16T17:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa275a20640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa270070ba0 0x7fa27006de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46416/0 (socket says 172.21.15.132:46416) 2024-03-16T17:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa275a20640 1 -- 172.21.15.132:0/2752104272 learned_addr learned my addr 172.21.15.132:0/2752104272 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa27521f640 1 --2- 172.21.15.132:0/2752104272 >> v2:172.21.15.194:3300/0 conn(0x7fa2700b2bb0 0x7fa2700b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa274a1e640 1 --2- 172.21.15.132:0/2752104272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2700cdf10 0x7fa2700b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fed5b1c9640 1 -- 172.21.15.132:0/133351364 wait complete. 2024-03-16T17:47:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.219+0000 7fed5b1c9640 1 Processor -- start 2024-03-16T17:47:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa267fff640 1 -- 172.21.15.132:0/2752104272 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485891940 0 0) 0x7fa2700b34d0 con 0x7fa270070ba0 2024-03-16T17:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.217+0000 7fa267fff640 1 -- 172.21.15.132:0/2752104272 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa25c003520 con 0x7fa270070ba0 2024-03-16T17:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.218+0000 7fa27521f640 1 -- 172.21.15.132:0/2752104272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2700cdf10 msgr2=0x7fa2700b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.218+0000 7fa27521f640 1 --2- 172.21.15.132:0/2752104272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2700cdf10 0x7fa2700b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.218+0000 7fa27521f640 1 -- 172.21.15.132:0/2752104272 >> v1:172.21.15.194:6789/0 conn(0x7fa270070ba0 legacy=0x7fa27006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.219+0000 7fed5b1c9640 1 -- start start 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.218+0000 7fa27521f640 1 -- 172.21.15.132:0/2752104272 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27006d080 con 0x7fa2700b2bb0 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.219+0000 7fa274a1e640 1 --2- 172.21.15.132:0/2752104272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2700cdf10 0x7fa2700b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.219+0000 7fa27521f640 1 --2- 172.21.15.132:0/2752104272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2700b2bb0 0x7fa2700b4aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0097a0 tx=0x7fa26c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebfe8fb3fb226a3d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.219+0000 7fa267fff640 1 -- 172.21.15.132:0/2752104272 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c02e070 con 0x7fa2700b2bb0 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.219+0000 7fa267fff640 1 -- 172.21.15.132:0/2752104272 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c0315a0 con 0x7fa2700b2bb0 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.219+0000 7fa267fff640 1 -- 172.21.15.132:0/2752104272 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c031950 con 0x7fa2700b2bb0 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fa277483640 1 -- 172.21.15.132:0/2752104272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2700b2bb0 msgr2=0x7fa2700b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fa277483640 1 --2- 172.21.15.132:0/2752104272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2700b2bb0 0x7fa2700b4aa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0097a0 tx=0x7fa26c02b840 comp rx=0 tx=0).stop 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fa277483640 1 -- 172.21.15.132:0/2752104272 shutdown_connections 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fa277483640 1 --2- 172.21.15.132:0/2752104272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2700cdf10 0x7fa2700b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fa277483640 1 --2- 172.21.15.132:0/2752104272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2700b2bb0 0x7fa2700b4aa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fa277483640 1 -- 172.21.15.132:0/2752104272 >> 172.21.15.132:0/2752104272 conn(0x7fa27006aee0 msgr2=0x7fa27006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fa277483640 1 -- 172.21.15.132:0/2752104272 shutdown_connections 2024-03-16T17:47:57.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fa277483640 1 -- 172.21.15.132:0/2752104272 wait complete. 2024-03-16T17:47:57.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fed5b1c9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed54070080 0x7fed5406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fed5b1c9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5415bda0 0x7fed540c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.220+0000 7fed5b1c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5415c180 0x7fed542033f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.221+0000 7fed5b1c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540cd060 con 0x7fed5415c180 2024-03-16T17:47:57.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.221+0000 7fed53fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5415bda0 0x7fed540c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.221+0000 7fed53fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5415bda0 0x7fed540c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:49860/0 (socket says 172.21.15.132:49860) 2024-03-16T17:47:57.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.221+0000 7fed53fff640 1 -- 172.21.15.132:0/1154268094 learned_addr learned my addr 172.21.15.132:0/1154268094 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.221+0000 7fed59766640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5415c180 0x7fed542033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.221+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540b0950 con 0x7fed54070080 2024-03-16T17:47:57.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.221+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed540cd2b0 con 0x7fed5415bda0 2024-03-16T17:47:57.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.221+0000 7fed58f65640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed54070080 0x7fed5406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.222+0000 7fed58f65640 1 -- 172.21.15.132:0/1154268094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5415bda0 msgr2=0x7fed540c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.222+0000 7fed58f65640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5415bda0 0x7fed540c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.222+0000 7fed58f65640 1 -- 172.21.15.132:0/1154268094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5415c180 msgr2=0x7fed542033f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.222+0000 7fed58f65640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5415c180 0x7fed542033f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.222+0000 7fed58f65640 1 -- 172.21.15.132:0/1154268094 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed440094d0 con 0x7fed54070080 2024-03-16T17:47:57.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.222+0000 7fa277483640 1 Processor -- start 2024-03-16T17:47:57.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.222+0000 7fed59766640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5415c180 0x7fed542033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:57.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.223+0000 7fed58f65640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed54070080 0x7fed5406d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00cec0 tx=0x7fed4c00a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.223+0000 7fed517fa640 1 -- 172.21.15.132:0/1154268094 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00d840 con 0x7fed54070080 2024-03-16T17:47:57.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.223+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed540cd590 con 0x7fed54070080 2024-03-16T17:47:57.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.223+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed540cdb50 con 0x7fed54070080 2024-03-16T17:47:57.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.224+0000 7fed517fa640 1 -- 172.21.15.132:0/1154268094 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c00d9a0 con 0x7fed54070080 2024-03-16T17:47:57.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.224+0000 7fed517fa640 1 -- 172.21.15.132:0/1154268094 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00dd10 con 0x7fed54070080 2024-03-16T17:47:57.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.222+0000 7fa277483640 1 -- start start 2024-03-16T17:47:57.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.224+0000 7fa277483640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa270070ba0 0x7fa270165210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.224+0000 7fa277483640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2700b2bb0 0x7fa27006dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.226+0000 7fed517fa640 1 -- 172.21.15.132:0/1154268094 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fed4c015440 con 0x7fed54070080 2024-03-16T17:47:57.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.224+0000 7fa27521f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa270070ba0 0x7fa270165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.224+0000 7fa27521f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa270070ba0 0x7fa270165210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:49866/0 (socket says 172.21.15.132:49866) 2024-03-16T17:47:57.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.225+0000 7fa27521f640 1 -- 172.21.15.132:0/1342725814 learned_addr learned my addr 172.21.15.132:0/1342725814 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.225+0000 7fa277483640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2700cdf10 0x7fa270161980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.225+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2700aca10 con 0x7fa2700b2bb0 2024-03-16T17:47:57.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.225+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2700accf0 con 0x7fa2700cdf10 2024-03-16T17:47:57.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.225+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2700acfd0 con 0x7fa270070ba0 2024-03-16T17:47:57.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fed517fa640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed4006b480 0x7fed4006d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.226+0000 7fa274a1e640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2700b2bb0 0x7fa27006dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fa275a20640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2700cdf10 0x7fa270161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fa27521f640 1 -- 172.21.15.132:0/1342725814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2700cdf10 msgr2=0x7fa270161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fa27521f640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2700cdf10 0x7fa270161980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fed517fa640 1 -- 172.21.15.132:0/1154268094 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed4c08a4f0 con 0x7fed54070080 2024-03-16T17:47:57.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fed53fff640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed4006b480 0x7fed4006d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fa27521f640 1 -- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2700b2bb0 msgr2=0x7fa27006dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fa27521f640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2700b2bb0 0x7fa27006dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fa27521f640 1 -- 172.21.15.132:0/1342725814 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c009400 con 0x7fa270070ba0 2024-03-16T17:47:57.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fa274a1e640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2700b2bb0 0x7fa27006dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:57.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.227+0000 7fa275a20640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2700cdf10 0x7fa270161980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:57.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.228+0000 7fed53fff640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed4006b480 0x7fed4006d940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed540b2b10 tx=0x7fed48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.228+0000 7fa27521f640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa270070ba0 0x7fa270165210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa26c034040 tx=0x7fa26c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.228+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed34005290 con 0x7fed54070080 2024-03-16T17:47:57.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.229+0000 7fa265ffb640 1 -- 172.21.15.132:0/1342725814 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c003810 con 0x7fa270070ba0 2024-03-16T17:47:57.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.229+0000 7fa265ffb640 1 -- 172.21.15.132:0/1342725814 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c040070 con 0x7fa270070ba0 2024-03-16T17:47:57.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.230+0000 7fa265ffb640 1 -- 172.21.15.132:0/1342725814 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c003b90 con 0x7fa270070ba0 2024-03-16T17:47:57.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.230+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2700a9570 con 0x7fa270070ba0 2024-03-16T17:47:57.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.230+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27013ce00 con 0x7fa270070ba0 2024-03-16T17:47:57.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.232+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2700a9790 con 0x7fa270070ba0 2024-03-16T17:47:57.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.234+0000 7fed517fa640 1 -- 172.21.15.132:0/1154268094 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fed4c0551e0 con 0x7fed54070080 2024-03-16T17:47:57.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.238+0000 7fa265ffb640 1 -- 172.21.15.132:0/1342725814 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fa26c003cf0 con 0x7fa270070ba0 2024-03-16T17:47:57.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.239+0000 7fa265ffb640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa25406b3b0 0x7fa25406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.239+0000 7fa265ffb640 1 -- 172.21.15.132:0/1342725814 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa26c042070 con 0x7fa270070ba0 2024-03-16T17:47:57.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.240+0000 7fa274a1e640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa25406b3b0 0x7fa25406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.241+0000 7fa274a1e640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa25406b3b0 0x7fa25406d870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa2700b0ab0 tx=0x7fa260008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.245+0000 7fa265ffb640 1 -- 172.21.15.132:0/1342725814 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa26c076af0 con 0x7fa270070ba0 2024-03-16T17:47:57.258 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-16T17:47:57.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.275+0000 7fc7e759e640 1 Processor -- start 2024-03-16T17:47:57.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.275+0000 7fc7e759e640 1 -- start start 2024-03-16T17:47:57.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.276+0000 7fc7e759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7e00e7870 0x7fc7e0050430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.276+0000 7fc7e759e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00539c0 con 0x7fc7e00e7490 2024-03-16T17:47:57.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.276+0000 7fc7e759e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e00510b0 con 0x7fc7e00071d0 2024-03-16T17:47:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.276+0000 7fc7e759e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e0051390 con 0x7fc7e00e7870 2024-03-16T17:47:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.276+0000 7fc7e659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc7e00e7490 0x7fc7e0006ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45786/0 (socket says 172.21.15.132:45786) 2024-03-16T17:47:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.276+0000 7fc7e659c640 1 -- 172.21.15.132:0/2932616401 learned_addr learned my addr 172.21.15.132:0/2932616401 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.277+0000 7fc7e5d9b640 1 --2- 172.21.15.132:0/2932616401 >> v2:172.21.15.132:3300/0 conn(0x7fc7e00e7870 0x7fc7e0050430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.278+0000 7fc7e5d9b640 1 -- 172.21.15.132:0/2932616401 >> v1:172.21.15.194:6789/0 conn(0x7fc7e00071d0 legacy=0x7fc7e0053e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.278+0000 7fc7e5d9b640 1 -- 172.21.15.132:0/2932616401 >> v1:172.21.15.132:6789/0 conn(0x7fc7e00e7490 legacy=0x7fc7e0006ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.278+0000 7fc7e5d9b640 1 -- 172.21.15.132:0/2932616401 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0051670 con 0x7fc7e00e7870 2024-03-16T17:47:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.279+0000 7fc7e5d9b640 1 --2- 172.21.15.132:0/2932616401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7e00e7870 0x7fc7e0050430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009a00 tx=0x7fc7d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6419d01da4f6eff3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.280+0000 7fc7e559a640 1 -- 172.21.15.132:0/2932616401 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8032640 con 0x7fc7e00e7870 2024-03-16T17:47:57.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.281+0000 7fc7e559a640 1 -- 172.21.15.132:0/2932616401 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d802e070 con 0x7fc7e00e7870 2024-03-16T17:47:57.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.281+0000 7fc7e559a640 1 -- 172.21.15.132:0/2932616401 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d80329c0 con 0x7fc7e00e7870 2024-03-16T17:47:57.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.282+0000 7fc7e759e640 1 -- 172.21.15.132:0/2932616401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7e00e7870 msgr2=0x7fc7e0050430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.282+0000 7fc7e759e640 1 --2- 172.21.15.132:0/2932616401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7e00e7870 0x7fc7e0050430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009a00 tx=0x7fc7d802b8d0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.282+0000 7fc7e759e640 1 -- 172.21.15.132:0/2932616401 shutdown_connections 2024-03-16T17:47:57.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.282+0000 7fc7e759e640 1 --2- 172.21.15.132:0/2932616401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7e00e7870 0x7fc7e0050430 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.282+0000 7fc7e759e640 1 -- 172.21.15.132:0/2932616401 >> 172.21.15.132:0/2932616401 conn(0x7fc7e0055bc0 msgr2=0x7fc7e0055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.282+0000 7fc7e759e640 1 -- 172.21.15.132:0/2932616401 shutdown_connections 2024-03-16T17:47:57.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.282+0000 7fc7e759e640 1 -- 172.21.15.132:0/2932616401 wait complete. 2024-03-16T17:47:57.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.282+0000 7f093f215640 1 Processor -- start 2024-03-16T17:47:57.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.282+0000 7f093f215640 1 -- start start 2024-03-16T17:47:57.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.283+0000 7f093f215640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f09380d0670 0x7f09380b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7fc7e759e640 1 Processor -- start 2024-03-16T17:47:57.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7f093f215640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380722c0 0x7f093806e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7f093f215640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093806d930 con 0x7f09380b4a60 2024-03-16T17:47:57.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7f093f215640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09380b4f70 con 0x7f09380d0670 2024-03-16T17:47:57.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7f093d7b2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380722c0 0x7f093806e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7f093d7b2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380722c0 0x7f093806e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:49868/0 (socket says 172.21.15.132:49868) 2024-03-16T17:47:57.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7f093d7b2640 1 -- 172.21.15.132:0/1334037884 learned_addr learned my addr 172.21.15.132:0/1334037884 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7f093f215640 1 -- 172.21.15.132:0/1334037884 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09380b5250 con 0x7f09380722c0 2024-03-16T17:47:57.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7f093cfb1640 1 --2- 172.21.15.132:0/1334037884 >> v2:172.21.15.194:3300/0 conn(0x7f09380d0670 0x7f09380b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.285+0000 7fb2169b6640 1 Processor -- start 2024-03-16T17:47:57.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7f09377fe640 1 -- 172.21.15.132:0/1334037884 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126095580 0 0) 0x7f093806d930 con 0x7f09380b4a60 2024-03-16T17:47:57.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.284+0000 7f09377fe640 1 -- 172.21.15.132:0/1334037884 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0920005730 con 0x7f09380b4a60 2024-03-16T17:47:57.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.285+0000 7f093d7b2640 1 -- 172.21.15.132:0/1334037884 >> v2:172.21.15.194:3300/0 conn(0x7f09380d0670 msgr2=0x7f09380b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.285+0000 7f093d7b2640 1 --2- 172.21.15.132:0/1334037884 >> v2:172.21.15.194:3300/0 conn(0x7f09380d0670 0x7f09380b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.285+0000 7f093d7b2640 1 -- 172.21.15.132:0/1334037884 >> v1:172.21.15.194:6789/0 conn(0x7f09380b4a60 legacy=0x7f0938071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.285+0000 7f093d7b2640 1 -- 172.21.15.132:0/1334037884 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093806db80 con 0x7f09380722c0 2024-03-16T17:47:57.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.285+0000 7f09377fe640 1 -- 172.21.15.132:0/1334037884 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3706330263 0 0) 0x7f0920005730 con 0x7f09380b4a60 2024-03-16T17:47:57.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.286+0000 7f093d7b2640 1 --2- 172.21.15.132:0/1334037884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380722c0 0x7f093806e380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f092c00f9b0 tx=0x7f092c034080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e5bfb6c583f93a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.286+0000 7f09377fe640 1 -- 172.21.15.132:0/1334037884 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09300019f0 con 0x7f09380722c0 2024-03-16T17:47:57.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.285+0000 7fb2169b6640 1 -- start start 2024-03-16T17:47:57.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7f09377fe640 1 -- 172.21.15.132:0/1334037884 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c034bb0 con 0x7f09380722c0 2024-03-16T17:47:57.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7f09377fe640 1 -- 172.21.15.132:0/1334037884 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c03c440 con 0x7f09380722c0 2024-03-16T17:47:57.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7fb2169b6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb2101622c0 0x7fb21006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7fb2169b6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb21006d870 0x7fb21006c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7fb2169b6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21006af80 con 0x7fb21006c560 2024-03-16T17:47:57.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7fb2169b6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2100b5010 con 0x7fb21006d870 2024-03-16T17:47:57.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7fb2169b6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2101626a0 con 0x7fb2101622c0 2024-03-16T17:47:57.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7fb214f53640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fb21006c560 0x7fb2100b40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46426/0 (socket says 172.21.15.132:46426) 2024-03-16T17:47:57.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7fb214f53640 1 -- 172.21.15.132:0/1642999234 learned_addr learned my addr 172.21.15.132:0/1642999234 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:57.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fb20ffff640 1 --2- 172.21.15.132:0/1642999234 >> v2:172.21.15.194:3300/0 conn(0x7fb2101622c0 0x7fb21006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7f093f215640 1 -- 172.21.15.132:0/1334037884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380722c0 msgr2=0x7f093806e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7f093f215640 1 --2- 172.21.15.132:0/1334037884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380722c0 0x7f093806e380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f092c00f9b0 tx=0x7f092c034080 comp rx=0 tx=0).stop 2024-03-16T17:47:57.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7fbd7ea6b640 1 Processor -- start 2024-03-16T17:47:57.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.287+0000 7fc7e759e640 1 -- start start 2024-03-16T17:47:57.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e759e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7e00071d0 0x7fc7e00ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7e00e7490 0x7fc7e00cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e759e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00e7870 0x7fc7e00e5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e759e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00caf00 con 0x7fc7e00e7490 2024-03-16T17:47:57.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e759e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00e6cf0 con 0x7fc7e00e7870 2024-03-16T17:47:57.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e759e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e00cced0 con 0x7fc7e00071d0 2024-03-16T17:47:57.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e659c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7e00071d0 0x7fc7e00ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fb20effd640 1 -- 172.21.15.132:0/1642999234 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269554333 0 0) 0x7fb21006af80 con 0x7fb21006c560 2024-03-16T17:47:57.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fb20f7fe640 1 --2- 172.21.15.132:0/1642999234 >> v2:172.21.15.132:3300/0 conn(0x7fb21006d870 0x7fb21006c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7f093f215640 1 -- 172.21.15.132:0/1334037884 shutdown_connections 2024-03-16T17:47:57.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7f093f215640 1 --2- 172.21.15.132:0/1334037884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380722c0 0x7f093806e380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7f093f215640 1 --2- 172.21.15.132:0/1334037884 >> v2:172.21.15.194:3300/0 conn(0x7f09380d0670 0x7f09380b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7f093f215640 1 -- 172.21.15.132:0/1334037884 >> 172.21.15.132:0/1334037884 conn(0x7f09380b28c0 msgr2=0x7f09380b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e659c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7e00071d0 0x7fc7e00ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:49870/0 (socket says 172.21.15.132:49870) 2024-03-16T17:47:57.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e659c640 1 -- 172.21.15.132:0/3481108784 learned_addr learned my addr 172.21.15.132:0/3481108784 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fbd7ea6b640 1 -- start start 2024-03-16T17:47:57.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7f093f215640 1 -- 172.21.15.132:0/1334037884 shutdown_connections 2024-03-16T17:47:57.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e6d9d640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00e7870 0x7fc7e00e5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e5d9b640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7e00e7490 0x7fc7e00cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fb20effd640 1 -- 172.21.15.132:0/1642999234 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1f8003520 con 0x7fb21006c560 2024-03-16T17:47:57.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7f093f215640 1 -- 172.21.15.132:0/1334037884 wait complete. 2024-03-16T17:47:57.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e659c640 1 -- 172.21.15.132:0/3481108784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00e7870 msgr2=0x7fc7e00e5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e659c640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00e7870 0x7fc7e00e5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e659c640 1 -- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7e00e7490 msgr2=0x7fc7e00cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e659c640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7e00e7490 0x7fc7e00cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.288+0000 7fc7e659c640 1 -- 172.21.15.132:0/3481108784 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d8009400 con 0x7fc7e00071d0 2024-03-16T17:47:57.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fb20ffff640 1 -- 172.21.15.132:0/1642999234 >> v2:172.21.15.132:3300/0 conn(0x7fb21006d870 msgr2=0x7fb21006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fb20ffff640 1 --2- 172.21.15.132:0/1642999234 >> v2:172.21.15.132:3300/0 conn(0x7fb21006d870 0x7fb21006c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fb20ffff640 1 -- 172.21.15.132:0/1642999234 >> v1:172.21.15.194:6789/0 conn(0x7fb21006c560 legacy=0x7fb2100b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fb20ffff640 1 -- 172.21.15.132:0/1642999234 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21006b260 con 0x7fb2101622c0 2024-03-16T17:47:57.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fbd7ea6b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd780b2bb0 0x7fbd780b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fbd7ea6b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd780cdf10 0x7fbd780b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fbd7ea6b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd780b34d0 con 0x7fbd78070ba0 2024-03-16T17:47:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fbd7ea6b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7814bfc0 con 0x7fbd780b2bb0 2024-03-16T17:47:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fbd7ea6b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7806cda0 con 0x7fbd780cdf10 2024-03-16T17:47:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.290+0000 7fbd7d008640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbd78070ba0 0x7fbd7806de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45792/0 (socket says 172.21.15.132:45792) 2024-03-16T17:47:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.290+0000 7fbd7d008640 1 -- 172.21.15.132:0/3815915824 learned_addr learned my addr 172.21.15.132:0/3815915824 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.290+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896718368 0 0) 0x7fbd780b34d0 con 0x7fbd78070ba0 2024-03-16T17:47:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.290+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd60003520 con 0x7fbd78070ba0 2024-03-16T17:47:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fc7e659c640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7e00071d0 0x7fc7e00ca9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8050b50 tx=0x7fc7e8068300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fc7d6ffd640 1 -- 172.21.15.132:0/3481108784 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80933b0 con 0x7fc7e00071d0 2024-03-16T17:47:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fc7e759e640 1 -- 172.21.15.132:0/3481108784 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e00d4390 con 0x7fc7e00071d0 2024-03-16T17:47:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fc7e759e640 1 -- 172.21.15.132:0/3481108784 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e00d4670 con 0x7fc7e00071d0 2024-03-16T17:47:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fc7d6ffd640 1 -- 172.21.15.132:0/3481108784 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e8093510 con 0x7fc7e00071d0 2024-03-16T17:47:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.289+0000 7fc7d6ffd640 1 -- 172.21.15.132:0/3481108784 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8093900 con 0x7fc7e00071d0 2024-03-16T17:47:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.290+0000 7fc7e5d9b640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7e00e7490 0x7fc7e00cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621039981 0 0) 0x7fbd60003520 con 0x7fbd78070ba0 2024-03-16T17:47:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd780cdf10 msgr2=0x7fbd780b2f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T17:47:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 --2- 172.21.15.132:0/3815915824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd780cdf10 0x7fbd780b2f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 >> v2:172.21.15.194:3300/0 conn(0x7fbd780b2bb0 msgr2=0x7fbd780b4aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-16T17:47:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 --2- 172.21.15.132:0/3815915824 >> v2:172.21.15.194:3300/0 conn(0x7fbd780b2bb0 0x7fbd780b4aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7806d080 con 0x7fbd78070ba0 2024-03-16T17:47:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7fbd700019f0 con 0x7fbd78070ba0 2024-03-16T17:47:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 >> v1:172.21.15.132:6789/0 conn(0x7fbd78070ba0 legacy=0x7fbd7806de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 --2- 172.21.15.132:0/3815915824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd60003970 0x7fbd60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 --2- 172.21.15.132:0/3815915824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd600047c0 0x7fbd60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 --2- 172.21.15.132:0/3815915824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 0x7fbd6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7814bfc0 con 0x7fbd600047c0 2024-03-16T17:47:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7806cda0 con 0x7fbd60003970 2024-03-16T17:47:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6000c220 con 0x7fbd60005380 2024-03-16T17:47:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.291+0000 7fc7d6ffd640 1 -- 172.21.15.132:0/3481108784 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fc7e8093a60 con 0x7fc7e00071d0 2024-03-16T17:47:57.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7fb20f7fe640 1 --2- 172.21.15.132:0/1642999234 >> v2:172.21.15.132:3300/0 conn(0x7fb21006d870 0x7fb21006c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:57.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7fc7d6ffd640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc7c806b480 0x7fc7c806d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7fc7d6ffd640 1 -- 172.21.15.132:0/3481108784 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7e81048d0 con 0x7fc7e00071d0 2024-03-16T17:47:57.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7fc7e759e640 1 -- 172.21.15.132:0/3481108784 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc005290 con 0x7fc7e00071d0 2024-03-16T17:47:57.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7fbd7d008640 1 --2- 172.21.15.132:0/3815915824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 0x7fbd6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.293+0000 7fc7e5d9b640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc7c806b480 0x7fc7c806d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7fbd7d008640 1 -- 172.21.15.132:0/3815915824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd60003970 msgr2=0x7fbd60003d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-16T17:47:57.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7fbd7d008640 1 --2- 172.21.15.132:0/3815915824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd60003970 0x7fbd60003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7fbd7d008640 1 -- 172.21.15.132:0/3815915824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd600047c0 msgr2=0x7fbd60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7fbd7d008640 1 --2- 172.21.15.132:0/3815915824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd600047c0 0x7fbd60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7fbd7d008640 1 -- 172.21.15.132:0/3815915824 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7806d080 con 0x7fbd60005380 2024-03-16T17:47:57.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7fc7e5d9b640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc7c806b480 0x7fc7c806d940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8036000 tx=0x7fc7d8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7f093f215640 1 Processor -- start 2024-03-16T17:47:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.292+0000 7f093f215640 1 -- start start 2024-03-16T17:47:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.293+0000 7f093f215640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09380722c0 0x7f0938151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.293+0000 7f093f215640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380b4a60 0x7f09381f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.293+0000 7f093f215640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09380d0670 0x7f09381f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.293+0000 7f093f215640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0938156e70 con 0x7f09380d0670 2024-03-16T17:47:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.293+0000 7f093f215640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0938156880 con 0x7f09380722c0 2024-03-16T17:47:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.293+0000 7f093f215640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09381526e0 con 0x7f09380b4a60 2024-03-16T17:47:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.293+0000 7f0937fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380b4a60 0x7f09381f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f0937fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380b4a60 0x7f09381f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:49892/0 (socket says 172.21.15.132:49892) 2024-03-16T17:47:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f0937fff640 1 -- 172.21.15.132:0/1297396110 learned_addr learned my addr 172.21.15.132:0/1297396110 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f093d7b2640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09380d0670 0x7f09381f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7fbd7d008640 1 --2- 172.21.15.132:0/3815915824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 0x7fbd6000b980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000a990 tx=0x7fbd600057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c61e1b26aca45ec server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f093cfb1640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09380722c0 0x7f0938151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7fb20ffff640 1 --2- 172.21.15.132:0/1642999234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2101622c0 0x7fb21006eac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb210066d80 tx=0x7fb20802bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f12c056dbd84a551 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f0937fff640 1 -- 172.21.15.132:0/1297396110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09380722c0 msgr2=0x7f0938151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f0937fff640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09380722c0 0x7f0938151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f0937fff640 1 -- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09380d0670 msgr2=0x7f09381f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f0937fff640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09380d0670 0x7f09381f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f0937fff640 1 -- 172.21.15.132:0/1297396110 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c00f610 con 0x7f09380b4a60 2024-03-16T17:47:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f093d7b2640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09380d0670 0x7f09381f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.294+0000 7f0937fff640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380b4a60 0x7f09381f2be0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f093000cad0 tx=0x7f093000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.295+0000 7fb20effd640 1 -- 172.21.15.132:0/1642999234 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200001670 con 0x7fb2101622c0 2024-03-16T17:47:57.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.295+0000 7fb20effd640 1 -- 172.21.15.132:0/1642999234 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20802c7e0 con 0x7fb2101622c0 2024-03-16T17:47:57.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.295+0000 7fb20effd640 1 -- 172.21.15.132:0/1642999234 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20802cb70 con 0x7fb2101622c0 2024-03-16T17:47:57.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.296+0000 7fb2169b6640 1 -- 172.21.15.132:0/1642999234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2101622c0 msgr2=0x7fb21006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.296+0000 7fb2169b6640 1 --2- 172.21.15.132:0/1642999234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2101622c0 0x7fb21006eac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb210066d80 tx=0x7fb20802bcb0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.297+0000 7fb2169b6640 1 -- 172.21.15.132:0/1642999234 shutdown_connections 2024-03-16T17:47:57.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.297+0000 7fb2169b6640 1 --2- 172.21.15.132:0/1642999234 >> v2:172.21.15.132:3300/0 conn(0x7fb21006d870 0x7fb21006c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.297+0000 7fb2169b6640 1 --2- 172.21.15.132:0/1642999234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2101622c0 0x7fb21006eac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.297+0000 7fb2169b6640 1 -- 172.21.15.132:0/1642999234 >> 172.21.15.132:0/1642999234 conn(0x7fb2100b2520 msgr2=0x7fb2100b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.297+0000 7fb2169b6640 1 -- 172.21.15.132:0/1642999234 shutdown_connections 2024-03-16T17:47:57.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.297+0000 7fb2169b6640 1 -- 172.21.15.132:0/1642999234 wait complete. 2024-03-16T17:47:57.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.298+0000 7fc7d6ffd640 1 -- 172.21.15.132:0/3481108784 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc7e80cf5a0 con 0x7fc7e00071d0 2024-03-16T17:47:57.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.298+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70034630 con 0x7fbd60005380 2024-03-16T17:47:57.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.299+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7002f070 con 0x7fbd60005380 2024-03-16T17:47:57.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.299+0000 7fbd6f7fe640 1 -- 172.21.15.132:0/3815915824 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70034a50 con 0x7fbd60005380 2024-03-16T17:47:57.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.299+0000 7fb2169b6640 1 Processor -- start 2024-03-16T17:47:57.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.299+0000 7f09357fa640 1 -- 172.21.15.132:0/1297396110 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000ab10 con 0x7f09380b4a60 2024-03-16T17:47:57.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.299+0000 7f09357fa640 1 -- 172.21.15.132:0/1297396110 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093000ac70 con 0x7f09380b4a60 2024-03-16T17:47:57.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.299+0000 7f093f215640 1 -- 172.21.15.132:0/1297396110 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09381529c0 con 0x7f09380b4a60 2024-03-16T17:47:57.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.300+0000 7f093f215640 1 -- 172.21.15.132:0/1297396110 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0938150bc0 con 0x7f09380b4a60 2024-03-16T17:47:57.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.300+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/3815915824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 msgr2=0x7fbd6000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.300+0000 7fbd7ea6b640 1 --2- 172.21.15.132:0/3815915824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 0x7fbd6000b980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000a990 tx=0x7fbd600057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.300+0000 7fbd7d008640 1 -- 172.21.15.132:0/3815915824 reap_dead start 2024-03-16T17:47:57.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.302+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/3815915824 shutdown_connections 2024-03-16T17:47:57.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.302+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/3815915824 >> 172.21.15.132:0/3815915824 conn(0x7fbd7806aee0 msgr2=0x7fbd7806b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.302+0000 7fb2169b6640 1 -- start start 2024-03-16T17:47:57.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.303+0000 7fb2169b6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21006c560 0x7fb210156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.302+0000 7f093f215640 1 -- 172.21.15.132:0/1297396110 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0938157020 con 0x7f09380b4a60 2024-03-16T17:47:57.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fb2169b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb21006d870 0x7fb2100acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/3815915824 shutdown_connections 2024-03-16T17:47:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.302+0000 7f09357fa640 1 -- 172.21.15.132:0/1297396110 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930012420 con 0x7f09380b4a60 2024-03-16T17:47:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.302+0000 7f09357fa640 1 -- 172.21.15.132:0/1297396110 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f09300125c0 con 0x7f09380b4a60 2024-03-16T17:47:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.302+0000 7f09357fa640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f092406b430 0x7f092406d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.303+0000 7f093cfb1640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f092406b430 0x7f092406d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.303+0000 7f093cfb1640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f092406b430 0x7f092406d8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0928006fd0 tx=0x7f0928008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.303+0000 7f09357fa640 1 -- 172.21.15.132:0/1297396110 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0930058730 con 0x7f09380b4a60 2024-03-16T17:47:57.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fb2169b6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2100ad000 0x7fb2100ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fb20ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21006c560 0x7fb210156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fb20ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21006c560 0x7fb210156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:45568/0 (socket says 172.21.15.132:45568) 2024-03-16T17:47:57.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fb20ffff640 1 -- 172.21.15.132:0/3757867906 learned_addr learned my addr 172.21.15.132:0/3757867906 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fb20f7fe640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb21006d870 0x7fb2100acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2100ac630 con 0x7fb21006d870 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fb214f53640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2100ad000 0x7fb2100ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2101566d0 con 0x7fb21006c560 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2100aba20 con 0x7fb2100ad000 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.305+0000 7fb20ffff640 1 -- 172.21.15.132:0/3757867906 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2100ad000 msgr2=0x7fb2100ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.305+0000 7fb20ffff640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2100ad000 0x7fb2100ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.305+0000 7fb20ffff640 1 -- 172.21.15.132:0/3757867906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb21006d870 msgr2=0x7fb2100acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.305+0000 7fb20ffff640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb21006d870 0x7fb2100acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.305+0000 7fb20ffff640 1 -- 172.21.15.132:0/3757867906 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb208009a70 con 0x7fb21006c560 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.305+0000 7fb20ffff640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21006c560 0x7fb210156190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb208000f80 tx=0x7fb208004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.306+0000 7fb20cff9640 1 -- 172.21.15.132:0/3757867906 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208035ce0 con 0x7fb21006c560 2024-03-16T17:47:57.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.306+0000 7fb20cff9640 1 -- 172.21.15.132:0/3757867906 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb208035e40 con 0x7fb21006c560 2024-03-16T17:47:57.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.307+0000 7fb20cff9640 1 -- 172.21.15.132:0/3757867906 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20803e630 con 0x7fb21006c560 2024-03-16T17:47:57.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.307+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2100abd00 con 0x7fb21006c560 2024-03-16T17:47:57.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.307+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2100ac2c0 con 0x7fb21006c560 2024-03-16T17:47:57.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.304+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/3815915824 wait complete. 2024-03-16T17:47:57.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.306+0000 7fbd7ea6b640 1 Processor -- start 2024-03-16T17:47:57.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.306+0000 7fbd7ea6b640 1 -- start start 2024-03-16T17:47:57.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.308+0000 7fbd7ea6b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 0x7fbd7813ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.308+0000 7fbd7ea6b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd7814b4f0 0x7fbd7808b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.308+0000 7fbd6ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd7814b4f0 0x7fbd7808b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.308+0000 7fbd6ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd7814b4f0 0x7fbd7808b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38668/0 (socket says 172.21.15.132:38668) 2024-03-16T17:47:57.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.309+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb210072e20 con 0x7fb21006c560 2024-03-16T17:47:57.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.310+0000 7fb20cff9640 1 -- 172.21.15.132:0/3757867906 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb20803b050 con 0x7fb21006c560 2024-03-16T17:47:57.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.310+0000 7fb20cff9640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1fc06b4b0 0x7fb1fc06d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.311+0000 7fb20cff9640 1 -- 172.21.15.132:0/3757867906 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2080abfb0 con 0x7fb21006c560 2024-03-16T17:47:57.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.311+0000 7fb20f7fe640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1fc06b4b0 0x7fb1fc06d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.309+0000 7f09357fa640 1 -- 172.21.15.132:0/1297396110 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0938157020 con 0x7f09380b4a60 2024-03-16T17:47:57.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.312+0000 7fb20f7fe640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1fc06b4b0 0x7fb1fc06d970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb210156cb0 tx=0x7fb204008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.312+0000 7fbd7ea6b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd781413f0 0x7fbd781418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.312+0000 7fbd7ea6b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78159b80 con 0x7fbd7814b4f0 2024-03-16T17:47:57.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.312+0000 7fbd7ea6b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78159e60 con 0x7fbd781413f0 2024-03-16T17:47:57.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.312+0000 7fbd7ea6b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7815a140 con 0x7fbd60005380 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.312+0000 7fbd7c807640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 0x7fbd7813ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.312+0000 7fbd7c807640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 0x7fbd7813ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:49914/0 (socket says 172.21.15.132:49914) 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.312+0000 7fbd7c807640 1 -- 172.21.15.132:0/2901222851 learned_addr learned my addr 172.21.15.132:0/2901222851 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.313+0000 7fbd7c807640 1 -- 172.21.15.132:0/2901222851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd781413f0 msgr2=0x7fbd781418a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.313+0000 7fbd7c807640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd781413f0 0x7fbd781418a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.313+0000 7fbd7c807640 1 -- 172.21.15.132:0/2901222851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd7814b4f0 msgr2=0x7fbd7808b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.313+0000 7fbd7c807640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd7814b4f0 0x7fbd7808b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.313+0000 7fbd7c807640 1 -- 172.21.15.132:0/2901222851 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7815a420 con 0x7fbd60005380 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.313+0000 7fbd7c807640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 0x7fbd7813ccf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800b3f0 tx=0x7fbd6800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.313+0000 7fbd6d7fa640 1 -- 172.21.15.132:0/2901222851 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68011830 con 0x7fbd60005380 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.313+0000 7fbd6d7fa640 1 -- 172.21.15.132:0/2901222851 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd68011990 con 0x7fbd60005380 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.313+0000 7fbd6d7fa640 1 -- 172.21.15.132:0/2901222851 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68011d40 con 0x7fbd60005380 2024-03-16T17:47:57.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.313+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/2901222851 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7815a700 con 0x7fbd60005380 2024-03-16T17:47:57.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.314+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/2901222851 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7808bc40 con 0x7fbd60005380 2024-03-16T17:47:57.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.316+0000 7fb20cff9640 1 -- 172.21.15.132:0/3757867906 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb208076e50 con 0x7fb21006c560 2024-03-16T17:47:57.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.316+0000 7fbd6d7fa640 1 -- 172.21.15.132:0/2901222851 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fbd6801a400 con 0x7fbd60005380 2024-03-16T17:47:57.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.316+0000 7fbd6d7fa640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbd6406b3e0 0x7fbd6406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.316+0000 7fbd6d7fa640 1 -- 172.21.15.132:0/2901222851 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd68089c90 con 0x7fbd60005380 2024-03-16T17:47:57.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.317+0000 7fbd6ffff640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd7814b4f0 0x7fbd7808b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:57.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.317+0000 7fbd6ffff640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbd6406b3e0 0x7fbd6406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.318+0000 7fbd6ffff640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbd6406b3e0 0x7fbd6406d8a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbd74006fd0 tx=0x7fbd74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.318+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/2901222851 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd780735f0 con 0x7fbd60005380 2024-03-16T17:47:57.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.324+0000 7fbd6d7fa640 1 -- 172.21.15.132:0/2901222851 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbd68015080 con 0x7fbd60005380 2024-03-16T17:47:57.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.328+0000 7fcce2948640 1 Processor -- start 2024-03-16T17:47:57.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.328+0000 7fcce2948640 1 -- start start 2024-03-16T17:47:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.336+0000 7fcce2948640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccdc15a120 0x7fccdc0b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.336+0000 7fcce2948640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fccdc15eb30 0x7fccdc0b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.337+0000 7fccdb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fccdc15eb30 0x7fccdc0b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.337+0000 7fccdb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fccdc15eb30 0x7fccdc0b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38672/0 (socket says 172.21.15.132:38672) 2024-03-16T17:47:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.338+0000 7fccdb7fe640 1 -- 172.21.15.132:0/1144756846 learned_addr learned my addr 172.21.15.132:0/1144756846 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.338+0000 7fcce2948640 1 -- 172.21.15.132:0/1144756846 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0b5440 con 0x7fccdc06e7b0 2024-03-16T17:47:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.338+0000 7fcce2948640 1 -- 172.21.15.132:0/1144756846 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc0b34d0 con 0x7fccdc15eb30 2024-03-16T17:47:57.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.338+0000 7fcce2948640 1 -- 172.21.15.132:0/1144756846 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0b37b0 con 0x7fccdc15a120 2024-03-16T17:47:57.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.339+0000 7fccdb7fe640 1 -- 172.21.15.132:0/1144756846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccdc15a120 msgr2=0x7fccdc0b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.340+0000 7fccdb7fe640 1 --2- 172.21.15.132:0/1144756846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccdc15a120 0x7fccdc0b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.340+0000 7fccdb7fe640 1 -- 172.21.15.132:0/1144756846 >> v1:172.21.15.194:6789/0 conn(0x7fccdc06e7b0 legacy=0x7fccdc06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.340+0000 7fccdb7fe640 1 -- 172.21.15.132:0/1144756846 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0b3a90 con 0x7fccdc15eb30 2024-03-16T17:47:57.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.347+0000 7fccdb7fe640 1 --2- 172.21.15.132:0/1144756846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15eb30 0x7fccdc0b4af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009ad0 tx=0x7fcccc030220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec5916afe862b25 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.349+0000 7fccdaffd640 1 -- 172.21.15.132:0/1144756846 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc030dc0 con 0x7fccdc15eb30 2024-03-16T17:47:57.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.349+0000 7fccdaffd640 1 -- 172.21.15.132:0/1144756846 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc038440 con 0x7fccdc15eb30 2024-03-16T17:47:57.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.355+0000 7fcce2948640 1 -- 172.21.15.132:0/1144756846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15eb30 msgr2=0x7fccdc0b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.355+0000 7fcce2948640 1 --2- 172.21.15.132:0/1144756846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15eb30 0x7fccdc0b4af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009ad0 tx=0x7fcccc030220 comp rx=0 tx=0).stop 2024-03-16T17:47:57.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.356+0000 7fcce2948640 1 -- 172.21.15.132:0/1144756846 shutdown_connections 2024-03-16T17:47:57.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.356+0000 7fcce2948640 1 --2- 172.21.15.132:0/1144756846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15eb30 0x7fccdc0b4af0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.356+0000 7fcce2948640 1 --2- 172.21.15.132:0/1144756846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccdc15a120 0x7fccdc0b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.356+0000 7fcce2948640 1 -- 172.21.15.132:0/1144756846 >> 172.21.15.132:0/1144756846 conn(0x7fccdc0b2520 msgr2=0x7fccdc0b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.357+0000 7fcce2948640 1 -- 172.21.15.132:0/1144756846 shutdown_connections 2024-03-16T17:47:57.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.357+0000 7fcce2948640 1 -- 172.21.15.132:0/1144756846 wait complete. 2024-03-16T17:47:57.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.369+0000 7fcce2948640 1 Processor -- start 2024-03-16T17:47:57.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.370+0000 7fcce2948640 1 -- start start 2024-03-16T17:47:57.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.378+0000 7fcce2948640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccdc06e7b0 0x7fccdc1f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.378+0000 7fcce2948640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15a120 0x7fccdc2038d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.379+0000 7fccdb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15a120 0x7fccdc2038d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.379+0000 7fccdb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15a120 0x7fccdc2038d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38674/0 (socket says 172.21.15.132:38674) 2024-03-16T17:47:57.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.379+0000 7fccdb7fe640 1 -- 172.21.15.132:0/2165800472 learned_addr learned my addr 172.21.15.132:0/2165800472 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.379+0000 7fcce2948640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc15eb30 0x7fccdc203e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.380+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0a9ee0 con 0x7fccdc15a120 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.380+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc200450 con 0x7fccdc15eb30 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.380+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc1f4f40 con 0x7fccdc06e7b0 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.380+0000 7fcce0ee5640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc15eb30 0x7fccdc203e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.380+0000 7fccdbfff640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccdc06e7b0 0x7fccdc1f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.380+0000 7fcce0ee5640 1 -- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccdc06e7b0 msgr2=0x7fccdc1f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.380+0000 7fcce0ee5640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccdc06e7b0 0x7fccdc1f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.380+0000 7fcce0ee5640 1 -- 172.21.15.132:0/2165800472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15a120 msgr2=0x7fccdc2038d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.380+0000 7fcce0ee5640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15a120 0x7fccdc2038d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.380+0000 7fcce0ee5640 1 -- 172.21.15.132:0/2165800472 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc0094d0 con 0x7fccdc15eb30 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.381+0000 7fcce0ee5640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc15eb30 0x7fccdc203e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fccd400c690 tx=0x7fccd400cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.381+0000 7fccdbfff640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccdc06e7b0 0x7fccdc1f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:57.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.382+0000 7fccd8ff9640 1 -- 172.21.15.132:0/2165800472 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4003b70 con 0x7fccdc15eb30 2024-03-16T17:47:57.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.382+0000 7fccd8ff9640 1 -- 172.21.15.132:0/2165800472 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd4003cd0 con 0x7fccdc15eb30 2024-03-16T17:47:57.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.383+0000 7fccd8ff9640 1 -- 172.21.15.132:0/2165800472 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4005310 con 0x7fccdc15eb30 2024-03-16T17:47:57.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.383+0000 7fccdb7fe640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15a120 0x7fccdc2038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:57.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.383+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc0aa130 con 0x7fccdc15eb30 2024-03-16T17:47:57.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.383+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc2009d0 con 0x7fccdc15eb30 2024-03-16T17:47:57.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.385+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc068450 con 0x7fccdc15eb30 2024-03-16T17:47:57.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.387+0000 7fccd8ff9640 1 -- 172.21.15.132:0/2165800472 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fccd4005470 con 0x7fccdc15eb30 2024-03-16T17:47:57.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.387+0000 7fccd8ff9640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fccc806b480 0x7fccc806d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.388+0000 7fccd8ff9640 1 -- 172.21.15.132:0/2165800472 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccd4089970 con 0x7fccdc15eb30 2024-03-16T17:47:57.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.388+0000 7fccdbfff640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fccc806b480 0x7fccc806d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.389+0000 7fccdbfff640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fccc806b480 0x7fccc806d940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fccd0006fd0 tx=0x7fccd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.393+0000 7fccd8ff9640 1 -- 172.21.15.132:0/2165800472 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fccd40545b0 con 0x7fccdc15eb30 2024-03-16T17:47:57.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.433+0000 7fba0aa0f640 1 Processor -- start 2024-03-16T17:47:57.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.433+0000 7fba0aa0f640 1 -- start start 2024-03-16T17:47:57.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.434+0000 7fba0aa0f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba0416e1e0 0x7fba0406e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.434+0000 7fba0aa0f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fba040b32c0 0x7fba04070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.434+0000 7fba0aa0f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0406e610 con 0x7fba040cda00 2024-03-16T17:47:57.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.434+0000 7fba0aa0f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0408b420 con 0x7fba0416e1e0 2024-03-16T17:47:57.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.434+0000 7fba0aa0f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0416e5c0 con 0x7fba040b32c0 2024-03-16T17:47:57.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.435+0000 7fba08fac640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fba040b32c0 0x7fba04070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.435+0000 7fba08fac640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fba040b32c0 0x7fba04070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:45598/0 (socket says 172.21.15.132:45598) 2024-03-16T17:47:57.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.435+0000 7fba08fac640 1 -- 172.21.15.132:0/1441444698 learned_addr learned my addr 172.21.15.132:0/1441444698 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.435+0000 7fba03fff640 1 --2- 172.21.15.132:0/1441444698 >> v2:172.21.15.132:3300/0 conn(0x7fba0416e1e0 0x7fba0406e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.435+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048419283 0 0) 0x7fba0406e610 con 0x7fba040cda00 2024-03-16T17:47:57.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.435+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9ec007930 con 0x7fba040cda00 2024-03-16T17:47:57.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3505850965 0 0) 0x7fb9ec007930 con 0x7fba040cda00 2024-03-16T17:47:57.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 >> v2:172.21.15.194:3300/0 conn(0x7fba040b32c0 msgr2=0x7fba04070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 --2- 172.21.15.132:0/1441444698 >> v2:172.21.15.194:3300/0 conn(0x7fba040b32c0 0x7fba04070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 >> v2:172.21.15.132:3300/0 conn(0x7fba0416e1e0 msgr2=0x7fba0406e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 --2- 172.21.15.132:0/1441444698 >> v2:172.21.15.132:3300/0 conn(0x7fba0416e1e0 0x7fba0406e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0406d610 con 0x7fba040cda00 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7fb9f4001670 con 0x7fba040cda00 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 >> v1:172.21.15.194:6789/0 conn(0x7fba040cda00 legacy=0x7fba040b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ec007d80 0x7fb9ec0081a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9ec008bd0 0x7fb9ec009050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec007440 0x7fb9ec009590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0408b420 con 0x7fb9ec007d80 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0416e5c0 con 0x7fb9ec008bd0 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec01cff0 con 0x7fb9ec007440 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba03fff640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ec007d80 0x7fb9ec0081a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba037fe640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9ec008bd0 0x7fb9ec009050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba08fac640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec007440 0x7fb9ec009590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.436+0000 7fba037fe640 1 -- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec007440 msgr2=0x7fb9ec009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.437+0000 7fba037fe640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec007440 0x7fb9ec009590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.437+0000 7fba037fe640 1 -- 172.21.15.132:0/1441444698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ec007d80 msgr2=0x7fb9ec0081a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.437+0000 7fba037fe640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ec007d80 0x7fb9ec0081a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.437+0000 7fba037fe640 1 -- 172.21.15.132:0/1441444698 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0406d610 con 0x7fb9ec008bd0 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.437+0000 7fba03fff640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9ec007d80 0x7fb9ec0081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.437+0000 7fba08fac640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec007440 0x7fb9ec009590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.437+0000 7fba08fac640 1 -- 172.21.15.132:0/1441444698 reap_dead start 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.438+0000 7fba037fe640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9ec008bd0 0x7fb9ec009050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb9f402e1a0 tx=0x7fb9ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54d97bf0d14b844c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.438+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f404ea60 con 0x7fb9ec008bd0 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.438+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f404ebe0 con 0x7fb9ec008bd0 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.438+0000 7fba02ffd640 1 -- 172.21.15.132:0/1441444698 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4056440 con 0x7fb9ec008bd0 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.439+0000 7fba0aa0f640 1 -- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9ec008bd0 msgr2=0x7fb9ec009050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.439+0000 7fba0aa0f640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9ec008bd0 0x7fb9ec009050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb9f402e1a0 tx=0x7fb9ec009c00 comp rx=0 tx=0).stop 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.441+0000 7fba0aa0f640 1 -- 172.21.15.132:0/1441444698 shutdown_connections 2024-03-16T17:47:57.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.441+0000 7fba0aa0f640 1 --2- 172.21.15.132:0/1441444698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9ec008bd0 0x7fb9ec009050 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.441+0000 7fba0aa0f640 1 -- 172.21.15.132:0/1441444698 >> 172.21.15.132:0/1441444698 conn(0x7fba0406aee0 msgr2=0x7fba0406b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.442+0000 7fba0aa0f640 1 -- 172.21.15.132:0/1441444698 shutdown_connections 2024-03-16T17:47:57.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.442+0000 7fba0aa0f640 1 -- 172.21.15.132:0/1441444698 wait complete. 2024-03-16T17:47:57.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.443+0000 7fba0aa0f640 1 Processor -- start 2024-03-16T17:47:57.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.444+0000 7fba0aa0f640 1 -- start start 2024-03-16T17:47:57.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.445+0000 7fba0aa0f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec008bd0 0x7fba0408ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.445+0000 7fba0aa0f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba04159a20 0x7fba040c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.445+0000 7fba0aa0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba04159ea0 0x7fba040c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.445+0000 7fba0aa0f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0415a6c0 con 0x7fba04159ea0 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.445+0000 7fba0aa0f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba04158980 con 0x7fba04159a20 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.445+0000 7fba0aa0f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba04158c60 con 0x7fb9ec008bd0 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.445+0000 7fba08fac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba04159ea0 0x7fba040c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.445+0000 7fba08fac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba04159ea0 0x7fba040c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38708/0 (socket says 172.21.15.132:38708) 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.445+0000 7fba08fac640 1 -- 172.21.15.132:0/4234928762 learned_addr learned my addr 172.21.15.132:0/4234928762 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.446+0000 7fba03fff640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec008bd0 0x7fba0408ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.446+0000 7fba08fac640 1 -- 172.21.15.132:0/4234928762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec008bd0 msgr2=0x7fba0408ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.446+0000 7fba08fac640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec008bd0 0x7fba0408ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.446+0000 7fba08fac640 1 -- 172.21.15.132:0/4234928762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba04159a20 msgr2=0x7fba040c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.446+0000 7fba08fac640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba04159a20 0x7fba040c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.446+0000 7fba08fac640 1 -- 172.21.15.132:0/4234928762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04158f40 con 0x7fba04159ea0 2024-03-16T17:47:57.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.446+0000 7fba03fff640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec008bd0 0x7fba0408ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:47:57.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.446+0000 7fba08fac640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba04159ea0 0x7fba040c7ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fba040cc5d0 tx=0x7fb9fc00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.449+0000 7fba00ff9640 1 -- 172.21.15.132:0/4234928762 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc014830 con 0x7fba04159ea0 2024-03-16T17:47:57.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.449+0000 7fba00ff9640 1 -- 172.21.15.132:0/4234928762 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc018070 con 0x7fba04159ea0 2024-03-16T17:47:57.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.449+0000 7fba00ff9640 1 -- 172.21.15.132:0/4234928762 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc003bd0 con 0x7fba04159ea0 2024-03-16T17:47:57.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.449+0000 7fba0aa0f640 1 -- 172.21.15.132:0/4234928762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba04159220 con 0x7fba04159ea0 2024-03-16T17:47:57.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.450+0000 7fba0aa0f640 1 -- 172.21.15.132:0/4234928762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0408b0a0 con 0x7fba04159ea0 2024-03-16T17:47:57.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.454+0000 7fba00ff9640 1 -- 172.21.15.132:0/4234928762 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb9fc010040 con 0x7fba04159ea0 2024-03-16T17:47:57.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.454+0000 7fba00ff9640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb9f006b4b0 0x7fb9f006d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.454+0000 7fba03fff640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb9f006b4b0 0x7fb9f006d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.455+0000 7fba03fff640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb9f006b4b0 0x7fb9f006d970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba04167690 tx=0x7fb9f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.455+0000 7fba00ff9640 1 -- 172.21.15.132:0/4234928762 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9fc00d040 con 0x7fba04159ea0 2024-03-16T17:47:57.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.456+0000 7fb9ea7fc640 1 -- 172.21.15.132:0/4234928762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba04159740 con 0x7fba04159ea0 2024-03-16T17:47:57.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.465+0000 7fba00ff9640 1 -- 172.21.15.132:0/4234928762 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fba04159740 con 0x7fba04159ea0 2024-03-16T17:47:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.611+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fed34005540 con 0x7fed54070080 2024-03-16T17:47:57.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.612+0000 7fed517fa640 1 -- 172.21.15.132:0/1154268094 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed4c01a030 con 0x7fed54070080 2024-03-16T17:47:57.636 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:57.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa2700735f0 con 0x7fa270070ba0 2024-03-16T17:47:57.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed4006b480 msgr2=0x7fed4006d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed4006b480 0x7fed4006d940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed540b2b10 tx=0x7fed48008040 comp rx=0 tx=0).stop 2024-03-16T17:47:57.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed54070080 msgr2=0x7fed5406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed54070080 0x7fed5406d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00cec0 tx=0x7fed4c00a710 comp rx=0 tx=0).stop 2024-03-16T17:47:57.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 shutdown_connections 2024-03-16T17:47:57.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed4006b480 0x7fed4006d940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5415c180 0x7fed542033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed5415bda0 0x7fed540c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 --2- 172.21.15.132:0/1154268094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed54070080 0x7fed5406d3e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 >> 172.21.15.132:0/1154268094 conn(0x7fed5409aa70 msgr2=0x7fed54151f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.646+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 shutdown_connections 2024-03-16T17:47:57.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.647+0000 7fed5b1c9640 1 -- 172.21.15.132:0/1154268094 wait complete. 2024-03-16T17:47:57.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.648+0000 7fa265ffb640 1 -- 172.21.15.132:0/1342725814 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa26c006e10 con 0x7fa270070ba0 2024-03-16T17:47:57.652 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:57.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.651+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa25406b3b0 msgr2=0x7fa25406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.651+0000 7fa277483640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa25406b3b0 0x7fa25406d870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa2700b0ab0 tx=0x7fa260008040 comp rx=0 tx=0).stop 2024-03-16T17:47:57.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.651+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa270070ba0 msgr2=0x7fa270165210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.651+0000 7fa277483640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa270070ba0 0x7fa270165210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa26c034040 tx=0x7fa26c0046c0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.651+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 shutdown_connections 2024-03-16T17:47:57.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.651+0000 7fa277483640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa25406b3b0 0x7fa25406d870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.651+0000 7fa277483640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2700cdf10 0x7fa270161980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.651+0000 7fa277483640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2700b2bb0 0x7fa27006dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.651+0000 7fa277483640 1 --2- 172.21.15.132:0/1342725814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa270070ba0 0x7fa270165210 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa26c034040 tx=0x7fa26c0046c0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.652+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 >> 172.21.15.132:0/1342725814 conn(0x7fa27006aee0 msgr2=0x7fa2701481f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.652+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 shutdown_connections 2024-03-16T17:47:57.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.652+0000 7fa277483640 1 -- 172.21.15.132:0/1342725814 wait complete. 2024-03-16T17:47:57.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-03-16T17:47:57.667 DEBUG:teuthology.parallel:result is None 2024-03-16T17:47:57.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-03-16T17:47:57.682 DEBUG:teuthology.parallel:result is None 2024-03-16T17:47:57.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.706+0000 7fc7e759e640 1 -- 172.21.15.132:0/3481108784 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc7cc005540 con 0x7fc7e00071d0 2024-03-16T17:47:57.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.707+0000 7fc7d6ffd640 1 -- 172.21.15.132:0/3481108784 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7e808f070 con 0x7fc7e00071d0 2024-03-16T17:47:57.710 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.709+0000 7fc7e759e640 1 -- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc7c806b480 msgr2=0x7fc7c806d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.709+0000 7fc7e759e640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc7c806b480 0x7fc7c806d940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8036000 tx=0x7fc7d8008030 comp rx=0 tx=0).stop 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.709+0000 7fc7e759e640 1 -- 172.21.15.132:0/3481108784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7e00071d0 msgr2=0x7fc7e00ca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.709+0000 7fc7e759e640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7e00071d0 0x7fc7e00ca9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8050b50 tx=0x7fc7e8068300 comp rx=0 tx=0).stop 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.710+0000 7fc7e759e640 1 -- 172.21.15.132:0/3481108784 shutdown_connections 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.710+0000 7fc7e759e640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc7c806b480 0x7fc7c806d940 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.710+0000 7fc7e759e640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7e00e7870 0x7fc7e00e5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.710+0000 7fc7e759e640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7e00e7490 0x7fc7e00cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.710+0000 7fc7e759e640 1 --2- 172.21.15.132:0/3481108784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7e00071d0 0x7fc7e00ca9c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.710+0000 7fc7e759e640 1 -- 172.21.15.132:0/3481108784 >> 172.21.15.132:0/3481108784 conn(0x7fc7e0055bc0 msgr2=0x7fc7e0008990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.710+0000 7fc7e759e640 1 -- 172.21.15.132:0/3481108784 shutdown_connections 2024-03-16T17:47:57.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.710+0000 7fc7e759e640 1 -- 172.21.15.132:0/3481108784 wait complete. 2024-03-16T17:47:57.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.711+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/2901222851 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbd7804f330 con 0x7fbd60005380 2024-03-16T17:47:57.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.712+0000 7fbd6d7fa640 1 -- 172.21.15.132:0/2901222851 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd680549a0 con 0x7fbd60005380 2024-03-16T17:47:57.715 INFO:teuthology.orchestra.run.smithi132.stdout:55834574856 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/2901222851 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbd6406b3e0 msgr2=0x7fbd6406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbd6406b3e0 0x7fbd6406d8a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbd74006fd0 tx=0x7fbd74008040 comp rx=0 tx=0).stop 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/2901222851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 msgr2=0x7fbd7813ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 0x7fbd7813ccf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800b3f0 tx=0x7fbd6800b8b0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/2901222851 shutdown_connections 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbd6406b3e0 0x7fbd6406d8a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd781413f0 0x7fbd781418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd7814b4f0 0x7fbd7808b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 --2- 172.21.15.132:0/2901222851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd60005380 0x7fbd7813ccf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/2901222851 >> 172.21.15.132:0/2901222851 conn(0x7fbd7806aee0 msgr2=0x7fbd780af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/2901222851 shutdown_connections 2024-03-16T17:47:57.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.715+0000 7fbd7ea6b640 1 -- 172.21.15.132:0/2901222851 wait complete. 2024-03-16T17:47:57.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.722+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb21004f330 con 0x7fb21006c560 2024-03-16T17:47:57.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.722+0000 7fb20cff9640 1 -- 172.21.15.132:0/3757867906 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb20804e020 con 0x7fb21006c560 2024-03-16T17:47:57.726 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:57.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.724+0000 7f093f215640 1 -- 172.21.15.132:0/1297396110 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0938157020 con 0x7f09380b4a60 2024-03-16T17:47:57.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.725+0000 7f09357fa640 1 -- 172.21.15.132:0/1297396110 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0938157020 con 0x7f09380b4a60 2024-03-16T17:47:57.728 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:57.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1fc06b4b0 msgr2=0x7fb1fc06d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1fc06b4b0 0x7fb1fc06d970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb210156cb0 tx=0x7fb204008040 comp rx=0 tx=0).stop 2024-03-16T17:47:57.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21006c560 msgr2=0x7fb210156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21006c560 0x7fb210156190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb208000f80 tx=0x7fb208004a40 comp rx=0 tx=0).stop 2024-03-16T17:47:57.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-03-16T17:47:57.731 DEBUG:teuthology.parallel:result is None 2024-03-16T17:47:57.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 shutdown_connections 2024-03-16T17:47:57.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1fc06b4b0 0x7fb1fc06d970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2100ad000 0x7fb2100ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb21006d870 0x7fb2100acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 --2- 172.21.15.132:0/3757867906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb21006c560 0x7fb210156190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 >> 172.21.15.132:0/3757867906 conn(0x7fb2100b2520 msgr2=0x7fb2100b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 shutdown_connections 2024-03-16T17:47:57.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.726+0000 7fb2169b6640 1 -- 172.21.15.132:0/3757867906 wait complete. 2024-03-16T17:47:57.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.728+0000 7f093f215640 1 -- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f092406b430 msgr2=0x7f092406d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.728+0000 7f093f215640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f092406b430 0x7f092406d8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0928006fd0 tx=0x7f0928008040 comp rx=0 tx=0).stop 2024-03-16T17:47:57.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.728+0000 7f093f215640 1 -- 172.21.15.132:0/1297396110 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380b4a60 msgr2=0x7f09381f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.728+0000 7f093f215640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380b4a60 0x7f09381f2be0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f093000cad0 tx=0x7f093000cf90 comp rx=0 tx=0).stop 2024-03-16T17:47:57.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.728+0000 7f093f215640 1 -- 172.21.15.132:0/1297396110 shutdown_connections 2024-03-16T17:47:57.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.728+0000 7f093f215640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f092406b430 0x7f092406d8f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.728+0000 7f093f215640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09380d0670 0x7f09381f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.728+0000 7f093f215640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09380b4a60 0x7f09381f2be0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.728+0000 7f093f215640 1 --2- 172.21.15.132:0/1297396110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09380722c0 0x7f0938151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.728+0000 7f093f215640 1 -- 172.21.15.132:0/1297396110 >> 172.21.15.132:0/1297396110 conn(0x7f09380b28c0 msgr2=0x7f09380b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.729+0000 7f093f215640 1 -- 172.21.15.132:0/1297396110 shutdown_connections 2024-03-16T17:47:57.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.729+0000 7f093f215640 1 -- 172.21.15.132:0/1297396110 wait complete. 2024-03-16T17:47:57.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-03-16T17:47:57.735 DEBUG:teuthology.parallel:result is None 2024-03-16T17:47:57.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-03-16T17:47:57.743 DEBUG:teuthology.parallel:result is None 2024-03-16T17:47:57.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-03-16T17:47:57.749 DEBUG:teuthology.parallel:result is None 2024-03-16T17:47:57.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.796+0000 7fb9ea7fc640 1 -- 172.21.15.132:0/4234928762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fba04159740 con 0x7fba04159ea0 2024-03-16T17:47:57.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.796+0000 7fba00ff9640 1 -- 172.21.15.132:0/4234928762 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba04159740 con 0x7fba04159ea0 2024-03-16T17:47:57.800 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.798+0000 7fb9ea7fc640 1 -- 172.21.15.132:0/4234928762 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb9f006b4b0 msgr2=0x7fb9f006d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.798+0000 7fb9ea7fc640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb9f006b4b0 0x7fb9f006d970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba04167690 tx=0x7fb9f8008040 comp rx=0 tx=0).stop 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.799+0000 7fb9ea7fc640 1 -- 172.21.15.132:0/4234928762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba04159ea0 msgr2=0x7fba040c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.799+0000 7fb9ea7fc640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba04159ea0 0x7fba040c7ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fba040cc5d0 tx=0x7fb9fc00ec40 comp rx=0 tx=0).stop 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.799+0000 7fb9ea7fc640 1 -- 172.21.15.132:0/4234928762 shutdown_connections 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.799+0000 7fb9ea7fc640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb9f006b4b0 0x7fb9f006d970 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.799+0000 7fb9ea7fc640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba04159ea0 0x7fba040c7ad0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.799+0000 7fb9ea7fc640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba04159a20 0x7fba040c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.799+0000 7fb9ea7fc640 1 --2- 172.21.15.132:0/4234928762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9ec008bd0 0x7fba0408ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.799+0000 7fb9ea7fc640 1 -- 172.21.15.132:0/4234928762 >> 172.21.15.132:0/4234928762 conn(0x7fba0406aee0 msgr2=0x7fba0406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.799+0000 7fb9ea7fc640 1 -- 172.21.15.132:0/4234928762 shutdown_connections 2024-03-16T17:47:57.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.799+0000 7fb9ea7fc640 1 -- 172.21.15.132:0/4234928762 wait complete. 2024-03-16T17:47:57.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-03-16T17:47:57.813 DEBUG:teuthology.parallel:result is None 2024-03-16T17:47:57.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.875+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fccdc200bf0 con 0x7fccdc15eb30 2024-03-16T17:47:57.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.875+0000 7fccd8ff9640 1 -- 172.21.15.132:0/2165800472 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccd4057c70 con 0x7fccdc15eb30 2024-03-16T17:47:57.879 INFO:teuthology.orchestra.run.smithi132.stdout:55834574855 2024-03-16T17:47:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fccc806b480 msgr2=0x7fccc806d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fccc806b480 0x7fccc806d940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fccd0006fd0 tx=0x7fccd0008040 comp rx=0 tx=0).stop 2024-03-16T17:47:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc15eb30 msgr2=0x7fccdc203e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc15eb30 0x7fccdc203e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fccd400c690 tx=0x7fccd400cb50 comp rx=0 tx=0).stop 2024-03-16T17:47:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 shutdown_connections 2024-03-16T17:47:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fccc806b480 0x7fccc806d940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc15eb30 0x7fccdc203e10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fccdc15a120 0x7fccdc2038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 --2- 172.21.15.132:0/2165800472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fccdc06e7b0 0x7fccdc1f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 >> 172.21.15.132:0/2165800472 conn(0x7fccdc0b2520 msgr2=0x7fccdc15ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 shutdown_connections 2024-03-16T17:47:57.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.877+0000 7fcce2948640 1 -- 172.21.15.132:0/2165800472 wait complete. 2024-03-16T17:47:57.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-03-16T17:47:57.892 DEBUG:teuthology.parallel:result is None 2024-03-16T17:47:57.892 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-16T17:47:57.892 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T17:47:57.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.989+0000 7fd2c0c8f640 1 Processor -- start 2024-03-16T17:47:57.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.989+0000 7fd2c0c8f640 1 -- start start 2024-03-16T17:47:57.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.989+0000 7fd2c0c8f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 0x7fd2bc0d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.989+0000 7fd2c0c8f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd2bc15cda0 0x7fd2bc0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:57.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.989+0000 7fd2c0c8f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0cd6e0 con 0x7fd2bc0b66e0 2024-03-16T17:47:57.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.989+0000 7fd2c0c8f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0b6b70 con 0x7fd2bc15cda0 2024-03-16T17:47:57.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.989+0000 7fd2c0c8f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc1606b0 con 0x7fd2bc15c9c0 2024-03-16T17:47:57.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.990+0000 7fd2b3fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd2bc15cda0 0x7fd2bc0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.990+0000 7fd2ba59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 0x7fd2bc0d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:57.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.990+0000 7fd2bad9d640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd2bc0b66e0 0x7fd2bc06aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46448/0 (socket says 172.21.15.132:46448) 2024-03-16T17:47:57.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.990+0000 7fd2bad9d640 1 -- 172.21.15.132:0/2525445175 learned_addr learned my addr 172.21.15.132:0/2525445175 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:57.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.990+0000 7fd2b3fff640 1 -- 172.21.15.132:0/2525445175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 msgr2=0x7fd2bc0d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:57.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.990+0000 7fd2b3fff640 1 --2- 172.21.15.132:0/2525445175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 0x7fd2bc0d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.990+0000 7fd2b3fff640 1 -- 172.21.15.132:0/2525445175 >> v1:172.21.15.194:6789/0 conn(0x7fd2bc0b66e0 legacy=0x7fd2bc06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.990+0000 7fd2b3fff640 1 -- 172.21.15.132:0/2525445175 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0d0a70 con 0x7fd2bc15cda0 2024-03-16T17:47:57.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.990+0000 7fd2b9d9b640 1 -- 172.21.15.132:0/2525445175 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260000780 0 0) 0x7fd2bc0cd6e0 con 0x7fd2bc0b66e0 2024-03-16T17:47:57.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.990+0000 7fd2ba59c640 1 --2- 172.21.15.132:0/2525445175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 0x7fd2bc0d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:57.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.991+0000 7fd2b3fff640 1 --2- 172.21.15.132:0/2525445175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc15cda0 0x7fd2bc0b61a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097a0 tx=0x7fd2a402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d2af84c8b7d273 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.991+0000 7fd2b9d9b640 1 -- 172.21.15.132:0/2525445175 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4031830 con 0x7fd2bc15cda0 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.991+0000 7fd2b9d9b640 1 -- 172.21.15.132:0/2525445175 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a4031990 con 0x7fd2bc15cda0 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.991+0000 7fd2b9d9b640 1 -- 172.21.15.132:0/2525445175 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4031d20 con 0x7fd2bc15cda0 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.991+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/2525445175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc15cda0 msgr2=0x7fd2bc0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.991+0000 7fd2c0c8f640 1 --2- 172.21.15.132:0/2525445175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc15cda0 0x7fd2bc0b61a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097a0 tx=0x7fd2a402b8d0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.991+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/2525445175 shutdown_connections 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.991+0000 7fd2c0c8f640 1 --2- 172.21.15.132:0/2525445175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc15cda0 0x7fd2bc0b61a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.991+0000 7fd2c0c8f640 1 --2- 172.21.15.132:0/2525445175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 0x7fd2bc0d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.992+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/2525445175 >> 172.21.15.132:0/2525445175 conn(0x7fd2bc0b2b90 msgr2=0x7fd2bc0b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.992+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/2525445175 shutdown_connections 2024-03-16T17:47:57.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.992+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/2525445175 wait complete. 2024-03-16T17:47:58.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.993+0000 7fd2c0c8f640 1 Processor -- start 2024-03-16T17:47:58.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.993+0000 7fd2c0c8f640 1 -- start start 2024-03-16T17:47:58.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2c0c8f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc0b66e0 0x7fd2bc0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2c0c8f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 0x7fd2bc150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2c0c8f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2bc15cda0 0x7fd2bc15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2c0c8f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0cb390 con 0x7fd2bc15cda0 2024-03-16T17:47:58.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2c0c8f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0ca710 con 0x7fd2bc0b66e0 2024-03-16T17:47:58.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2c0c8f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc0ca9f0 con 0x7fd2bc15c9c0 2024-03-16T17:47:58.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2bad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2bc15cda0 0x7fd2bc15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2ba59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc0b66e0 0x7fd2bc0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2bad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2bc15cda0 0x7fd2bc15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38712/0 (socket says 172.21.15.132:38712) 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2bad9d640 1 -- 172.21.15.132:0/1209661575 learned_addr learned my addr 172.21.15.132:0/1209661575 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2b3fff640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 0x7fd2bc150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2bad9d640 1 -- 172.21.15.132:0/1209661575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 msgr2=0x7fd2bc150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2bad9d640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 0x7fd2bc150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2bad9d640 1 -- 172.21.15.132:0/1209661575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc0b66e0 msgr2=0x7fd2bc0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2bad9d640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc0b66e0 0x7fd2bc0cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2bad9d640 1 -- 172.21.15.132:0/1209661575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac009400 con 0x7fd2bc15cda0 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2bad9d640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2bc15cda0 0x7fd2bc15dec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400c7a0 tx=0x7fd2b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2b2ffd640 1 -- 172.21.15.132:0/1209661575 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400a640 con 0x7fd2bc15cda0 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2b2ffd640 1 -- 172.21.15.132:0/1209661575 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b400a7a0 con 0x7fd2bc15cda0 2024-03-16T17:47:58.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/1209661575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a4009400 con 0x7fd2bc15cda0 2024-03-16T17:47:58.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2b2ffd640 1 -- 172.21.15.132:0/1209661575 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400abd0 con 0x7fd2bc15cda0 2024-03-16T17:47:58.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.994+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/1209661575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc0cafb0 con 0x7fd2bc15cda0 2024-03-16T17:47:58.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.995+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/1209661575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc04f2c0 con 0x7fd2bc15cda0 2024-03-16T17:47:58.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.996+0000 7fd2b2ffd640 1 -- 172.21.15.132:0/1209661575 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fd2b400ad30 con 0x7fd2bc15cda0 2024-03-16T17:47:58.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.996+0000 7fd2b2ffd640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd29c06b3b0 0x7fd29c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.996+0000 7fd2b2ffd640 1 -- 172.21.15.132:0/1209661575 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2b4089350 con 0x7fd2bc15cda0 2024-03-16T17:47:58.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.996+0000 7fd2ba59c640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd29c06b3b0 0x7fd29c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:57.996+0000 7fd2ba59c640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd29c06b3b0 0x7fd29c06d870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009cd0 tx=0x7fd2ac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:58.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.001+0000 7fd2b2ffd640 1 -- 172.21.15.132:0/1209661575 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd2b40540f0 con 0x7fd2bc15cda0 2024-03-16T17:47:58.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.256+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/1209661575 --> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2bc160060 con 0x7fd29c06b3b0 2024-03-16T17:47:58.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.262+0000 7fd2b2ffd640 1 -- 172.21.15.132:0/1209661575 <== mgr.4107 v2:172.21.15.132:6832/2724898791 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7fd2ac009920 con 0x7fd29c06b3b0 2024-03-16T17:47:58.268 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:58.269 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-03-16T17:47:58.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/1209661575 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd29c06b3b0 msgr2=0x7fd29c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd29c06b3b0 0x7fd29c06d870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009cd0 tx=0x7fd2ac009190 comp rx=0 tx=0).stop 2024-03-16T17:47:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/1209661575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2bc15cda0 msgr2=0x7fd2bc15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2bc15cda0 0x7fd2bc15dec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400c7a0 tx=0x7fd2b400cc60 comp rx=0 tx=0).stop 2024-03-16T17:47:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/1209661575 shutdown_connections 2024-03-16T17:47:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd29c06b3b0 0x7fd29c06d870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2bc15cda0 0x7fd2bc15dec0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2bc15c9c0 0x7fd2bc150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 --2- 172.21.15.132:0/1209661575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2bc0b66e0 0x7fd2bc0cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/1209661575 >> 172.21.15.132:0/1209661575 conn(0x7fd2bc0b2b90 msgr2=0x7fd2bc15b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/1209661575 shutdown_connections 2024-03-16T17:47:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.265+0000 7fd2c0c8f640 1 -- 172.21.15.132:0/1209661575 wait complete. 2024-03-16T17:47:58.280 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-16T17:47:57.845653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12753,"internal_metadata":221236783},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001844"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521964+0000","last_change":"2024-03-16T17:47:50.495081+0000","last_active":"2024-03-16T17:47:52.521964+0000","last_peered":"2024-03-16T17:47:52.521964+0000","last_clean":"2024-03-16T17:47:52.521964+0000","last_became_active":"2024-03-16T17:47:50.494717+0000","last_became_peered":"2024-03-16T17:47:50.494717+0000","last_unstale":"2024-03-16T17:47:52.521964+0000","last_undegraded":"2024-03-16T17:47:52.521964+0000","last_fullsized":"2024-03-16T17:47:52.521964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:04:30.010877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494900+0000","last_change":"2024-03-16T17:47:50.491581+0000","last_active":"2024-03-16T17:47:51.494900+0000","last_peered":"2024-03-16T17:47:51.494900+0000","last_clean":"2024-03-16T17:47:51.494900+0000","last_became_active":"2024-03-16T17:47:50.491333+0000","last_became_peered":"2024-03-16T17:47:50.491333+0000","last_unstale":"2024-03-16T17:47:51.494900+0000","last_undegraded":"2024-03-16T17:47:51.494900+0000","last_fullsized":"2024-03-16T17:47:51.494900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521308+0000","last_change":"2024-03-16T17:47:50.492368+0000","last_active":"2024-03-16T17:47:52.521308+0000","last_peered":"2024-03-16T17:47:52.521308+0000","last_clean":"2024-03-16T17:47:52.521308+0000","last_became_active":"2024-03-16T17:47:50.492083+0000","last_became_peered":"2024-03-16T17:47:50.492083+0000","last_unstale":"2024-03-16T17:47:52.521308+0000","last_undegraded":"2024-03-16T17:47:52.521308+0000","last_fullsized":"2024-03-16T17:47:52.521308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:58:26.517921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500483+0000","last_change":"2024-03-16T17:47:50.494809+0000","last_active":"2024-03-16T17:47:51.500483+0000","last_peered":"2024-03-16T17:47:51.500483+0000","last_clean":"2024-03-16T17:47:51.500483+0000","last_became_active":"2024-03-16T17:47:50.494538+0000","last_became_peered":"2024-03-16T17:47:50.494538+0000","last_unstale":"2024-03-16T17:47:51.500483+0000","last_undegraded":"2024-03-16T17:47:51.500483+0000","last_fullsized":"2024-03-16T17:47:51.500483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:11.212917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521509+0000","last_change":"2024-03-16T17:47:50.493953+0000","last_active":"2024-03-16T17:47:52.521509+0000","last_peered":"2024-03-16T17:47:52.521509+0000","last_clean":"2024-03-16T17:47:52.521509+0000","last_became_active":"2024-03-16T17:47:50.493629+0000","last_became_peered":"2024-03-16T17:47:50.493629+0000","last_unstale":"2024-03-16T17:47:52.521509+0000","last_undegraded":"2024-03-16T17:47:52.521509+0000","last_fullsized":"2024-03-16T17:47:52.521509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:41:17.182744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500785+0000","last_change":"2024-03-16T17:47:50.495431+0000","last_active":"2024-03-16T17:47:51.500785+0000","last_peered":"2024-03-16T17:47:51.500785+0000","last_clean":"2024-03-16T17:47:51.500785+0000","last_became_active":"2024-03-16T17:47:50.492556+0000","last_became_peered":"2024-03-16T17:47:50.492556+0000","last_unstale":"2024-03-16T17:47:51.500785+0000","last_undegraded":"2024-03-16T17:47:51.500785+0000","last_fullsized":"2024-03-16T17:47:51.500785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:41:17.182744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521080+0000","last_change":"2024-03-16T17:47:50.505084+0000","last_active":"2024-03-16T17:47:52.521080+0000","last_peered":"2024-03-16T17:47:52.521080+0000","last_clean":"2024-03-16T17:47:52.521080+0000","last_became_active":"2024-03-16T17:47:50.504788+0000","last_became_peered":"2024-03-16T17:47:50.504788+0000","last_unstale":"2024-03-16T17:47:52.521080+0000","last_undegraded":"2024-03-16T17:47:52.521080+0000","last_fullsized":"2024-03-16T17:47:52.521080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:57:07.363497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520574+0000","last_change":"2024-03-16T17:47:50.499062+0000","last_active":"2024-03-16T17:47:52.520574+0000","last_peered":"2024-03-16T17:47:52.520574+0000","last_clean":"2024-03-16T17:47:52.520574+0000","last_became_active":"2024-03-16T17:47:50.498783+0000","last_became_peered":"2024-03-16T17:47:50.498783+0000","last_unstale":"2024-03-16T17:47:52.520574+0000","last_undegraded":"2024-03-16T17:47:52.520574+0000","last_fullsized":"2024-03-16T17:47:52.520574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:58:26.517921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521968+0000","last_change":"2024-03-16T17:47:50.502669+0000","last_active":"2024-03-16T17:47:52.521968+0000","last_peered":"2024-03-16T17:47:52.521968+0000","last_clean":"2024-03-16T17:47:52.521968+0000","last_became_active":"2024-03-16T17:47:50.501969+0000","last_became_peered":"2024-03-16T17:47:50.501969+0000","last_unstale":"2024-03-16T17:47:52.521968+0000","last_undegraded":"2024-03-16T17:47:52.521968+0000","last_fullsized":"2024-03-16T17:47:52.521968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:45:04.415199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499708+0000","last_change":"2024-03-16T17:47:50.493316+0000","last_active":"2024-03-16T17:47:51.499708+0000","last_peered":"2024-03-16T17:47:51.499708+0000","last_clean":"2024-03-16T17:47:51.499708+0000","last_became_active":"2024-03-16T17:47:50.493053+0000","last_became_peered":"2024-03-16T17:47:50.493053+0000","last_unstale":"2024-03-16T17:47:51.499708+0000","last_undegraded":"2024-03-16T17:47:51.499708+0000","last_fullsized":"2024-03-16T17:47:51.499708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499549+0000","last_change":"2024-03-16T17:47:50.492718+0000","last_active":"2024-03-16T17:47:51.499549+0000","last_peered":"2024-03-16T17:47:51.499549+0000","last_clean":"2024-03-16T17:47:51.499549+0000","last_became_active":"2024-03-16T17:47:50.492439+0000","last_became_peered":"2024-03-16T17:47:50.492439+0000","last_unstale":"2024-03-16T17:47:51.499549+0000","last_undegraded":"2024-03-16T17:47:51.499549+0000","last_fullsized":"2024-03-16T17:47:51.499549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521619+0000","last_change":"2024-03-16T17:47:50.490986+0000","last_active":"2024-03-16T17:47:52.521619+0000","last_peered":"2024-03-16T17:47:52.521619+0000","last_clean":"2024-03-16T17:47:52.521619+0000","last_became_active":"2024-03-16T17:47:50.490454+0000","last_became_peered":"2024-03-16T17:47:50.490454+0000","last_unstale":"2024-03-16T17:47:52.521619+0000","last_undegraded":"2024-03-16T17:47:52.521619+0000","last_fullsized":"2024-03-16T17:47:52.521619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:44.623412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521178+0000","last_change":"2024-03-16T17:47:50.497782+0000","last_active":"2024-03-16T17:47:52.521178+0000","last_peered":"2024-03-16T17:47:52.521178+0000","last_clean":"2024-03-16T17:47:52.521178+0000","last_became_active":"2024-03-16T17:47:50.497502+0000","last_became_peered":"2024-03-16T17:47:50.497502+0000","last_unstale":"2024-03-16T17:47:52.521178+0000","last_undegraded":"2024-03-16T17:47:52.521178+0000","last_fullsized":"2024-03-16T17:47:52.521178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:39:30.261042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521420+0000","last_change":"2024-03-16T17:47:50.487780+0000","last_active":"2024-03-16T17:47:52.521420+0000","last_peered":"2024-03-16T17:47:52.521420+0000","last_clean":"2024-03-16T17:47:52.521420+0000","last_became_active":"2024-03-16T17:47:50.487531+0000","last_became_peered":"2024-03-16T17:47:50.487531+0000","last_unstale":"2024-03-16T17:47:52.521420+0000","last_undegraded":"2024-03-16T17:47:52.521420+0000","last_fullsized":"2024-03-16T17:47:52.521420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494597+0000","last_change":"2024-03-16T17:47:50.489383+0000","last_active":"2024-03-16T17:47:51.494597+0000","last_peered":"2024-03-16T17:47:51.494597+0000","last_clean":"2024-03-16T17:47:51.494597+0000","last_became_active":"2024-03-16T17:47:50.489069+0000","last_became_peered":"2024-03-16T17:47:50.489069+0000","last_unstale":"2024-03-16T17:47:51.494597+0000","last_undegraded":"2024-03-16T17:47:51.494597+0000","last_fullsized":"2024-03-16T17:47:51.494597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500491+0000","last_change":"2024-03-16T17:47:50.496049+0000","last_active":"2024-03-16T17:47:51.500491+0000","last_peered":"2024-03-16T17:47:51.500491+0000","last_clean":"2024-03-16T17:47:51.500491+0000","last_became_active":"2024-03-16T17:47:50.495736+0000","last_became_peered":"2024-03-16T17:47:50.495736+0000","last_unstale":"2024-03-16T17:47:51.500491+0000","last_undegraded":"2024-03-16T17:47:51.500491+0000","last_fullsized":"2024-03-16T17:47:51.500491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501076+0000","last_change":"2024-03-16T17:47:50.497692+0000","last_active":"2024-03-16T17:47:51.501076+0000","last_peered":"2024-03-16T17:47:51.501076+0000","last_clean":"2024-03-16T17:47:51.501076+0000","last_became_active":"2024-03-16T17:47:50.497133+0000","last_became_peered":"2024-03-16T17:47:50.497133+0000","last_unstale":"2024-03-16T17:47:51.501076+0000","last_undegraded":"2024-03-16T17:47:51.501076+0000","last_fullsized":"2024-03-16T17:47:51.501076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:14:09.646659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522205+0000","last_change":"2024-03-16T17:47:50.490816+0000","last_active":"2024-03-16T17:47:52.522205+0000","last_peered":"2024-03-16T17:47:52.522205+0000","last_clean":"2024-03-16T17:47:52.522205+0000","last_became_active":"2024-03-16T17:47:50.490521+0000","last_became_peered":"2024-03-16T17:47:50.490521+0000","last_unstale":"2024-03-16T17:47:52.522205+0000","last_undegraded":"2024-03-16T17:47:52.522205+0000","last_fullsized":"2024-03-16T17:47:52.522205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:44.623412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521893+0000","last_change":"2024-03-16T17:47:50.495340+0000","last_active":"2024-03-16T17:47:52.521893+0000","last_peered":"2024-03-16T17:47:52.521893+0000","last_clean":"2024-03-16T17:47:52.521893+0000","last_became_active":"2024-03-16T17:47:50.495069+0000","last_became_peered":"2024-03-16T17:47:50.495069+0000","last_unstale":"2024-03-16T17:47:52.521893+0000","last_undegraded":"2024-03-16T17:47:52.521893+0000","last_fullsized":"2024-03-16T17:47:52.521893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:40:23.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499593+0000","last_change":"2024-03-16T17:47:50.491366+0000","last_active":"2024-03-16T17:47:51.499593+0000","last_peered":"2024-03-16T17:47:51.499593+0000","last_clean":"2024-03-16T17:47:51.499593+0000","last_became_active":"2024-03-16T17:47:50.491097+0000","last_became_peered":"2024-03-16T17:47:50.491097+0000","last_unstale":"2024-03-16T17:47:51.499593+0000","last_undegraded":"2024-03-16T17:47:51.499593+0000","last_fullsized":"2024-03-16T17:47:51.499593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521572+0000","last_change":"2024-03-16T17:47:50.496801+0000","last_active":"2024-03-16T17:47:52.521572+0000","last_peered":"2024-03-16T17:47:52.521572+0000","last_clean":"2024-03-16T17:47:52.521572+0000","last_became_active":"2024-03-16T17:47:50.496475+0000","last_became_peered":"2024-03-16T17:47:50.496475+0000","last_unstale":"2024-03-16T17:47:52.521572+0000","last_undegraded":"2024-03-16T17:47:52.521572+0000","last_fullsized":"2024-03-16T17:47:52.521572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500611+0000","last_change":"2024-03-16T17:47:50.497501+0000","last_active":"2024-03-16T17:47:51.500611+0000","last_peered":"2024-03-16T17:47:51.500611+0000","last_clean":"2024-03-16T17:47:51.500611+0000","last_became_active":"2024-03-16T17:47:50.497232+0000","last_became_peered":"2024-03-16T17:47:50.497232+0000","last_unstale":"2024-03-16T17:47:51.500611+0000","last_undegraded":"2024-03-16T17:47:51.500611+0000","last_fullsized":"2024-03-16T17:47:51.500611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:43.769763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520575+0000","last_change":"2024-03-16T17:47:50.500668+0000","last_active":"2024-03-16T17:47:52.520575+0000","last_peered":"2024-03-16T17:47:52.520575+0000","last_clean":"2024-03-16T17:47:52.520575+0000","last_became_active":"2024-03-16T17:47:50.500420+0000","last_became_peered":"2024-03-16T17:47:50.500420+0000","last_unstale":"2024-03-16T17:47:52.520575+0000","last_undegraded":"2024-03-16T17:47:52.520575+0000","last_fullsized":"2024-03-16T17:47:52.520575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500398+0000","last_change":"2024-03-16T17:47:50.494033+0000","last_active":"2024-03-16T17:47:51.500398+0000","last_peered":"2024-03-16T17:47:51.500398+0000","last_clean":"2024-03-16T17:47:51.500398+0000","last_became_active":"2024-03-16T17:47:50.493181+0000","last_became_peered":"2024-03-16T17:47:50.493181+0000","last_unstale":"2024-03-16T17:47:51.500398+0000","last_undegraded":"2024-03-16T17:47:51.500398+0000","last_fullsized":"2024-03-16T17:47:51.500398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521102+0000","last_change":"2024-03-16T17:47:50.501551+0000","last_active":"2024-03-16T17:47:52.521102+0000","last_peered":"2024-03-16T17:47:52.521102+0000","last_clean":"2024-03-16T17:47:52.521102+0000","last_became_active":"2024-03-16T17:47:50.500985+0000","last_became_peered":"2024-03-16T17:47:50.500985+0000","last_unstale":"2024-03-16T17:47:52.521102+0000","last_undegraded":"2024-03-16T17:47:52.521102+0000","last_fullsized":"2024-03-16T17:47:52.521102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:11.212917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499729+0000","last_change":"2024-03-16T17:47:50.494874+0000","last_active":"2024-03-16T17:47:51.499729+0000","last_peered":"2024-03-16T17:47:51.499729+0000","last_clean":"2024-03-16T17:47:51.499729+0000","last_became_active":"2024-03-16T17:47:50.494624+0000","last_became_peered":"2024-03-16T17:47:50.494624+0000","last_unstale":"2024-03-16T17:47:51.499729+0000","last_undegraded":"2024-03-16T17:47:51.499729+0000","last_fullsized":"2024-03-16T17:47:51.499729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494828+0000","last_change":"2024-03-16T17:47:50.495096+0000","last_active":"2024-03-16T17:47:51.494828+0000","last_peered":"2024-03-16T17:47:51.494828+0000","last_clean":"2024-03-16T17:47:51.494828+0000","last_became_active":"2024-03-16T17:47:50.494845+0000","last_became_peered":"2024-03-16T17:47:50.494845+0000","last_unstale":"2024-03-16T17:47:51.494828+0000","last_undegraded":"2024-03-16T17:47:51.494828+0000","last_fullsized":"2024-03-16T17:47:51.494828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521090+0000","last_change":"2024-03-16T17:47:50.496454+0000","last_active":"2024-03-16T17:47:52.521090+0000","last_peered":"2024-03-16T17:47:52.521090+0000","last_clean":"2024-03-16T17:47:52.521090+0000","last_became_active":"2024-03-16T17:47:50.496216+0000","last_became_peered":"2024-03-16T17:47:50.496216+0000","last_unstale":"2024-03-16T17:47:52.521090+0000","last_undegraded":"2024-03-16T17:47:52.521090+0000","last_fullsized":"2024-03-16T17:47:52.521090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521655+0000","last_change":"2024-03-16T17:47:50.493770+0000","last_active":"2024-03-16T17:47:52.521655+0000","last_peered":"2024-03-16T17:47:52.521655+0000","last_clean":"2024-03-16T17:47:52.521655+0000","last_became_active":"2024-03-16T17:47:50.493371+0000","last_became_peered":"2024-03-16T17:47:50.493371+0000","last_unstale":"2024-03-16T17:47:52.521655+0000","last_undegraded":"2024-03-16T17:47:52.521655+0000","last_fullsized":"2024-03-16T17:47:52.521655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500983+0000","last_change":"2024-03-16T17:47:50.493391+0000","last_active":"2024-03-16T17:47:51.500983+0000","last_peered":"2024-03-16T17:47:51.500983+0000","last_clean":"2024-03-16T17:47:51.500983+0000","last_became_active":"2024-03-16T17:47:50.493125+0000","last_became_peered":"2024-03-16T17:47:50.493125+0000","last_unstale":"2024-03-16T17:47:51.500983+0000","last_undegraded":"2024-03-16T17:47:51.500983+0000","last_fullsized":"2024-03-16T17:47:51.500983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:45.171163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522135+0000","last_change":"2024-03-16T17:47:50.492316+0000","last_active":"2024-03-16T17:47:52.522135+0000","last_peered":"2024-03-16T17:47:52.522135+0000","last_clean":"2024-03-16T17:47:52.522135+0000","last_became_active":"2024-03-16T17:47:50.492048+0000","last_became_peered":"2024-03-16T17:47:50.492048+0000","last_unstale":"2024-03-16T17:47:52.522135+0000","last_undegraded":"2024-03-16T17:47:52.522135+0000","last_fullsized":"2024-03-16T17:47:52.522135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:13.979638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499284+0000","last_change":"2024-03-16T17:47:50.500770+0000","last_active":"2024-03-16T17:47:51.499284+0000","last_peered":"2024-03-16T17:47:51.499284+0000","last_clean":"2024-03-16T17:47:51.499284+0000","last_became_active":"2024-03-16T17:47:50.500482+0000","last_became_peered":"2024-03-16T17:47:50.500482+0000","last_unstale":"2024-03-16T17:47:51.499284+0000","last_undegraded":"2024-03-16T17:47:51.499284+0000","last_fullsized":"2024-03-16T17:47:51.499284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521043+0000","last_change":"2024-03-16T17:47:50.489102+0000","last_active":"2024-03-16T17:47:52.521043+0000","last_peered":"2024-03-16T17:47:52.521043+0000","last_clean":"2024-03-16T17:47:52.521043+0000","last_became_active":"2024-03-16T17:47:50.488757+0000","last_became_peered":"2024-03-16T17:47:50.488757+0000","last_unstale":"2024-03-16T17:47:52.521043+0000","last_undegraded":"2024-03-16T17:47:52.521043+0000","last_fullsized":"2024-03-16T17:47:52.521043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:53.335867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521375+0000","last_change":"2024-03-16T17:47:49.484094+0000","last_active":"2024-03-16T17:47:52.521375+0000","last_peered":"2024-03-16T17:47:52.521375+0000","last_clean":"2024-03-16T17:47:52.521375+0000","last_became_active":"2024-03-16T17:47:49.483835+0000","last_became_peered":"2024-03-16T17:47:49.483835+0000","last_unstale":"2024-03-16T17:47:52.521375+0000","last_undegraded":"2024-03-16T17:47:52.521375+0000","last_fullsized":"2024-03-16T17:47:52.521375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521642+0000","last_change":"2024-03-16T17:47:50.492375+0000","last_active":"2024-03-16T17:47:52.521642+0000","last_peered":"2024-03-16T17:47:52.521642+0000","last_clean":"2024-03-16T17:47:52.521642+0000","last_became_active":"2024-03-16T17:47:50.492119+0000","last_became_peered":"2024-03-16T17:47:50.492119+0000","last_unstale":"2024-03-16T17:47:52.521642+0000","last_undegraded":"2024-03-16T17:47:52.521642+0000","last_fullsized":"2024-03-16T17:47:52.521642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499392+0000","last_change":"2024-03-16T17:47:49.480693+0000","last_active":"2024-03-16T17:47:51.499392+0000","last_peered":"2024-03-16T17:47:51.499392+0000","last_clean":"2024-03-16T17:47:51.499392+0000","last_became_active":"2024-03-16T17:47:49.480396+0000","last_became_peered":"2024-03-16T17:47:49.480396+0000","last_unstale":"2024-03-16T17:47:51.499392+0000","last_undegraded":"2024-03-16T17:47:51.499392+0000","last_fullsized":"2024-03-16T17:47:51.499392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520666+0000","last_change":"2024-03-16T17:47:49.482964+0000","last_active":"2024-03-16T17:47:52.520666+0000","last_peered":"2024-03-16T17:47:52.520666+0000","last_clean":"2024-03-16T17:47:52.520666+0000","last_became_active":"2024-03-16T17:47:49.482603+0000","last_became_peered":"2024-03-16T17:47:49.482603+0000","last_unstale":"2024-03-16T17:47:52.520666+0000","last_undegraded":"2024-03-16T17:47:52.520666+0000","last_fullsized":"2024-03-16T17:47:52.520666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:18:43.224585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520762+0000","last_change":"2024-03-16T17:47:50.504067+0000","last_active":"2024-03-16T17:47:52.520762+0000","last_peered":"2024-03-16T17:47:52.520762+0000","last_clean":"2024-03-16T17:47:52.520762+0000","last_became_active":"2024-03-16T17:47:50.503836+0000","last_became_peered":"2024-03-16T17:47:50.503836+0000","last_unstale":"2024-03-16T17:47:52.520762+0000","last_undegraded":"2024-03-16T17:47:52.520762+0000","last_fullsized":"2024-03-16T17:47:52.520762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500556+0000","last_change":"2024-03-16T17:47:49.480169+0000","last_active":"2024-03-16T17:47:51.500556+0000","last_peered":"2024-03-16T17:47:51.500556+0000","last_clean":"2024-03-16T17:47:51.500556+0000","last_became_active":"2024-03-16T17:47:49.478055+0000","last_became_peered":"2024-03-16T17:47:49.478055+0000","last_unstale":"2024-03-16T17:47:51.500556+0000","last_undegraded":"2024-03-16T17:47:51.500556+0000","last_fullsized":"2024-03-16T17:47:51.500556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494549+0000","last_change":"2024-03-16T17:47:50.493815+0000","last_active":"2024-03-16T17:47:51.494549+0000","last_peered":"2024-03-16T17:47:51.494549+0000","last_clean":"2024-03-16T17:47:51.494549+0000","last_became_active":"2024-03-16T17:47:50.493522+0000","last_became_peered":"2024-03-16T17:47:50.493522+0000","last_unstale":"2024-03-16T17:47:51.494549+0000","last_undegraded":"2024-03-16T17:47:51.494549+0000","last_fullsized":"2024-03-16T17:47:51.494549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499476+0000","last_change":"2024-03-16T17:47:49.486100+0000","last_active":"2024-03-16T17:47:51.499476+0000","last_peered":"2024-03-16T17:47:51.499476+0000","last_clean":"2024-03-16T17:47:51.499476+0000","last_became_active":"2024-03-16T17:47:49.485816+0000","last_became_peered":"2024-03-16T17:47:49.485816+0000","last_unstale":"2024-03-16T17:47:51.499476+0000","last_undegraded":"2024-03-16T17:47:51.499476+0000","last_fullsized":"2024-03-16T17:47:51.499476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:58.531025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500516+0000","last_change":"2024-03-16T17:47:50.497437+0000","last_active":"2024-03-16T17:47:51.500516+0000","last_peered":"2024-03-16T17:47:51.500516+0000","last_clean":"2024-03-16T17:47:51.500516+0000","last_became_active":"2024-03-16T17:47:50.497148+0000","last_became_peered":"2024-03-16T17:47:50.497148+0000","last_unstale":"2024-03-16T17:47:51.500516+0000","last_undegraded":"2024-03-16T17:47:51.500516+0000","last_fullsized":"2024-03-16T17:47:51.500516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:39:30.261042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500710+0000","last_change":"2024-03-16T17:47:49.482053+0000","last_active":"2024-03-16T17:47:51.500710+0000","last_peered":"2024-03-16T17:47:51.500710+0000","last_clean":"2024-03-16T17:47:51.500710+0000","last_became_active":"2024-03-16T17:47:49.481763+0000","last_became_peered":"2024-03-16T17:47:49.481763+0000","last_unstale":"2024-03-16T17:47:51.500710+0000","last_undegraded":"2024-03-16T17:47:51.500710+0000","last_fullsized":"2024-03-16T17:47:51.500710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:58.531025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521081+0000","last_change":"2024-03-16T17:47:50.504585+0000","last_active":"2024-03-16T17:47:52.521081+0000","last_peered":"2024-03-16T17:47:52.521081+0000","last_clean":"2024-03-16T17:47:52.521081+0000","last_became_active":"2024-03-16T17:47:50.502857+0000","last_became_peered":"2024-03-16T17:47:50.502857+0000","last_unstale":"2024-03-16T17:47:52.521081+0000","last_undegraded":"2024-03-16T17:47:52.521081+0000","last_fullsized":"2024-03-16T17:47:52.521081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:22:00.192672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494819+0000","last_change":"2024-03-16T17:47:49.485845+0000","last_active":"2024-03-16T17:47:51.494819+0000","last_peered":"2024-03-16T17:47:51.494819+0000","last_clean":"2024-03-16T17:47:51.494819+0000","last_became_active":"2024-03-16T17:47:49.485582+0000","last_became_peered":"2024-03-16T17:47:49.485582+0000","last_unstale":"2024-03-16T17:47:51.494819+0000","last_undegraded":"2024-03-16T17:47:51.494819+0000","last_fullsized":"2024-03-16T17:47:51.494819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:58.531025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521613+0000","last_change":"2024-03-16T17:47:50.498096+0000","last_active":"2024-03-16T17:47:52.521613+0000","last_peered":"2024-03-16T17:47:52.521613+0000","last_clean":"2024-03-16T17:47:52.521613+0000","last_became_active":"2024-03-16T17:47:50.495381+0000","last_became_peered":"2024-03-16T17:47:50.495381+0000","last_unstale":"2024-03-16T17:47:52.521613+0000","last_undegraded":"2024-03-16T17:47:52.521613+0000","last_fullsized":"2024-03-16T17:47:52.521613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:13.979638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499604+0000","last_change":"2024-03-16T17:47:49.483811+0000","last_active":"2024-03-16T17:47:51.499604+0000","last_peered":"2024-03-16T17:47:51.499604+0000","last_clean":"2024-03-16T17:47:51.499604+0000","last_became_active":"2024-03-16T17:47:49.483494+0000","last_became_peered":"2024-03-16T17:47:49.483494+0000","last_unstale":"2024-03-16T17:47:51.499604+0000","last_undegraded":"2024-03-16T17:47:51.499604+0000","last_fullsized":"2024-03-16T17:47:51.499604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521750+0000","last_change":"2024-03-16T17:47:50.499367+0000","last_active":"2024-03-16T17:47:52.521750+0000","last_peered":"2024-03-16T17:47:52.521750+0000","last_clean":"2024-03-16T17:47:52.521750+0000","last_became_active":"2024-03-16T17:47:50.499087+0000","last_became_peered":"2024-03-16T17:47:50.499087+0000","last_unstale":"2024-03-16T17:47:52.521750+0000","last_undegraded":"2024-03-16T17:47:52.521750+0000","last_fullsized":"2024-03-16T17:47:52.521750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:02:20.712220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521724+0000","last_change":"2024-03-16T17:47:49.484787+0000","last_active":"2024-03-16T17:47:52.521724+0000","last_peered":"2024-03-16T17:47:52.521724+0000","last_clean":"2024-03-16T17:47:52.521724+0000","last_became_active":"2024-03-16T17:47:49.484518+0000","last_became_peered":"2024-03-16T17:47:49.484518+0000","last_unstale":"2024-03-16T17:47:52.521724+0000","last_undegraded":"2024-03-16T17:47:52.521724+0000","last_fullsized":"2024-03-16T17:47:52.521724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:39:26.504278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521491+0000","last_change":"2024-03-16T17:47:50.491184+0000","last_active":"2024-03-16T17:47:52.521491+0000","last_peered":"2024-03-16T17:47:52.521491+0000","last_clean":"2024-03-16T17:47:52.521491+0000","last_became_active":"2024-03-16T17:47:50.490924+0000","last_became_peered":"2024-03-16T17:47:50.490924+0000","last_unstale":"2024-03-16T17:47:52.521491+0000","last_undegraded":"2024-03-16T17:47:52.521491+0000","last_fullsized":"2024-03-16T17:47:52.521491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501121+0000","last_change":"2024-03-16T17:47:49.483984+0000","last_active":"2024-03-16T17:47:51.501121+0000","last_peered":"2024-03-16T17:47:51.501121+0000","last_clean":"2024-03-16T17:47:51.501121+0000","last_became_active":"2024-03-16T17:47:49.483687+0000","last_became_peered":"2024-03-16T17:47:49.483687+0000","last_unstale":"2024-03-16T17:47:51.501121+0000","last_undegraded":"2024-03-16T17:47:51.501121+0000","last_fullsized":"2024-03-16T17:47:51.501121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521501+0000","last_change":"2024-03-16T17:47:50.500826+0000","last_active":"2024-03-16T17:47:52.521501+0000","last_peered":"2024-03-16T17:47:52.521501+0000","last_clean":"2024-03-16T17:47:52.521501+0000","last_became_active":"2024-03-16T17:47:50.500555+0000","last_became_peered":"2024-03-16T17:47:50.500555+0000","last_unstale":"2024-03-16T17:47:52.521501+0000","last_undegraded":"2024-03-16T17:47:52.521501+0000","last_fullsized":"2024-03-16T17:47:52.521501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:48:00.859392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499164+0000","last_change":"2024-03-16T17:47:49.480239+0000","last_active":"2024-03-16T17:47:51.499164+0000","last_peered":"2024-03-16T17:47:51.499164+0000","last_clean":"2024-03-16T17:47:51.499164+0000","last_became_active":"2024-03-16T17:47:49.479908+0000","last_became_peered":"2024-03-16T17:47:49.479908+0000","last_unstale":"2024-03-16T17:47:51.499164+0000","last_undegraded":"2024-03-16T17:47:51.499164+0000","last_fullsized":"2024-03-16T17:47:51.499164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499604+0000","last_change":"2024-03-16T17:47:50.492853+0000","last_active":"2024-03-16T17:47:51.499604+0000","last_peered":"2024-03-16T17:47:51.499604+0000","last_clean":"2024-03-16T17:47:51.499604+0000","last_became_active":"2024-03-16T17:47:50.492558+0000","last_became_peered":"2024-03-16T17:47:50.492558+0000","last_unstale":"2024-03-16T17:47:51.499604+0000","last_undegraded":"2024-03-16T17:47:51.499604+0000","last_fullsized":"2024-03-16T17:47:51.499604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522062+0000","last_change":"2024-03-16T17:47:49.479326+0000","last_active":"2024-03-16T17:47:52.522062+0000","last_peered":"2024-03-16T17:47:52.522062+0000","last_clean":"2024-03-16T17:47:52.522062+0000","last_became_active":"2024-03-16T17:47:49.479034+0000","last_became_peered":"2024-03-16T17:47:49.479034+0000","last_unstale":"2024-03-16T17:47:52.522062+0000","last_undegraded":"2024-03-16T17:47:52.522062+0000","last_fullsized":"2024-03-16T17:47:52.522062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521246+0000","last_change":"2024-03-16T17:47:50.500094+0000","last_active":"2024-03-16T17:47:52.521246+0000","last_peered":"2024-03-16T17:47:52.521246+0000","last_clean":"2024-03-16T17:47:52.521246+0000","last_became_active":"2024-03-16T17:47:50.499817+0000","last_became_peered":"2024-03-16T17:47:50.499817+0000","last_unstale":"2024-03-16T17:47:52.521246+0000","last_undegraded":"2024-03-16T17:47:52.521246+0000","last_fullsized":"2024-03-16T17:47:52.521246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:43.769763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521499+0000","last_change":"2024-03-16T17:47:49.483884+0000","last_active":"2024-03-16T17:47:52.521499+0000","last_peered":"2024-03-16T17:47:52.521499+0000","last_clean":"2024-03-16T17:47:52.521499+0000","last_became_active":"2024-03-16T17:47:49.483542+0000","last_became_peered":"2024-03-16T17:47:49.483542+0000","last_unstale":"2024-03-16T17:47:52.521499+0000","last_undegraded":"2024-03-16T17:47:52.521499+0000","last_fullsized":"2024-03-16T17:47:52.521499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:20:40.919920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521833+0000","last_change":"2024-03-16T17:47:50.498543+0000","last_active":"2024-03-16T17:47:52.521833+0000","last_peered":"2024-03-16T17:47:52.521833+0000","last_clean":"2024-03-16T17:47:52.521833+0000","last_became_active":"2024-03-16T17:47:50.498283+0000","last_became_peered":"2024-03-16T17:47:50.498283+0000","last_unstale":"2024-03-16T17:47:52.521833+0000","last_undegraded":"2024-03-16T17:47:52.521833+0000","last_fullsized":"2024-03-16T17:47:52.521833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:14:09.646659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522156+0000","last_change":"2024-03-16T17:47:49.484771+0000","last_active":"2024-03-16T17:47:52.522156+0000","last_peered":"2024-03-16T17:47:52.522156+0000","last_clean":"2024-03-16T17:47:52.522156+0000","last_became_active":"2024-03-16T17:47:49.484490+0000","last_became_peered":"2024-03-16T17:47:49.484490+0000","last_unstale":"2024-03-16T17:47:52.522156+0000","last_undegraded":"2024-03-16T17:47:52.522156+0000","last_fullsized":"2024-03-16T17:47:52.522156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522091+0000","last_change":"2024-03-16T17:47:50.505116+0000","last_active":"2024-03-16T17:47:52.522091+0000","last_peered":"2024-03-16T17:47:52.522091+0000","last_clean":"2024-03-16T17:47:52.522091+0000","last_became_active":"2024-03-16T17:47:50.504865+0000","last_became_peered":"2024-03-16T17:47:50.504865+0000","last_unstale":"2024-03-16T17:47:52.522091+0000","last_undegraded":"2024-03-16T17:47:52.522091+0000","last_fullsized":"2024-03-16T17:47:52.522091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:08:08.823896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494934+0000","last_change":"2024-03-16T17:47:49.477416+0000","last_active":"2024-03-16T17:47:51.494934+0000","last_peered":"2024-03-16T17:47:51.494934+0000","last_clean":"2024-03-16T17:47:51.494934+0000","last_became_active":"2024-03-16T17:47:49.477156+0000","last_became_peered":"2024-03-16T17:47:49.477156+0000","last_unstale":"2024-03-16T17:47:51.494934+0000","last_undegraded":"2024-03-16T17:47:51.494934+0000","last_fullsized":"2024-03-16T17:47:51.494934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500668+0000","last_change":"2024-03-16T17:47:50.493922+0000","last_active":"2024-03-16T17:47:51.500668+0000","last_peered":"2024-03-16T17:47:51.500668+0000","last_clean":"2024-03-16T17:47:51.500668+0000","last_became_active":"2024-03-16T17:47:50.493259+0000","last_became_peered":"2024-03-16T17:47:50.493259+0000","last_unstale":"2024-03-16T17:47:51.500668+0000","last_undegraded":"2024-03-16T17:47:51.500668+0000","last_fullsized":"2024-03-16T17:47:51.500668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:48:00.859392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522188+0000","last_change":"2024-03-16T17:47:49.481283+0000","last_active":"2024-03-16T17:47:52.522188+0000","last_peered":"2024-03-16T17:47:52.522188+0000","last_clean":"2024-03-16T17:47:52.522188+0000","last_became_active":"2024-03-16T17:47:49.480969+0000","last_became_peered":"2024-03-16T17:47:49.480969+0000","last_unstale":"2024-03-16T17:47:52.522188+0000","last_undegraded":"2024-03-16T17:47:52.522188+0000","last_fullsized":"2024-03-16T17:47:52.522188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:18:43.224585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521666+0000","last_change":"2024-03-16T17:47:50.494717+0000","last_active":"2024-03-16T17:47:52.521666+0000","last_peered":"2024-03-16T17:47:52.521666+0000","last_clean":"2024-03-16T17:47:52.521666+0000","last_became_active":"2024-03-16T17:47:50.494415+0000","last_became_peered":"2024-03-16T17:47:50.494415+0000","last_unstale":"2024-03-16T17:47:52.521666+0000","last_undegraded":"2024-03-16T17:47:52.521666+0000","last_fullsized":"2024-03-16T17:47:52.521666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:45.171163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520876+0000","last_change":"2024-03-16T17:47:39.177353+0000","last_active":"2024-03-16T17:47:52.520876+0000","last_peered":"2024-03-16T17:47:52.520876+0000","last_clean":"2024-03-16T17:47:52.520876+0000","last_became_active":"2024-03-16T17:47:39.176109+0000","last_became_peered":"2024-03-16T17:47:39.176109+0000","last_unstale":"2024-03-16T17:47:52.520876+0000","last_undegraded":"2024-03-16T17:47:52.520876+0000","last_fullsized":"2024-03-16T17:47:52.520876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_clean_scrub_stamp":"2024-03-16T17:47:37.885590+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:47.704856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500310+0000","last_change":"2024-03-16T17:47:49.482795+0000","last_active":"2024-03-16T17:47:51.500310+0000","last_peered":"2024-03-16T17:47:51.500310+0000","last_clean":"2024-03-16T17:47:51.500310+0000","last_became_active":"2024-03-16T17:47:49.482524+0000","last_became_peered":"2024-03-16T17:47:49.482524+0000","last_unstale":"2024-03-16T17:47:51.500310+0000","last_undegraded":"2024-03-16T17:47:51.500310+0000","last_fullsized":"2024-03-16T17:47:51.500310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520716+0000","last_change":"2024-03-16T17:47:50.499991+0000","last_active":"2024-03-16T17:47:52.520716+0000","last_peered":"2024-03-16T17:47:52.520716+0000","last_clean":"2024-03-16T17:47:52.520716+0000","last_became_active":"2024-03-16T17:47:50.499726+0000","last_became_peered":"2024-03-16T17:47:50.499726+0000","last_unstale":"2024-03-16T17:47:52.520716+0000","last_undegraded":"2024-03-16T17:47:52.520716+0000","last_fullsized":"2024-03-16T17:47:52.520716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521734+0000","last_change":"2024-03-16T17:47:49.482775+0000","last_active":"2024-03-16T17:47:52.521734+0000","last_peered":"2024-03-16T17:47:52.521734+0000","last_clean":"2024-03-16T17:47:52.521734+0000","last_became_active":"2024-03-16T17:47:49.482367+0000","last_became_peered":"2024-03-16T17:47:49.482367+0000","last_unstale":"2024-03-16T17:47:52.521734+0000","last_undegraded":"2024-03-16T17:47:52.521734+0000","last_fullsized":"2024-03-16T17:47:52.521734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521344+0000","last_change":"2024-03-16T17:47:50.491608+0000","last_active":"2024-03-16T17:47:52.521344+0000","last_peered":"2024-03-16T17:47:52.521344+0000","last_clean":"2024-03-16T17:47:52.521344+0000","last_became_active":"2024-03-16T17:47:50.491341+0000","last_became_peered":"2024-03-16T17:47:50.491341+0000","last_unstale":"2024-03-16T17:47:52.521344+0000","last_undegraded":"2024-03-16T17:47:52.521344+0000","last_fullsized":"2024-03-16T17:47:52.521344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522116+0000","last_change":"2024-03-16T17:47:49.483339+0000","last_active":"2024-03-16T17:47:52.522116+0000","last_peered":"2024-03-16T17:47:52.522116+0000","last_clean":"2024-03-16T17:47:52.522116+0000","last_became_active":"2024-03-16T17:47:49.483030+0000","last_became_peered":"2024-03-16T17:47:49.483030+0000","last_unstale":"2024-03-16T17:47:52.522116+0000","last_undegraded":"2024-03-16T17:47:52.522116+0000","last_fullsized":"2024-03-16T17:47:52.522116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494583+0000","last_change":"2024-03-16T17:47:50.492425+0000","last_active":"2024-03-16T17:47:51.494583+0000","last_peered":"2024-03-16T17:47:51.494583+0000","last_clean":"2024-03-16T17:47:51.494583+0000","last_became_active":"2024-03-16T17:47:50.492129+0000","last_became_peered":"2024-03-16T17:47:50.492129+0000","last_unstale":"2024-03-16T17:47:51.494583+0000","last_undegraded":"2024-03-16T17:47:51.494583+0000","last_fullsized":"2024-03-16T17:47:51.494583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501157+0000","last_change":"2024-03-16T17:47:49.479391+0000","last_active":"2024-03-16T17:47:51.501157+0000","last_peered":"2024-03-16T17:47:51.501157+0000","last_clean":"2024-03-16T17:47:51.501157+0000","last_became_active":"2024-03-16T17:47:49.479121+0000","last_became_peered":"2024-03-16T17:47:49.479121+0000","last_unstale":"2024-03-16T17:47:51.501157+0000","last_undegraded":"2024-03-16T17:47:51.501157+0000","last_fullsized":"2024-03-16T17:47:51.501157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521315+0000","last_change":"2024-03-16T17:47:50.497378+0000","last_active":"2024-03-16T17:47:52.521315+0000","last_peered":"2024-03-16T17:47:52.521315+0000","last_clean":"2024-03-16T17:47:52.521315+0000","last_became_active":"2024-03-16T17:47:50.497042+0000","last_became_peered":"2024-03-16T17:47:50.497042+0000","last_unstale":"2024-03-16T17:47:52.521315+0000","last_undegraded":"2024-03-16T17:47:52.521315+0000","last_fullsized":"2024-03-16T17:47:52.521315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:02.404060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494714+0000","last_change":"2024-03-16T17:47:49.481660+0000","last_active":"2024-03-16T17:47:51.494714+0000","last_peered":"2024-03-16T17:47:51.494714+0000","last_clean":"2024-03-16T17:47:51.494714+0000","last_became_active":"2024-03-16T17:47:49.481419+0000","last_became_peered":"2024-03-16T17:47:49.481419+0000","last_unstale":"2024-03-16T17:47:51.494714+0000","last_undegraded":"2024-03-16T17:47:51.494714+0000","last_fullsized":"2024-03-16T17:47:51.494714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501144+0000","last_change":"2024-03-16T17:47:50.496399+0000","last_active":"2024-03-16T17:47:51.501144+0000","last_peered":"2024-03-16T17:47:51.501144+0000","last_clean":"2024-03-16T17:47:51.501144+0000","last_became_active":"2024-03-16T17:47:50.496000+0000","last_became_peered":"2024-03-16T17:47:50.496000+0000","last_unstale":"2024-03-16T17:47:51.501144+0000","last_undegraded":"2024-03-16T17:47:51.501144+0000","last_fullsized":"2024-03-16T17:47:51.501144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:40:23.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521930+0000","last_change":"2024-03-16T17:47:49.484747+0000","last_active":"2024-03-16T17:47:52.521930+0000","last_peered":"2024-03-16T17:47:52.521930+0000","last_clean":"2024-03-16T17:47:52.521930+0000","last_became_active":"2024-03-16T17:47:49.484405+0000","last_became_peered":"2024-03-16T17:47:49.484405+0000","last_unstale":"2024-03-16T17:47:52.521930+0000","last_undegraded":"2024-03-16T17:47:52.521930+0000","last_fullsized":"2024-03-16T17:47:52.521930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:21:22.363663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494614+0000","last_change":"2024-03-16T17:47:50.492799+0000","last_active":"2024-03-16T17:47:51.494614+0000","last_peered":"2024-03-16T17:47:51.494614+0000","last_clean":"2024-03-16T17:47:51.494614+0000","last_became_active":"2024-03-16T17:47:50.492116+0000","last_became_peered":"2024-03-16T17:47:50.492116+0000","last_unstale":"2024-03-16T17:47:51.494614+0000","last_undegraded":"2024-03-16T17:47:51.494614+0000","last_fullsized":"2024-03-16T17:47:51.494614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.498597+0000","last_change":"2024-03-16T17:47:49.480286+0000","last_active":"2024-03-16T17:47:51.498597+0000","last_peered":"2024-03-16T17:47:51.498597+0000","last_clean":"2024-03-16T17:47:51.498597+0000","last_became_active":"2024-03-16T17:47:49.479968+0000","last_became_peered":"2024-03-16T17:47:49.479968+0000","last_unstale":"2024-03-16T17:47:51.498597+0000","last_undegraded":"2024-03-16T17:47:51.498597+0000","last_fullsized":"2024-03-16T17:47:51.498597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:43.618484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521225+0000","last_change":"2024-03-16T17:47:50.496046+0000","last_active":"2024-03-16T17:47:52.521225+0000","last_peered":"2024-03-16T17:47:52.521225+0000","last_clean":"2024-03-16T17:47:52.521225+0000","last_became_active":"2024-03-16T17:47:50.495774+0000","last_became_peered":"2024-03-16T17:47:50.495774+0000","last_unstale":"2024-03-16T17:47:52.521225+0000","last_undegraded":"2024-03-16T17:47:52.521225+0000","last_fullsized":"2024-03-16T17:47:52.521225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:57:07.363497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499593+0000","last_change":"2024-03-16T17:47:49.478995+0000","last_active":"2024-03-16T17:47:51.499593+0000","last_peered":"2024-03-16T17:47:51.499593+0000","last_clean":"2024-03-16T17:47:51.499593+0000","last_became_active":"2024-03-16T17:47:49.478495+0000","last_became_peered":"2024-03-16T17:47:49.478495+0000","last_unstale":"2024-03-16T17:47:51.499593+0000","last_undegraded":"2024-03-16T17:47:51.499593+0000","last_fullsized":"2024-03-16T17:47:51.499593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521105+0000","last_change":"2024-03-16T17:47:50.488336+0000","last_active":"2024-03-16T17:47:52.521105+0000","last_peered":"2024-03-16T17:47:52.521105+0000","last_clean":"2024-03-16T17:47:52.521105+0000","last_became_active":"2024-03-16T17:47:50.488097+0000","last_became_peered":"2024-03-16T17:47:50.488097+0000","last_unstale":"2024-03-16T17:47:52.521105+0000","last_undegraded":"2024-03-16T17:47:52.521105+0000","last_fullsized":"2024-03-16T17:47:52.521105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:48:41.055949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520819+0000","last_change":"2024-03-16T17:47:49.485058+0000","last_active":"2024-03-16T17:47:52.520819+0000","last_peered":"2024-03-16T17:47:52.520819+0000","last_clean":"2024-03-16T17:47:52.520819+0000","last_became_active":"2024-03-16T17:47:49.484767+0000","last_became_peered":"2024-03-16T17:47:49.484767+0000","last_unstale":"2024-03-16T17:47:52.520819+0000","last_undegraded":"2024-03-16T17:47:52.520819+0000","last_fullsized":"2024-03-16T17:47:52.520819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:12.974711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521233+0000","last_change":"2024-03-16T17:47:50.491877+0000","last_active":"2024-03-16T17:47:52.521233+0000","last_peered":"2024-03-16T17:47:52.521233+0000","last_clean":"2024-03-16T17:47:52.521233+0000","last_became_active":"2024-03-16T17:47:50.491512+0000","last_became_peered":"2024-03-16T17:47:50.491512+0000","last_unstale":"2024-03-16T17:47:52.521233+0000","last_undegraded":"2024-03-16T17:47:52.521233+0000","last_fullsized":"2024-03-16T17:47:52.521233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:59.535953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494603+0000","last_change":"2024-03-16T17:47:49.478211+0000","last_active":"2024-03-16T17:47:51.494603+0000","last_peered":"2024-03-16T17:47:51.494603+0000","last_clean":"2024-03-16T17:47:51.494603+0000","last_became_active":"2024-03-16T17:47:49.477944+0000","last_became_peered":"2024-03-16T17:47:49.477944+0000","last_unstale":"2024-03-16T17:47:51.494603+0000","last_undegraded":"2024-03-16T17:47:51.494603+0000","last_fullsized":"2024-03-16T17:47:51.494603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:12.974711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520683+0000","last_change":"2024-03-16T17:47:50.496170+0000","last_active":"2024-03-16T17:47:52.520683+0000","last_peered":"2024-03-16T17:47:52.520683+0000","last_clean":"2024-03-16T17:47:52.520683+0000","last_became_active":"2024-03-16T17:47:50.495911+0000","last_became_peered":"2024-03-16T17:47:50.495911+0000","last_unstale":"2024-03-16T17:47:52.520683+0000","last_undegraded":"2024-03-16T17:47:52.520683+0000","last_fullsized":"2024-03-16T17:47:52.520683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494768+0000","last_change":"2024-03-16T17:47:49.487179+0000","last_active":"2024-03-16T17:47:51.494768+0000","last_peered":"2024-03-16T17:47:51.494768+0000","last_clean":"2024-03-16T17:47:51.494768+0000","last_became_active":"2024-03-16T17:47:49.486891+0000","last_became_peered":"2024-03-16T17:47:49.486891+0000","last_unstale":"2024-03-16T17:47:51.494768+0000","last_undegraded":"2024-03-16T17:47:51.494768+0000","last_fullsized":"2024-03-16T17:47:51.494768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521308+0000","last_change":"2024-03-16T17:47:50.493256+0000","last_active":"2024-03-16T17:47:52.521308+0000","last_peered":"2024-03-16T17:47:52.521308+0000","last_clean":"2024-03-16T17:47:52.521308+0000","last_became_active":"2024-03-16T17:47:50.492993+0000","last_became_peered":"2024-03-16T17:47:50.492993+0000","last_unstale":"2024-03-16T17:47:52.521308+0000","last_undegraded":"2024-03-16T17:47:52.521308+0000","last_fullsized":"2024-03-16T17:47:52.521308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:43.769763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521638+0000","last_change":"2024-03-16T17:47:49.485238+0000","last_active":"2024-03-16T17:47:52.521638+0000","last_peered":"2024-03-16T17:47:52.521638+0000","last_clean":"2024-03-16T17:47:52.521638+0000","last_became_active":"2024-03-16T17:47:49.484882+0000","last_became_peered":"2024-03-16T17:47:49.484882+0000","last_unstale":"2024-03-16T17:47:52.521638+0000","last_undegraded":"2024-03-16T17:47:52.521638+0000","last_fullsized":"2024-03-16T17:47:52.521638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:01:30.780692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499249+0000","last_change":"2024-03-16T17:47:50.491997+0000","last_active":"2024-03-16T17:47:51.499249+0000","last_peered":"2024-03-16T17:47:51.499249+0000","last_clean":"2024-03-16T17:47:51.499249+0000","last_became_active":"2024-03-16T17:47:50.491733+0000","last_became_peered":"2024-03-16T17:47:50.491733+0000","last_unstale":"2024-03-16T17:47:51.499249+0000","last_undegraded":"2024-03-16T17:47:51.499249+0000","last_fullsized":"2024-03-16T17:47:51.499249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:58:26.517921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501072+0000","last_change":"2024-03-16T17:47:50.500620+0000","last_active":"2024-03-16T17:47:51.501072+0000","last_peered":"2024-03-16T17:47:51.501072+0000","last_clean":"2024-03-16T17:47:51.501072+0000","last_became_active":"2024-03-16T17:47:50.500350+0000","last_became_peered":"2024-03-16T17:47:50.500350+0000","last_unstale":"2024-03-16T17:47:51.501072+0000","last_undegraded":"2024-03-16T17:47:51.501072+0000","last_fullsized":"2024-03-16T17:47:51.501072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:02:20.712220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521598+0000","last_change":"2024-03-16T17:47:49.486202+0000","last_active":"2024-03-16T17:47:52.521598+0000","last_peered":"2024-03-16T17:47:52.521598+0000","last_clean":"2024-03-16T17:47:52.521598+0000","last_became_active":"2024-03-16T17:47:49.485500+0000","last_became_peered":"2024-03-16T17:47:49.485500+0000","last_unstale":"2024-03-16T17:47:52.521598+0000","last_undegraded":"2024-03-16T17:47:52.521598+0000","last_fullsized":"2024-03-16T17:47:52.521598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:43.618484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500577+0000","last_change":"2024-03-16T17:47:50.491413+0000","last_active":"2024-03-16T17:47:51.500577+0000","last_peered":"2024-03-16T17:47:51.500577+0000","last_clean":"2024-03-16T17:47:51.500577+0000","last_became_active":"2024-03-16T17:47:50.491137+0000","last_became_peered":"2024-03-16T17:47:50.491137+0000","last_unstale":"2024-03-16T17:47:51.500577+0000","last_undegraded":"2024-03-16T17:47:51.500577+0000","last_fullsized":"2024-03-16T17:47:51.500577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:57:07.363497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521824+0000","last_change":"2024-03-16T17:47:49.481386+0000","last_active":"2024-03-16T17:47:52.521824+0000","last_peered":"2024-03-16T17:47:52.521824+0000","last_clean":"2024-03-16T17:47:52.521824+0000","last_became_active":"2024-03-16T17:47:49.481018+0000","last_became_peered":"2024-03-16T17:47:49.481018+0000","last_unstale":"2024-03-16T17:47:52.521824+0000","last_undegraded":"2024-03-16T17:47:52.521824+0000","last_fullsized":"2024-03-16T17:47:52.521824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:29:10.861159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520936+0000","last_change":"2024-03-16T17:47:50.504628+0000","last_active":"2024-03-16T17:47:52.520936+0000","last_peered":"2024-03-16T17:47:52.520936+0000","last_clean":"2024-03-16T17:47:52.520936+0000","last_became_active":"2024-03-16T17:47:50.503220+0000","last_became_peered":"2024-03-16T17:47:50.503220+0000","last_unstale":"2024-03-16T17:47:52.520936+0000","last_undegraded":"2024-03-16T17:47:52.520936+0000","last_fullsized":"2024-03-16T17:47:52.520936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:21:23.368591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521157+0000","last_change":"2024-03-16T17:47:49.486523+0000","last_active":"2024-03-16T17:47:52.521157+0000","last_peered":"2024-03-16T17:47:52.521157+0000","last_clean":"2024-03-16T17:47:52.521157+0000","last_became_active":"2024-03-16T17:47:49.486072+0000","last_became_peered":"2024-03-16T17:47:49.486072+0000","last_unstale":"2024-03-16T17:47:52.521157+0000","last_undegraded":"2024-03-16T17:47:52.521157+0000","last_fullsized":"2024-03-16T17:47:52.521157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:49:57.754681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520972+0000","last_change":"2024-03-16T17:47:50.497830+0000","last_active":"2024-03-16T17:47:52.520972+0000","last_peered":"2024-03-16T17:47:52.520972+0000","last_clean":"2024-03-16T17:47:52.520972+0000","last_became_active":"2024-03-16T17:47:50.497566+0000","last_became_peered":"2024-03-16T17:47:50.497566+0000","last_unstale":"2024-03-16T17:47:52.520972+0000","last_undegraded":"2024-03-16T17:47:52.520972+0000","last_fullsized":"2024-03-16T17:47:52.520972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521251+0000","last_change":"2024-03-16T17:47:49.483468+0000","last_active":"2024-03-16T17:47:52.521251+0000","last_peered":"2024-03-16T17:47:52.521251+0000","last_clean":"2024-03-16T17:47:52.521251+0000","last_became_active":"2024-03-16T17:47:49.483189+0000","last_became_peered":"2024-03-16T17:47:49.483189+0000","last_unstale":"2024-03-16T17:47:52.521251+0000","last_undegraded":"2024-03-16T17:47:52.521251+0000","last_fullsized":"2024-03-16T17:47:52.521251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:49:57.754681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T17:47:58.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T17:47:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.417+0000 7fb1ee3fd640 1 Processor -- start 2024-03-16T17:47:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.417+0000 7fb1ee3fd640 1 -- start start 2024-03-16T17:47:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1ee3fd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb1e80d0ee0 0x7fb1e80cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1ee3fd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e80b4960 0x7fb1e80cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1ee3fd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e80d4990 con 0x7fb1e815e110 2024-03-16T17:47:58.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1ee3fd640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e80d4c70 con 0x7fb1e80d0ee0 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1ee3fd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80d2450 con 0x7fb1e80b4960 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1e7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb1e815e110 0x7fb1e80d07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45794/0 (socket says 172.21.15.132:45794) 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1e7fff640 1 -- 172.21.15.132:0/1372195858 learned_addr learned my addr 172.21.15.132:0/1372195858 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1e77fe640 1 --2- 172.21.15.132:0/1372195858 >> v2:172.21.15.194:3300/0 conn(0x7fb1e80d0ee0 0x7fb1e80cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1ec99a640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e80b4960 0x7fb1e80cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255235930 0 0) 0x7fb1e80d4990 con 0x7fb1e815e110 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1d0003520 con 0x7fb1e815e110 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.418+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2955341375 0 0) 0x7fb1d0003520 con 0x7fb1e815e110 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e80b4960 msgr2=0x7fb1e80cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e80b4960 0x7fb1e80cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 >> v2:172.21.15.194:3300/0 conn(0x7fb1e80d0ee0 msgr2=0x7fb1e80cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 --2- 172.21.15.132:0/1372195858 >> v2:172.21.15.194:3300/0 conn(0x7fb1e80d0ee0 0x7fb1e80cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80d2730 con 0x7fb1e815e110 2024-03-16T17:47:58.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7fb1dc001670 con 0x7fb1e815e110 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e77fe640 1 --2- 172.21.15.132:0/1372195858 >> v2:172.21.15.194:3300/0 conn(0x7fb1e80d0ee0 0x7fb1e80cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 >> v1:172.21.15.132:6789/0 conn(0x7fb1e815e110 legacy=0x7fb1e80d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d0003970 0x7fb1d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e80b4960 0x7fb1d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1d0004d00 0x7fb1d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80d4c70 con 0x7fb1d0004d00 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80d2450 con 0x7fb1d0003970 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d000b980 con 0x7fb1e80b4960 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e7fff640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d0003970 0x7fb1d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1ec99a640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1d0004d00 0x7fb1d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1e77fe640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e80b4960 0x7fb1d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1ec99a640 1 -- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e80b4960 msgr2=0x7fb1d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:58.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1ec99a640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1e80b4960 0x7fb1d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1ec99a640 1 -- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d0003970 msgr2=0x7fb1d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1ec99a640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d0003970 0x7fb1d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.419+0000 7fb1ec99a640 1 -- 172.21.15.132:0/1372195858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d0003520 con 0x7fb1d0004d00 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.420+0000 7fb1ec99a640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1d0004d00 0x7fb1d0005180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009fc0 tx=0x7fb1d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4516548565b5cae8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.420+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e002cc20 con 0x7fb1d0004d00 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.420+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e000f040 con 0x7fb1d0004d00 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.420+0000 7fb1e6ffd640 1 -- 172.21.15.132:0/1372195858 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0034440 con 0x7fb1d0004d00 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.420+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/1372195858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1d0004d00 msgr2=0x7fb1d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.420+0000 7fb1ee3fd640 1 --2- 172.21.15.132:0/1372195858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1d0004d00 0x7fb1d0005180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009fc0 tx=0x7fb1d00057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.420+0000 7fb1ec99a640 1 -- 172.21.15.132:0/1372195858 reap_dead start 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.421+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/1372195858 shutdown_connections 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.421+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/1372195858 >> 172.21.15.132:0/1372195858 conn(0x7fb1e80d3e70 msgr2=0x7fb1e80d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:58.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.421+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/1372195858 shutdown_connections 2024-03-16T17:47:58.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.421+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/1372195858 wait complete. 2024-03-16T17:47:58.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.422+0000 7fb1ee3fd640 1 Processor -- start 2024-03-16T17:47:58.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.423+0000 7fb1ee3fd640 1 -- start start 2024-03-16T17:47:58.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ee3fd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d0004d00 0x7fb1e81f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ee3fd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1e8161380 0x7fb1e80c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ee3fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1e80c7ea0 0x7fb1e80c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ee3fd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c9690 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ee3fd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c9970 con 0x7fb1e8161380 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ee3fd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c9c50 con 0x7fb1d0004d00 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ec99a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1e80c7ea0 0x7fb1e80c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ec99a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1e80c7ea0 0x7fb1e80c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38726/0 (socket says 172.21.15.132:38726) 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ec99a640 1 -- 172.21.15.132:0/235241396 learned_addr learned my addr 172.21.15.132:0/235241396 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1e77fe640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1e8161380 0x7fb1e80c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1e7fff640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d0004d00 0x7fb1e81f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ec99a640 1 -- 172.21.15.132:0/235241396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d0004d00 msgr2=0x7fb1e81f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ec99a640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d0004d00 0x7fb1e81f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ec99a640 1 -- 172.21.15.132:0/235241396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1e8161380 msgr2=0x7fb1e80c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ec99a640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1e8161380 0x7fb1e80c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ec99a640 1 -- 172.21.15.132:0/235241396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80ca420 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ec99a640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1e80c7ea0 0x7fb1e80c8350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000e230 tx=0x7fb1e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1e4ff9640 1 -- 172.21.15.132:0/235241396 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0043070 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1e4ff9640 1 -- 172.21.15.132:0/235241396 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0034b50 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/235241396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e8161840 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.424+0000 7fb1e4ff9640 1 -- 172.21.15.132:0/235241396 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0003990 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.425+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/235241396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e81f71e0 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.425+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/235241396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e804f2c0 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.426+0000 7fb1e4ff9640 1 -- 172.21.15.132:0/235241396 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb1e003e440 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.426+0000 7fb1e4ff9640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1d406b3e0 0x7fb1d406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.426+0000 7fb1e4ff9640 1 -- 172.21.15.132:0/235241396 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1e00ab5c0 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.426+0000 7fb1e7fff640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1d406b3e0 0x7fb1d406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.427+0000 7fb1e7fff640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1d406b3e0 0x7fb1d406d8a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc000fb0 tx=0x7fb1dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:58.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.431+0000 7fb1e4ff9640 1 -- 172.21.15.132:0/235241396 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb1e0076360 con 0x7fb1e80c7ea0 2024-03-16T17:47:58.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.613+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/235241396 --> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb1e815e4f0 con 0x7fb1d406b3e0 2024-03-16T17:47:58.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.618+0000 7fb1e4ff9640 1 -- 172.21.15.132:0/235241396 <== mgr.4107 v2:172.21.15.132:6832/2724898791 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7fb1dc001650 con 0x7fb1d406b3e0 2024-03-16T17:47:58.624 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:58.626 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-03-16T17:47:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/235241396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1d406b3e0 msgr2=0x7fb1d406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1d406b3e0 0x7fb1d406d8a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc000fb0 tx=0x7fb1dc009040 comp rx=0 tx=0).stop 2024-03-16T17:47:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/235241396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1e80c7ea0 msgr2=0x7fb1e80c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1e80c7ea0 0x7fb1e80c8350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000e230 tx=0x7fb1e0009750 comp rx=0 tx=0).stop 2024-03-16T17:47:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/235241396 shutdown_connections 2024-03-16T17:47:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb1d406b3e0 0x7fb1d406d8a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1e80c7ea0 0x7fb1e80c8350 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1e8161380 0x7fb1e80c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 --2- 172.21.15.132:0/235241396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d0004d00 0x7fb1e81f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/235241396 >> 172.21.15.132:0/235241396 conn(0x7fb1e80d3e70 msgr2=0x7fb1e80cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/235241396 shutdown_connections 2024-03-16T17:47:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.621+0000 7fb1ee3fd640 1 -- 172.21.15.132:0/235241396 wait complete. 2024-03-16T17:47:58.636 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-16T17:47:57.845653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219008,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755712,"statfs":{"total":773094113280,"available":772869849088,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12753,"internal_metadata":221236783},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001844"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521964+0000","last_change":"2024-03-16T17:47:50.495081+0000","last_active":"2024-03-16T17:47:52.521964+0000","last_peered":"2024-03-16T17:47:52.521964+0000","last_clean":"2024-03-16T17:47:52.521964+0000","last_became_active":"2024-03-16T17:47:50.494717+0000","last_became_peered":"2024-03-16T17:47:50.494717+0000","last_unstale":"2024-03-16T17:47:52.521964+0000","last_undegraded":"2024-03-16T17:47:52.521964+0000","last_fullsized":"2024-03-16T17:47:52.521964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:04:30.010877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494900+0000","last_change":"2024-03-16T17:47:50.491581+0000","last_active":"2024-03-16T17:47:51.494900+0000","last_peered":"2024-03-16T17:47:51.494900+0000","last_clean":"2024-03-16T17:47:51.494900+0000","last_became_active":"2024-03-16T17:47:50.491333+0000","last_became_peered":"2024-03-16T17:47:50.491333+0000","last_unstale":"2024-03-16T17:47:51.494900+0000","last_undegraded":"2024-03-16T17:47:51.494900+0000","last_fullsized":"2024-03-16T17:47:51.494900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521308+0000","last_change":"2024-03-16T17:47:50.492368+0000","last_active":"2024-03-16T17:47:52.521308+0000","last_peered":"2024-03-16T17:47:52.521308+0000","last_clean":"2024-03-16T17:47:52.521308+0000","last_became_active":"2024-03-16T17:47:50.492083+0000","last_became_peered":"2024-03-16T17:47:50.492083+0000","last_unstale":"2024-03-16T17:47:52.521308+0000","last_undegraded":"2024-03-16T17:47:52.521308+0000","last_fullsized":"2024-03-16T17:47:52.521308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:58:26.517921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500483+0000","last_change":"2024-03-16T17:47:50.494809+0000","last_active":"2024-03-16T17:47:51.500483+0000","last_peered":"2024-03-16T17:47:51.500483+0000","last_clean":"2024-03-16T17:47:51.500483+0000","last_became_active":"2024-03-16T17:47:50.494538+0000","last_became_peered":"2024-03-16T17:47:50.494538+0000","last_unstale":"2024-03-16T17:47:51.500483+0000","last_undegraded":"2024-03-16T17:47:51.500483+0000","last_fullsized":"2024-03-16T17:47:51.500483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:11.212917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521509+0000","last_change":"2024-03-16T17:47:50.493953+0000","last_active":"2024-03-16T17:47:52.521509+0000","last_peered":"2024-03-16T17:47:52.521509+0000","last_clean":"2024-03-16T17:47:52.521509+0000","last_became_active":"2024-03-16T17:47:50.493629+0000","last_became_peered":"2024-03-16T17:47:50.493629+0000","last_unstale":"2024-03-16T17:47:52.521509+0000","last_undegraded":"2024-03-16T17:47:52.521509+0000","last_fullsized":"2024-03-16T17:47:52.521509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:41:17.182744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500785+0000","last_change":"2024-03-16T17:47:50.495431+0000","last_active":"2024-03-16T17:47:51.500785+0000","last_peered":"2024-03-16T17:47:51.500785+0000","last_clean":"2024-03-16T17:47:51.500785+0000","last_became_active":"2024-03-16T17:47:50.492556+0000","last_became_peered":"2024-03-16T17:47:50.492556+0000","last_unstale":"2024-03-16T17:47:51.500785+0000","last_undegraded":"2024-03-16T17:47:51.500785+0000","last_fullsized":"2024-03-16T17:47:51.500785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:41:17.182744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521080+0000","last_change":"2024-03-16T17:47:50.505084+0000","last_active":"2024-03-16T17:47:52.521080+0000","last_peered":"2024-03-16T17:47:52.521080+0000","last_clean":"2024-03-16T17:47:52.521080+0000","last_became_active":"2024-03-16T17:47:50.504788+0000","last_became_peered":"2024-03-16T17:47:50.504788+0000","last_unstale":"2024-03-16T17:47:52.521080+0000","last_undegraded":"2024-03-16T17:47:52.521080+0000","last_fullsized":"2024-03-16T17:47:52.521080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:57:07.363497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520574+0000","last_change":"2024-03-16T17:47:50.499062+0000","last_active":"2024-03-16T17:47:52.520574+0000","last_peered":"2024-03-16T17:47:52.520574+0000","last_clean":"2024-03-16T17:47:52.520574+0000","last_became_active":"2024-03-16T17:47:50.498783+0000","last_became_peered":"2024-03-16T17:47:50.498783+0000","last_unstale":"2024-03-16T17:47:52.520574+0000","last_undegraded":"2024-03-16T17:47:52.520574+0000","last_fullsized":"2024-03-16T17:47:52.520574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:58:26.517921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521968+0000","last_change":"2024-03-16T17:47:50.502669+0000","last_active":"2024-03-16T17:47:52.521968+0000","last_peered":"2024-03-16T17:47:52.521968+0000","last_clean":"2024-03-16T17:47:52.521968+0000","last_became_active":"2024-03-16T17:47:50.501969+0000","last_became_peered":"2024-03-16T17:47:50.501969+0000","last_unstale":"2024-03-16T17:47:52.521968+0000","last_undegraded":"2024-03-16T17:47:52.521968+0000","last_fullsized":"2024-03-16T17:47:52.521968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:45:04.415199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499708+0000","last_change":"2024-03-16T17:47:50.493316+0000","last_active":"2024-03-16T17:47:51.499708+0000","last_peered":"2024-03-16T17:47:51.499708+0000","last_clean":"2024-03-16T17:47:51.499708+0000","last_became_active":"2024-03-16T17:47:50.493053+0000","last_became_peered":"2024-03-16T17:47:50.493053+0000","last_unstale":"2024-03-16T17:47:51.499708+0000","last_undegraded":"2024-03-16T17:47:51.499708+0000","last_fullsized":"2024-03-16T17:47:51.499708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499549+0000","last_change":"2024-03-16T17:47:50.492718+0000","last_active":"2024-03-16T17:47:51.499549+0000","last_peered":"2024-03-16T17:47:51.499549+0000","last_clean":"2024-03-16T17:47:51.499549+0000","last_became_active":"2024-03-16T17:47:50.492439+0000","last_became_peered":"2024-03-16T17:47:50.492439+0000","last_unstale":"2024-03-16T17:47:51.499549+0000","last_undegraded":"2024-03-16T17:47:51.499549+0000","last_fullsized":"2024-03-16T17:47:51.499549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521619+0000","last_change":"2024-03-16T17:47:50.490986+0000","last_active":"2024-03-16T17:47:52.521619+0000","last_peered":"2024-03-16T17:47:52.521619+0000","last_clean":"2024-03-16T17:47:52.521619+0000","last_became_active":"2024-03-16T17:47:50.490454+0000","last_became_peered":"2024-03-16T17:47:50.490454+0000","last_unstale":"2024-03-16T17:47:52.521619+0000","last_undegraded":"2024-03-16T17:47:52.521619+0000","last_fullsized":"2024-03-16T17:47:52.521619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:44.623412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521178+0000","last_change":"2024-03-16T17:47:50.497782+0000","last_active":"2024-03-16T17:47:52.521178+0000","last_peered":"2024-03-16T17:47:52.521178+0000","last_clean":"2024-03-16T17:47:52.521178+0000","last_became_active":"2024-03-16T17:47:50.497502+0000","last_became_peered":"2024-03-16T17:47:50.497502+0000","last_unstale":"2024-03-16T17:47:52.521178+0000","last_undegraded":"2024-03-16T17:47:52.521178+0000","last_fullsized":"2024-03-16T17:47:52.521178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:39:30.261042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521420+0000","last_change":"2024-03-16T17:47:50.487780+0000","last_active":"2024-03-16T17:47:52.521420+0000","last_peered":"2024-03-16T17:47:52.521420+0000","last_clean":"2024-03-16T17:47:52.521420+0000","last_became_active":"2024-03-16T17:47:50.487531+0000","last_became_peered":"2024-03-16T17:47:50.487531+0000","last_unstale":"2024-03-16T17:47:52.521420+0000","last_undegraded":"2024-03-16T17:47:52.521420+0000","last_fullsized":"2024-03-16T17:47:52.521420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494597+0000","last_change":"2024-03-16T17:47:50.489383+0000","last_active":"2024-03-16T17:47:51.494597+0000","last_peered":"2024-03-16T17:47:51.494597+0000","last_clean":"2024-03-16T17:47:51.494597+0000","last_became_active":"2024-03-16T17:47:50.489069+0000","last_became_peered":"2024-03-16T17:47:50.489069+0000","last_unstale":"2024-03-16T17:47:51.494597+0000","last_undegraded":"2024-03-16T17:47:51.494597+0000","last_fullsized":"2024-03-16T17:47:51.494597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500491+0000","last_change":"2024-03-16T17:47:50.496049+0000","last_active":"2024-03-16T17:47:51.500491+0000","last_peered":"2024-03-16T17:47:51.500491+0000","last_clean":"2024-03-16T17:47:51.500491+0000","last_became_active":"2024-03-16T17:47:50.495736+0000","last_became_peered":"2024-03-16T17:47:50.495736+0000","last_unstale":"2024-03-16T17:47:51.500491+0000","last_undegraded":"2024-03-16T17:47:51.500491+0000","last_fullsized":"2024-03-16T17:47:51.500491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501076+0000","last_change":"2024-03-16T17:47:50.497692+0000","last_active":"2024-03-16T17:47:51.501076+0000","last_peered":"2024-03-16T17:47:51.501076+0000","last_clean":"2024-03-16T17:47:51.501076+0000","last_became_active":"2024-03-16T17:47:50.497133+0000","last_became_peered":"2024-03-16T17:47:50.497133+0000","last_unstale":"2024-03-16T17:47:51.501076+0000","last_undegraded":"2024-03-16T17:47:51.501076+0000","last_fullsized":"2024-03-16T17:47:51.501076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:14:09.646659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522205+0000","last_change":"2024-03-16T17:47:50.490816+0000","last_active":"2024-03-16T17:47:52.522205+0000","last_peered":"2024-03-16T17:47:52.522205+0000","last_clean":"2024-03-16T17:47:52.522205+0000","last_became_active":"2024-03-16T17:47:50.490521+0000","last_became_peered":"2024-03-16T17:47:50.490521+0000","last_unstale":"2024-03-16T17:47:52.522205+0000","last_undegraded":"2024-03-16T17:47:52.522205+0000","last_fullsized":"2024-03-16T17:47:52.522205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:44.623412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521893+0000","last_change":"2024-03-16T17:47:50.495340+0000","last_active":"2024-03-16T17:47:52.521893+0000","last_peered":"2024-03-16T17:47:52.521893+0000","last_clean":"2024-03-16T17:47:52.521893+0000","last_became_active":"2024-03-16T17:47:50.495069+0000","last_became_peered":"2024-03-16T17:47:50.495069+0000","last_unstale":"2024-03-16T17:47:52.521893+0000","last_undegraded":"2024-03-16T17:47:52.521893+0000","last_fullsized":"2024-03-16T17:47:52.521893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:40:23.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499593+0000","last_change":"2024-03-16T17:47:50.491366+0000","last_active":"2024-03-16T17:47:51.499593+0000","last_peered":"2024-03-16T17:47:51.499593+0000","last_clean":"2024-03-16T17:47:51.499593+0000","last_became_active":"2024-03-16T17:47:50.491097+0000","last_became_peered":"2024-03-16T17:47:50.491097+0000","last_unstale":"2024-03-16T17:47:51.499593+0000","last_undegraded":"2024-03-16T17:47:51.499593+0000","last_fullsized":"2024-03-16T17:47:51.499593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521572+0000","last_change":"2024-03-16T17:47:50.496801+0000","last_active":"2024-03-16T17:47:52.521572+0000","last_peered":"2024-03-16T17:47:52.521572+0000","last_clean":"2024-03-16T17:47:52.521572+0000","last_became_active":"2024-03-16T17:47:50.496475+0000","last_became_peered":"2024-03-16T17:47:50.496475+0000","last_unstale":"2024-03-16T17:47:52.521572+0000","last_undegraded":"2024-03-16T17:47:52.521572+0000","last_fullsized":"2024-03-16T17:47:52.521572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500611+0000","last_change":"2024-03-16T17:47:50.497501+0000","last_active":"2024-03-16T17:47:51.500611+0000","last_peered":"2024-03-16T17:47:51.500611+0000","last_clean":"2024-03-16T17:47:51.500611+0000","last_became_active":"2024-03-16T17:47:50.497232+0000","last_became_peered":"2024-03-16T17:47:50.497232+0000","last_unstale":"2024-03-16T17:47:51.500611+0000","last_undegraded":"2024-03-16T17:47:51.500611+0000","last_fullsized":"2024-03-16T17:47:51.500611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:43.769763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520575+0000","last_change":"2024-03-16T17:47:50.500668+0000","last_active":"2024-03-16T17:47:52.520575+0000","last_peered":"2024-03-16T17:47:52.520575+0000","last_clean":"2024-03-16T17:47:52.520575+0000","last_became_active":"2024-03-16T17:47:50.500420+0000","last_became_peered":"2024-03-16T17:47:50.500420+0000","last_unstale":"2024-03-16T17:47:52.520575+0000","last_undegraded":"2024-03-16T17:47:52.520575+0000","last_fullsized":"2024-03-16T17:47:52.520575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500398+0000","last_change":"2024-03-16T17:47:50.494033+0000","last_active":"2024-03-16T17:47:51.500398+0000","last_peered":"2024-03-16T17:47:51.500398+0000","last_clean":"2024-03-16T17:47:51.500398+0000","last_became_active":"2024-03-16T17:47:50.493181+0000","last_became_peered":"2024-03-16T17:47:50.493181+0000","last_unstale":"2024-03-16T17:47:51.500398+0000","last_undegraded":"2024-03-16T17:47:51.500398+0000","last_fullsized":"2024-03-16T17:47:51.500398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521102+0000","last_change":"2024-03-16T17:47:50.501551+0000","last_active":"2024-03-16T17:47:52.521102+0000","last_peered":"2024-03-16T17:47:52.521102+0000","last_clean":"2024-03-16T17:47:52.521102+0000","last_became_active":"2024-03-16T17:47:50.500985+0000","last_became_peered":"2024-03-16T17:47:50.500985+0000","last_unstale":"2024-03-16T17:47:52.521102+0000","last_undegraded":"2024-03-16T17:47:52.521102+0000","last_fullsized":"2024-03-16T17:47:52.521102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:13:11.212917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499729+0000","last_change":"2024-03-16T17:47:50.494874+0000","last_active":"2024-03-16T17:47:51.499729+0000","last_peered":"2024-03-16T17:47:51.499729+0000","last_clean":"2024-03-16T17:47:51.499729+0000","last_became_active":"2024-03-16T17:47:50.494624+0000","last_became_peered":"2024-03-16T17:47:50.494624+0000","last_unstale":"2024-03-16T17:47:51.499729+0000","last_undegraded":"2024-03-16T17:47:51.499729+0000","last_fullsized":"2024-03-16T17:47:51.499729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494828+0000","last_change":"2024-03-16T17:47:50.495096+0000","last_active":"2024-03-16T17:47:51.494828+0000","last_peered":"2024-03-16T17:47:51.494828+0000","last_clean":"2024-03-16T17:47:51.494828+0000","last_became_active":"2024-03-16T17:47:50.494845+0000","last_became_peered":"2024-03-16T17:47:50.494845+0000","last_unstale":"2024-03-16T17:47:51.494828+0000","last_undegraded":"2024-03-16T17:47:51.494828+0000","last_fullsized":"2024-03-16T17:47:51.494828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521090+0000","last_change":"2024-03-16T17:47:50.496454+0000","last_active":"2024-03-16T17:47:52.521090+0000","last_peered":"2024-03-16T17:47:52.521090+0000","last_clean":"2024-03-16T17:47:52.521090+0000","last_became_active":"2024-03-16T17:47:50.496216+0000","last_became_peered":"2024-03-16T17:47:50.496216+0000","last_unstale":"2024-03-16T17:47:52.521090+0000","last_undegraded":"2024-03-16T17:47:52.521090+0000","last_fullsized":"2024-03-16T17:47:52.521090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521655+0000","last_change":"2024-03-16T17:47:50.493770+0000","last_active":"2024-03-16T17:47:52.521655+0000","last_peered":"2024-03-16T17:47:52.521655+0000","last_clean":"2024-03-16T17:47:52.521655+0000","last_became_active":"2024-03-16T17:47:50.493371+0000","last_became_peered":"2024-03-16T17:47:50.493371+0000","last_unstale":"2024-03-16T17:47:52.521655+0000","last_undegraded":"2024-03-16T17:47:52.521655+0000","last_fullsized":"2024-03-16T17:47:52.521655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:31:48.882712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500983+0000","last_change":"2024-03-16T17:47:50.493391+0000","last_active":"2024-03-16T17:47:51.500983+0000","last_peered":"2024-03-16T17:47:51.500983+0000","last_clean":"2024-03-16T17:47:51.500983+0000","last_became_active":"2024-03-16T17:47:50.493125+0000","last_became_peered":"2024-03-16T17:47:50.493125+0000","last_unstale":"2024-03-16T17:47:51.500983+0000","last_undegraded":"2024-03-16T17:47:51.500983+0000","last_fullsized":"2024-03-16T17:47:51.500983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:45.171163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522135+0000","last_change":"2024-03-16T17:47:50.492316+0000","last_active":"2024-03-16T17:47:52.522135+0000","last_peered":"2024-03-16T17:47:52.522135+0000","last_clean":"2024-03-16T17:47:52.522135+0000","last_became_active":"2024-03-16T17:47:50.492048+0000","last_became_peered":"2024-03-16T17:47:50.492048+0000","last_unstale":"2024-03-16T17:47:52.522135+0000","last_undegraded":"2024-03-16T17:47:52.522135+0000","last_fullsized":"2024-03-16T17:47:52.522135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:13.979638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499284+0000","last_change":"2024-03-16T17:47:50.500770+0000","last_active":"2024-03-16T17:47:51.499284+0000","last_peered":"2024-03-16T17:47:51.499284+0000","last_clean":"2024-03-16T17:47:51.499284+0000","last_became_active":"2024-03-16T17:47:50.500482+0000","last_became_peered":"2024-03-16T17:47:50.500482+0000","last_unstale":"2024-03-16T17:47:51.499284+0000","last_undegraded":"2024-03-16T17:47:51.499284+0000","last_fullsized":"2024-03-16T17:47:51.499284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521043+0000","last_change":"2024-03-16T17:47:50.489102+0000","last_active":"2024-03-16T17:47:52.521043+0000","last_peered":"2024-03-16T17:47:52.521043+0000","last_clean":"2024-03-16T17:47:52.521043+0000","last_became_active":"2024-03-16T17:47:50.488757+0000","last_became_peered":"2024-03-16T17:47:50.488757+0000","last_unstale":"2024-03-16T17:47:52.521043+0000","last_undegraded":"2024-03-16T17:47:52.521043+0000","last_fullsized":"2024-03-16T17:47:52.521043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:53.335867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521375+0000","last_change":"2024-03-16T17:47:49.484094+0000","last_active":"2024-03-16T17:47:52.521375+0000","last_peered":"2024-03-16T17:47:52.521375+0000","last_clean":"2024-03-16T17:47:52.521375+0000","last_became_active":"2024-03-16T17:47:49.483835+0000","last_became_peered":"2024-03-16T17:47:49.483835+0000","last_unstale":"2024-03-16T17:47:52.521375+0000","last_undegraded":"2024-03-16T17:47:52.521375+0000","last_fullsized":"2024-03-16T17:47:52.521375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521642+0000","last_change":"2024-03-16T17:47:50.492375+0000","last_active":"2024-03-16T17:47:52.521642+0000","last_peered":"2024-03-16T17:47:52.521642+0000","last_clean":"2024-03-16T17:47:52.521642+0000","last_became_active":"2024-03-16T17:47:50.492119+0000","last_became_peered":"2024-03-16T17:47:50.492119+0000","last_unstale":"2024-03-16T17:47:52.521642+0000","last_undegraded":"2024-03-16T17:47:52.521642+0000","last_fullsized":"2024-03-16T17:47:52.521642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499392+0000","last_change":"2024-03-16T17:47:49.480693+0000","last_active":"2024-03-16T17:47:51.499392+0000","last_peered":"2024-03-16T17:47:51.499392+0000","last_clean":"2024-03-16T17:47:51.499392+0000","last_became_active":"2024-03-16T17:47:49.480396+0000","last_became_peered":"2024-03-16T17:47:49.480396+0000","last_unstale":"2024-03-16T17:47:51.499392+0000","last_undegraded":"2024-03-16T17:47:51.499392+0000","last_fullsized":"2024-03-16T17:47:51.499392+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520666+0000","last_change":"2024-03-16T17:47:49.482964+0000","last_active":"2024-03-16T17:47:52.520666+0000","last_peered":"2024-03-16T17:47:52.520666+0000","last_clean":"2024-03-16T17:47:52.520666+0000","last_became_active":"2024-03-16T17:47:49.482603+0000","last_became_peered":"2024-03-16T17:47:49.482603+0000","last_unstale":"2024-03-16T17:47:52.520666+0000","last_undegraded":"2024-03-16T17:47:52.520666+0000","last_fullsized":"2024-03-16T17:47:52.520666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:18:43.224585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520762+0000","last_change":"2024-03-16T17:47:50.504067+0000","last_active":"2024-03-16T17:47:52.520762+0000","last_peered":"2024-03-16T17:47:52.520762+0000","last_clean":"2024-03-16T17:47:52.520762+0000","last_became_active":"2024-03-16T17:47:50.503836+0000","last_became_peered":"2024-03-16T17:47:50.503836+0000","last_unstale":"2024-03-16T17:47:52.520762+0000","last_undegraded":"2024-03-16T17:47:52.520762+0000","last_fullsized":"2024-03-16T17:47:52.520762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500556+0000","last_change":"2024-03-16T17:47:49.480169+0000","last_active":"2024-03-16T17:47:51.500556+0000","last_peered":"2024-03-16T17:47:51.500556+0000","last_clean":"2024-03-16T17:47:51.500556+0000","last_became_active":"2024-03-16T17:47:49.478055+0000","last_became_peered":"2024-03-16T17:47:49.478055+0000","last_unstale":"2024-03-16T17:47:51.500556+0000","last_undegraded":"2024-03-16T17:47:51.500556+0000","last_fullsized":"2024-03-16T17:47:51.500556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494549+0000","last_change":"2024-03-16T17:47:50.493815+0000","last_active":"2024-03-16T17:47:51.494549+0000","last_peered":"2024-03-16T17:47:51.494549+0000","last_clean":"2024-03-16T17:47:51.494549+0000","last_became_active":"2024-03-16T17:47:50.493522+0000","last_became_peered":"2024-03-16T17:47:50.493522+0000","last_unstale":"2024-03-16T17:47:51.494549+0000","last_undegraded":"2024-03-16T17:47:51.494549+0000","last_fullsized":"2024-03-16T17:47:51.494549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499476+0000","last_change":"2024-03-16T17:47:49.486100+0000","last_active":"2024-03-16T17:47:51.499476+0000","last_peered":"2024-03-16T17:47:51.499476+0000","last_clean":"2024-03-16T17:47:51.499476+0000","last_became_active":"2024-03-16T17:47:49.485816+0000","last_became_peered":"2024-03-16T17:47:49.485816+0000","last_unstale":"2024-03-16T17:47:51.499476+0000","last_undegraded":"2024-03-16T17:47:51.499476+0000","last_fullsized":"2024-03-16T17:47:51.499476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:58.531025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500516+0000","last_change":"2024-03-16T17:47:50.497437+0000","last_active":"2024-03-16T17:47:51.500516+0000","last_peered":"2024-03-16T17:47:51.500516+0000","last_clean":"2024-03-16T17:47:51.500516+0000","last_became_active":"2024-03-16T17:47:50.497148+0000","last_became_peered":"2024-03-16T17:47:50.497148+0000","last_unstale":"2024-03-16T17:47:51.500516+0000","last_undegraded":"2024-03-16T17:47:51.500516+0000","last_fullsized":"2024-03-16T17:47:51.500516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:39:30.261042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500710+0000","last_change":"2024-03-16T17:47:49.482053+0000","last_active":"2024-03-16T17:47:51.500710+0000","last_peered":"2024-03-16T17:47:51.500710+0000","last_clean":"2024-03-16T17:47:51.500710+0000","last_became_active":"2024-03-16T17:47:49.481763+0000","last_became_peered":"2024-03-16T17:47:49.481763+0000","last_unstale":"2024-03-16T17:47:51.500710+0000","last_undegraded":"2024-03-16T17:47:51.500710+0000","last_fullsized":"2024-03-16T17:47:51.500710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:58.531025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521081+0000","last_change":"2024-03-16T17:47:50.504585+0000","last_active":"2024-03-16T17:47:52.521081+0000","last_peered":"2024-03-16T17:47:52.521081+0000","last_clean":"2024-03-16T17:47:52.521081+0000","last_became_active":"2024-03-16T17:47:50.502857+0000","last_became_peered":"2024-03-16T17:47:50.502857+0000","last_unstale":"2024-03-16T17:47:52.521081+0000","last_undegraded":"2024-03-16T17:47:52.521081+0000","last_fullsized":"2024-03-16T17:47:52.521081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:22:00.192672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494819+0000","last_change":"2024-03-16T17:47:49.485845+0000","last_active":"2024-03-16T17:47:51.494819+0000","last_peered":"2024-03-16T17:47:51.494819+0000","last_clean":"2024-03-16T17:47:51.494819+0000","last_became_active":"2024-03-16T17:47:49.485582+0000","last_became_peered":"2024-03-16T17:47:49.485582+0000","last_unstale":"2024-03-16T17:47:51.494819+0000","last_undegraded":"2024-03-16T17:47:51.494819+0000","last_fullsized":"2024-03-16T17:47:51.494819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:58.531025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521613+0000","last_change":"2024-03-16T17:47:50.498096+0000","last_active":"2024-03-16T17:47:52.521613+0000","last_peered":"2024-03-16T17:47:52.521613+0000","last_clean":"2024-03-16T17:47:52.521613+0000","last_became_active":"2024-03-16T17:47:50.495381+0000","last_became_peered":"2024-03-16T17:47:50.495381+0000","last_unstale":"2024-03-16T17:47:52.521613+0000","last_undegraded":"2024-03-16T17:47:52.521613+0000","last_fullsized":"2024-03-16T17:47:52.521613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:13.979638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499604+0000","last_change":"2024-03-16T17:47:49.483811+0000","last_active":"2024-03-16T17:47:51.499604+0000","last_peered":"2024-03-16T17:47:51.499604+0000","last_clean":"2024-03-16T17:47:51.499604+0000","last_became_active":"2024-03-16T17:47:49.483494+0000","last_became_peered":"2024-03-16T17:47:49.483494+0000","last_unstale":"2024-03-16T17:47:51.499604+0000","last_undegraded":"2024-03-16T17:47:51.499604+0000","last_fullsized":"2024-03-16T17:47:51.499604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521750+0000","last_change":"2024-03-16T17:47:50.499367+0000","last_active":"2024-03-16T17:47:52.521750+0000","last_peered":"2024-03-16T17:47:52.521750+0000","last_clean":"2024-03-16T17:47:52.521750+0000","last_became_active":"2024-03-16T17:47:50.499087+0000","last_became_peered":"2024-03-16T17:47:50.499087+0000","last_unstale":"2024-03-16T17:47:52.521750+0000","last_undegraded":"2024-03-16T17:47:52.521750+0000","last_fullsized":"2024-03-16T17:47:52.521750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:02:20.712220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521724+0000","last_change":"2024-03-16T17:47:49.484787+0000","last_active":"2024-03-16T17:47:52.521724+0000","last_peered":"2024-03-16T17:47:52.521724+0000","last_clean":"2024-03-16T17:47:52.521724+0000","last_became_active":"2024-03-16T17:47:49.484518+0000","last_became_peered":"2024-03-16T17:47:49.484518+0000","last_unstale":"2024-03-16T17:47:52.521724+0000","last_undegraded":"2024-03-16T17:47:52.521724+0000","last_fullsized":"2024-03-16T17:47:52.521724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:39:26.504278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521491+0000","last_change":"2024-03-16T17:47:50.491184+0000","last_active":"2024-03-16T17:47:52.521491+0000","last_peered":"2024-03-16T17:47:52.521491+0000","last_clean":"2024-03-16T17:47:52.521491+0000","last_became_active":"2024-03-16T17:47:50.490924+0000","last_became_peered":"2024-03-16T17:47:50.490924+0000","last_unstale":"2024-03-16T17:47:52.521491+0000","last_undegraded":"2024-03-16T17:47:52.521491+0000","last_fullsized":"2024-03-16T17:47:52.521491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501121+0000","last_change":"2024-03-16T17:47:49.483984+0000","last_active":"2024-03-16T17:47:51.501121+0000","last_peered":"2024-03-16T17:47:51.501121+0000","last_clean":"2024-03-16T17:47:51.501121+0000","last_became_active":"2024-03-16T17:47:49.483687+0000","last_became_peered":"2024-03-16T17:47:49.483687+0000","last_unstale":"2024-03-16T17:47:51.501121+0000","last_undegraded":"2024-03-16T17:47:51.501121+0000","last_fullsized":"2024-03-16T17:47:51.501121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521501+0000","last_change":"2024-03-16T17:47:50.500826+0000","last_active":"2024-03-16T17:47:52.521501+0000","last_peered":"2024-03-16T17:47:52.521501+0000","last_clean":"2024-03-16T17:47:52.521501+0000","last_became_active":"2024-03-16T17:47:50.500555+0000","last_became_peered":"2024-03-16T17:47:50.500555+0000","last_unstale":"2024-03-16T17:47:52.521501+0000","last_undegraded":"2024-03-16T17:47:52.521501+0000","last_fullsized":"2024-03-16T17:47:52.521501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:48:00.859392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499164+0000","last_change":"2024-03-16T17:47:49.480239+0000","last_active":"2024-03-16T17:47:51.499164+0000","last_peered":"2024-03-16T17:47:51.499164+0000","last_clean":"2024-03-16T17:47:51.499164+0000","last_became_active":"2024-03-16T17:47:49.479908+0000","last_became_peered":"2024-03-16T17:47:49.479908+0000","last_unstale":"2024-03-16T17:47:51.499164+0000","last_undegraded":"2024-03-16T17:47:51.499164+0000","last_fullsized":"2024-03-16T17:47:51.499164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499604+0000","last_change":"2024-03-16T17:47:50.492853+0000","last_active":"2024-03-16T17:47:51.499604+0000","last_peered":"2024-03-16T17:47:51.499604+0000","last_clean":"2024-03-16T17:47:51.499604+0000","last_became_active":"2024-03-16T17:47:50.492558+0000","last_became_peered":"2024-03-16T17:47:50.492558+0000","last_unstale":"2024-03-16T17:47:51.499604+0000","last_undegraded":"2024-03-16T17:47:51.499604+0000","last_fullsized":"2024-03-16T17:47:51.499604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522062+0000","last_change":"2024-03-16T17:47:49.479326+0000","last_active":"2024-03-16T17:47:52.522062+0000","last_peered":"2024-03-16T17:47:52.522062+0000","last_clean":"2024-03-16T17:47:52.522062+0000","last_became_active":"2024-03-16T17:47:49.479034+0000","last_became_peered":"2024-03-16T17:47:49.479034+0000","last_unstale":"2024-03-16T17:47:52.522062+0000","last_undegraded":"2024-03-16T17:47:52.522062+0000","last_fullsized":"2024-03-16T17:47:52.522062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521246+0000","last_change":"2024-03-16T17:47:50.500094+0000","last_active":"2024-03-16T17:47:52.521246+0000","last_peered":"2024-03-16T17:47:52.521246+0000","last_clean":"2024-03-16T17:47:52.521246+0000","last_became_active":"2024-03-16T17:47:50.499817+0000","last_became_peered":"2024-03-16T17:47:50.499817+0000","last_unstale":"2024-03-16T17:47:52.521246+0000","last_undegraded":"2024-03-16T17:47:52.521246+0000","last_fullsized":"2024-03-16T17:47:52.521246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:43.769763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521499+0000","last_change":"2024-03-16T17:47:49.483884+0000","last_active":"2024-03-16T17:47:52.521499+0000","last_peered":"2024-03-16T17:47:52.521499+0000","last_clean":"2024-03-16T17:47:52.521499+0000","last_became_active":"2024-03-16T17:47:49.483542+0000","last_became_peered":"2024-03-16T17:47:49.483542+0000","last_unstale":"2024-03-16T17:47:52.521499+0000","last_undegraded":"2024-03-16T17:47:52.521499+0000","last_fullsized":"2024-03-16T17:47:52.521499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:20:40.919920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521833+0000","last_change":"2024-03-16T17:47:50.498543+0000","last_active":"2024-03-16T17:47:52.521833+0000","last_peered":"2024-03-16T17:47:52.521833+0000","last_clean":"2024-03-16T17:47:52.521833+0000","last_became_active":"2024-03-16T17:47:50.498283+0000","last_became_peered":"2024-03-16T17:47:50.498283+0000","last_unstale":"2024-03-16T17:47:52.521833+0000","last_undegraded":"2024-03-16T17:47:52.521833+0000","last_fullsized":"2024-03-16T17:47:52.521833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:14:09.646659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522156+0000","last_change":"2024-03-16T17:47:49.484771+0000","last_active":"2024-03-16T17:47:52.522156+0000","last_peered":"2024-03-16T17:47:52.522156+0000","last_clean":"2024-03-16T17:47:52.522156+0000","last_became_active":"2024-03-16T17:47:49.484490+0000","last_became_peered":"2024-03-16T17:47:49.484490+0000","last_unstale":"2024-03-16T17:47:52.522156+0000","last_undegraded":"2024-03-16T17:47:52.522156+0000","last_fullsized":"2024-03-16T17:47:52.522156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522091+0000","last_change":"2024-03-16T17:47:50.505116+0000","last_active":"2024-03-16T17:47:52.522091+0000","last_peered":"2024-03-16T17:47:52.522091+0000","last_clean":"2024-03-16T17:47:52.522091+0000","last_became_active":"2024-03-16T17:47:50.504865+0000","last_became_peered":"2024-03-16T17:47:50.504865+0000","last_unstale":"2024-03-16T17:47:52.522091+0000","last_undegraded":"2024-03-16T17:47:52.522091+0000","last_fullsized":"2024-03-16T17:47:52.522091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:08:08.823896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494934+0000","last_change":"2024-03-16T17:47:49.477416+0000","last_active":"2024-03-16T17:47:51.494934+0000","last_peered":"2024-03-16T17:47:51.494934+0000","last_clean":"2024-03-16T17:47:51.494934+0000","last_became_active":"2024-03-16T17:47:49.477156+0000","last_became_peered":"2024-03-16T17:47:49.477156+0000","last_unstale":"2024-03-16T17:47:51.494934+0000","last_undegraded":"2024-03-16T17:47:51.494934+0000","last_fullsized":"2024-03-16T17:47:51.494934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500668+0000","last_change":"2024-03-16T17:47:50.493922+0000","last_active":"2024-03-16T17:47:51.500668+0000","last_peered":"2024-03-16T17:47:51.500668+0000","last_clean":"2024-03-16T17:47:51.500668+0000","last_became_active":"2024-03-16T17:47:50.493259+0000","last_became_peered":"2024-03-16T17:47:50.493259+0000","last_unstale":"2024-03-16T17:47:51.500668+0000","last_undegraded":"2024-03-16T17:47:51.500668+0000","last_fullsized":"2024-03-16T17:47:51.500668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:48:00.859392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522188+0000","last_change":"2024-03-16T17:47:49.481283+0000","last_active":"2024-03-16T17:47:52.522188+0000","last_peered":"2024-03-16T17:47:52.522188+0000","last_clean":"2024-03-16T17:47:52.522188+0000","last_became_active":"2024-03-16T17:47:49.480969+0000","last_became_peered":"2024-03-16T17:47:49.480969+0000","last_unstale":"2024-03-16T17:47:52.522188+0000","last_undegraded":"2024-03-16T17:47:52.522188+0000","last_fullsized":"2024-03-16T17:47:52.522188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:18:43.224585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521666+0000","last_change":"2024-03-16T17:47:50.494717+0000","last_active":"2024-03-16T17:47:52.521666+0000","last_peered":"2024-03-16T17:47:52.521666+0000","last_clean":"2024-03-16T17:47:52.521666+0000","last_became_active":"2024-03-16T17:47:50.494415+0000","last_became_peered":"2024-03-16T17:47:50.494415+0000","last_unstale":"2024-03-16T17:47:52.521666+0000","last_undegraded":"2024-03-16T17:47:52.521666+0000","last_fullsized":"2024-03-16T17:47:52.521666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:48:45.171163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520876+0000","last_change":"2024-03-16T17:47:39.177353+0000","last_active":"2024-03-16T17:47:52.520876+0000","last_peered":"2024-03-16T17:47:52.520876+0000","last_clean":"2024-03-16T17:47:52.520876+0000","last_became_active":"2024-03-16T17:47:39.176109+0000","last_became_peered":"2024-03-16T17:47:39.176109+0000","last_unstale":"2024-03-16T17:47:52.520876+0000","last_undegraded":"2024-03-16T17:47:52.520876+0000","last_fullsized":"2024-03-16T17:47:52.520876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_clean_scrub_stamp":"2024-03-16T17:47:37.885590+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:47.704856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500310+0000","last_change":"2024-03-16T17:47:49.482795+0000","last_active":"2024-03-16T17:47:51.500310+0000","last_peered":"2024-03-16T17:47:51.500310+0000","last_clean":"2024-03-16T17:47:51.500310+0000","last_became_active":"2024-03-16T17:47:49.482524+0000","last_became_peered":"2024-03-16T17:47:49.482524+0000","last_unstale":"2024-03-16T17:47:51.500310+0000","last_undegraded":"2024-03-16T17:47:51.500310+0000","last_fullsized":"2024-03-16T17:47:51.500310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:15:34.060525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520716+0000","last_change":"2024-03-16T17:47:50.499991+0000","last_active":"2024-03-16T17:47:52.520716+0000","last_peered":"2024-03-16T17:47:52.520716+0000","last_clean":"2024-03-16T17:47:52.520716+0000","last_became_active":"2024-03-16T17:47:50.499726+0000","last_became_peered":"2024-03-16T17:47:50.499726+0000","last_unstale":"2024-03-16T17:47:52.520716+0000","last_undegraded":"2024-03-16T17:47:52.520716+0000","last_fullsized":"2024-03-16T17:47:52.520716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:29:14.653051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521734+0000","last_change":"2024-03-16T17:47:49.482775+0000","last_active":"2024-03-16T17:47:52.521734+0000","last_peered":"2024-03-16T17:47:52.521734+0000","last_clean":"2024-03-16T17:47:52.521734+0000","last_became_active":"2024-03-16T17:47:49.482367+0000","last_became_peered":"2024-03-16T17:47:49.482367+0000","last_unstale":"2024-03-16T17:47:52.521734+0000","last_undegraded":"2024-03-16T17:47:52.521734+0000","last_fullsized":"2024-03-16T17:47:52.521734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521344+0000","last_change":"2024-03-16T17:47:50.491608+0000","last_active":"2024-03-16T17:47:52.521344+0000","last_peered":"2024-03-16T17:47:52.521344+0000","last_clean":"2024-03-16T17:47:52.521344+0000","last_became_active":"2024-03-16T17:47:50.491341+0000","last_became_peered":"2024-03-16T17:47:50.491341+0000","last_unstale":"2024-03-16T17:47:52.521344+0000","last_undegraded":"2024-03-16T17:47:52.521344+0000","last_fullsized":"2024-03-16T17:47:52.521344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:18:58.291684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.522116+0000","last_change":"2024-03-16T17:47:49.483339+0000","last_active":"2024-03-16T17:47:52.522116+0000","last_peered":"2024-03-16T17:47:52.522116+0000","last_clean":"2024-03-16T17:47:52.522116+0000","last_became_active":"2024-03-16T17:47:49.483030+0000","last_became_peered":"2024-03-16T17:47:49.483030+0000","last_unstale":"2024-03-16T17:47:52.522116+0000","last_undegraded":"2024-03-16T17:47:52.522116+0000","last_fullsized":"2024-03-16T17:47:52.522116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494583+0000","last_change":"2024-03-16T17:47:50.492425+0000","last_active":"2024-03-16T17:47:51.494583+0000","last_peered":"2024-03-16T17:47:51.494583+0000","last_clean":"2024-03-16T17:47:51.494583+0000","last_became_active":"2024-03-16T17:47:50.492129+0000","last_became_peered":"2024-03-16T17:47:50.492129+0000","last_unstale":"2024-03-16T17:47:51.494583+0000","last_undegraded":"2024-03-16T17:47:51.494583+0000","last_fullsized":"2024-03-16T17:47:51.494583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501157+0000","last_change":"2024-03-16T17:47:49.479391+0000","last_active":"2024-03-16T17:47:51.501157+0000","last_peered":"2024-03-16T17:47:51.501157+0000","last_clean":"2024-03-16T17:47:51.501157+0000","last_became_active":"2024-03-16T17:47:49.479121+0000","last_became_peered":"2024-03-16T17:47:49.479121+0000","last_unstale":"2024-03-16T17:47:51.501157+0000","last_undegraded":"2024-03-16T17:47:51.501157+0000","last_fullsized":"2024-03-16T17:47:51.501157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521315+0000","last_change":"2024-03-16T17:47:50.497378+0000","last_active":"2024-03-16T17:47:52.521315+0000","last_peered":"2024-03-16T17:47:52.521315+0000","last_clean":"2024-03-16T17:47:52.521315+0000","last_became_active":"2024-03-16T17:47:50.497042+0000","last_became_peered":"2024-03-16T17:47:50.497042+0000","last_unstale":"2024-03-16T17:47:52.521315+0000","last_undegraded":"2024-03-16T17:47:52.521315+0000","last_fullsized":"2024-03-16T17:47:52.521315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:02.404060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494714+0000","last_change":"2024-03-16T17:47:49.481660+0000","last_active":"2024-03-16T17:47:51.494714+0000","last_peered":"2024-03-16T17:47:51.494714+0000","last_clean":"2024-03-16T17:47:51.494714+0000","last_became_active":"2024-03-16T17:47:49.481419+0000","last_became_peered":"2024-03-16T17:47:49.481419+0000","last_unstale":"2024-03-16T17:47:51.494714+0000","last_undegraded":"2024-03-16T17:47:51.494714+0000","last_fullsized":"2024-03-16T17:47:51.494714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:17:52.577877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501144+0000","last_change":"2024-03-16T17:47:50.496399+0000","last_active":"2024-03-16T17:47:51.501144+0000","last_peered":"2024-03-16T17:47:51.501144+0000","last_clean":"2024-03-16T17:47:51.501144+0000","last_became_active":"2024-03-16T17:47:50.496000+0000","last_became_peered":"2024-03-16T17:47:50.496000+0000","last_unstale":"2024-03-16T17:47:51.501144+0000","last_undegraded":"2024-03-16T17:47:51.501144+0000","last_fullsized":"2024-03-16T17:47:51.501144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:40:23.219396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521930+0000","last_change":"2024-03-16T17:47:49.484747+0000","last_active":"2024-03-16T17:47:52.521930+0000","last_peered":"2024-03-16T17:47:52.521930+0000","last_clean":"2024-03-16T17:47:52.521930+0000","last_became_active":"2024-03-16T17:47:49.484405+0000","last_became_peered":"2024-03-16T17:47:49.484405+0000","last_unstale":"2024-03-16T17:47:52.521930+0000","last_undegraded":"2024-03-16T17:47:52.521930+0000","last_fullsized":"2024-03-16T17:47:52.521930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:21:22.363663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494614+0000","last_change":"2024-03-16T17:47:50.492799+0000","last_active":"2024-03-16T17:47:51.494614+0000","last_peered":"2024-03-16T17:47:51.494614+0000","last_clean":"2024-03-16T17:47:51.494614+0000","last_became_active":"2024-03-16T17:47:50.492116+0000","last_became_peered":"2024-03-16T17:47:50.492116+0000","last_unstale":"2024-03-16T17:47:51.494614+0000","last_undegraded":"2024-03-16T17:47:51.494614+0000","last_fullsized":"2024-03-16T17:47:51.494614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:17:35.106810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.498597+0000","last_change":"2024-03-16T17:47:49.480286+0000","last_active":"2024-03-16T17:47:51.498597+0000","last_peered":"2024-03-16T17:47:51.498597+0000","last_clean":"2024-03-16T17:47:51.498597+0000","last_became_active":"2024-03-16T17:47:49.479968+0000","last_became_peered":"2024-03-16T17:47:49.479968+0000","last_unstale":"2024-03-16T17:47:51.498597+0000","last_undegraded":"2024-03-16T17:47:51.498597+0000","last_fullsized":"2024-03-16T17:47:51.498597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:43.618484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521225+0000","last_change":"2024-03-16T17:47:50.496046+0000","last_active":"2024-03-16T17:47:52.521225+0000","last_peered":"2024-03-16T17:47:52.521225+0000","last_clean":"2024-03-16T17:47:52.521225+0000","last_became_active":"2024-03-16T17:47:50.495774+0000","last_became_peered":"2024-03-16T17:47:50.495774+0000","last_unstale":"2024-03-16T17:47:52.521225+0000","last_undegraded":"2024-03-16T17:47:52.521225+0000","last_fullsized":"2024-03-16T17:47:52.521225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:57:07.363497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499593+0000","last_change":"2024-03-16T17:47:49.478995+0000","last_active":"2024-03-16T17:47:51.499593+0000","last_peered":"2024-03-16T17:47:51.499593+0000","last_clean":"2024-03-16T17:47:51.499593+0000","last_became_active":"2024-03-16T17:47:49.478495+0000","last_became_peered":"2024-03-16T17:47:49.478495+0000","last_unstale":"2024-03-16T17:47:51.499593+0000","last_undegraded":"2024-03-16T17:47:51.499593+0000","last_fullsized":"2024-03-16T17:47:51.499593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:48:01.399132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521105+0000","last_change":"2024-03-16T17:47:50.488336+0000","last_active":"2024-03-16T17:47:52.521105+0000","last_peered":"2024-03-16T17:47:52.521105+0000","last_clean":"2024-03-16T17:47:52.521105+0000","last_became_active":"2024-03-16T17:47:50.488097+0000","last_became_peered":"2024-03-16T17:47:50.488097+0000","last_unstale":"2024-03-16T17:47:52.521105+0000","last_undegraded":"2024-03-16T17:47:52.521105+0000","last_fullsized":"2024-03-16T17:47:52.521105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:48:41.055949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520819+0000","last_change":"2024-03-16T17:47:49.485058+0000","last_active":"2024-03-16T17:47:52.520819+0000","last_peered":"2024-03-16T17:47:52.520819+0000","last_clean":"2024-03-16T17:47:52.520819+0000","last_became_active":"2024-03-16T17:47:49.484767+0000","last_became_peered":"2024-03-16T17:47:49.484767+0000","last_unstale":"2024-03-16T17:47:52.520819+0000","last_undegraded":"2024-03-16T17:47:52.520819+0000","last_fullsized":"2024-03-16T17:47:52.520819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:12.974711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521233+0000","last_change":"2024-03-16T17:47:50.491877+0000","last_active":"2024-03-16T17:47:52.521233+0000","last_peered":"2024-03-16T17:47:52.521233+0000","last_clean":"2024-03-16T17:47:52.521233+0000","last_became_active":"2024-03-16T17:47:50.491512+0000","last_became_peered":"2024-03-16T17:47:50.491512+0000","last_unstale":"2024-03-16T17:47:52.521233+0000","last_undegraded":"2024-03-16T17:47:52.521233+0000","last_fullsized":"2024-03-16T17:47:52.521233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:13:59.535953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494603+0000","last_change":"2024-03-16T17:47:49.478211+0000","last_active":"2024-03-16T17:47:51.494603+0000","last_peered":"2024-03-16T17:47:51.494603+0000","last_clean":"2024-03-16T17:47:51.494603+0000","last_became_active":"2024-03-16T17:47:49.477944+0000","last_became_peered":"2024-03-16T17:47:49.477944+0000","last_unstale":"2024-03-16T17:47:51.494603+0000","last_undegraded":"2024-03-16T17:47:51.494603+0000","last_fullsized":"2024-03-16T17:47:51.494603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:12.974711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520683+0000","last_change":"2024-03-16T17:47:50.496170+0000","last_active":"2024-03-16T17:47:52.520683+0000","last_peered":"2024-03-16T17:47:52.520683+0000","last_clean":"2024-03-16T17:47:52.520683+0000","last_became_active":"2024-03-16T17:47:50.495911+0000","last_became_peered":"2024-03-16T17:47:50.495911+0000","last_unstale":"2024-03-16T17:47:52.520683+0000","last_undegraded":"2024-03-16T17:47:52.520683+0000","last_fullsized":"2024-03-16T17:47:52.520683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:55:09.327691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.494768+0000","last_change":"2024-03-16T17:47:49.487179+0000","last_active":"2024-03-16T17:47:51.494768+0000","last_peered":"2024-03-16T17:47:51.494768+0000","last_clean":"2024-03-16T17:47:51.494768+0000","last_became_active":"2024-03-16T17:47:49.486891+0000","last_became_peered":"2024-03-16T17:47:49.486891+0000","last_unstale":"2024-03-16T17:47:51.494768+0000","last_undegraded":"2024-03-16T17:47:51.494768+0000","last_fullsized":"2024-03-16T17:47:51.494768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:10:52.330939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521308+0000","last_change":"2024-03-16T17:47:50.493256+0000","last_active":"2024-03-16T17:47:52.521308+0000","last_peered":"2024-03-16T17:47:52.521308+0000","last_clean":"2024-03-16T17:47:52.521308+0000","last_became_active":"2024-03-16T17:47:50.492993+0000","last_became_peered":"2024-03-16T17:47:50.492993+0000","last_unstale":"2024-03-16T17:47:52.521308+0000","last_undegraded":"2024-03-16T17:47:52.521308+0000","last_fullsized":"2024-03-16T17:47:52.521308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:43.769763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521638+0000","last_change":"2024-03-16T17:47:49.485238+0000","last_active":"2024-03-16T17:47:52.521638+0000","last_peered":"2024-03-16T17:47:52.521638+0000","last_clean":"2024-03-16T17:47:52.521638+0000","last_became_active":"2024-03-16T17:47:49.484882+0000","last_became_peered":"2024-03-16T17:47:49.484882+0000","last_unstale":"2024-03-16T17:47:52.521638+0000","last_undegraded":"2024-03-16T17:47:52.521638+0000","last_fullsized":"2024-03-16T17:47:52.521638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:01:30.780692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.499249+0000","last_change":"2024-03-16T17:47:50.491997+0000","last_active":"2024-03-16T17:47:51.499249+0000","last_peered":"2024-03-16T17:47:51.499249+0000","last_clean":"2024-03-16T17:47:51.499249+0000","last_became_active":"2024-03-16T17:47:50.491733+0000","last_became_peered":"2024-03-16T17:47:50.491733+0000","last_unstale":"2024-03-16T17:47:51.499249+0000","last_undegraded":"2024-03-16T17:47:51.499249+0000","last_fullsized":"2024-03-16T17:47:51.499249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:58:26.517921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.501072+0000","last_change":"2024-03-16T17:47:50.500620+0000","last_active":"2024-03-16T17:47:51.501072+0000","last_peered":"2024-03-16T17:47:51.501072+0000","last_clean":"2024-03-16T17:47:51.501072+0000","last_became_active":"2024-03-16T17:47:50.500350+0000","last_became_peered":"2024-03-16T17:47:50.500350+0000","last_unstale":"2024-03-16T17:47:51.501072+0000","last_undegraded":"2024-03-16T17:47:51.501072+0000","last_fullsized":"2024-03-16T17:47:51.501072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:02:20.712220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521598+0000","last_change":"2024-03-16T17:47:49.486202+0000","last_active":"2024-03-16T17:47:52.521598+0000","last_peered":"2024-03-16T17:47:52.521598+0000","last_clean":"2024-03-16T17:47:52.521598+0000","last_became_active":"2024-03-16T17:47:49.485500+0000","last_became_peered":"2024-03-16T17:47:49.485500+0000","last_unstale":"2024-03-16T17:47:52.521598+0000","last_undegraded":"2024-03-16T17:47:52.521598+0000","last_fullsized":"2024-03-16T17:47:52.521598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:50:43.618484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:51.500577+0000","last_change":"2024-03-16T17:47:50.491413+0000","last_active":"2024-03-16T17:47:51.500577+0000","last_peered":"2024-03-16T17:47:51.500577+0000","last_clean":"2024-03-16T17:47:51.500577+0000","last_became_active":"2024-03-16T17:47:50.491137+0000","last_became_peered":"2024-03-16T17:47:50.491137+0000","last_unstale":"2024-03-16T17:47:51.500577+0000","last_undegraded":"2024-03-16T17:47:51.500577+0000","last_fullsized":"2024-03-16T17:47:51.500577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:57:07.363497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521824+0000","last_change":"2024-03-16T17:47:49.481386+0000","last_active":"2024-03-16T17:47:52.521824+0000","last_peered":"2024-03-16T17:47:52.521824+0000","last_clean":"2024-03-16T17:47:52.521824+0000","last_became_active":"2024-03-16T17:47:49.481018+0000","last_became_peered":"2024-03-16T17:47:49.481018+0000","last_unstale":"2024-03-16T17:47:52.521824+0000","last_undegraded":"2024-03-16T17:47:52.521824+0000","last_fullsized":"2024-03-16T17:47:52.521824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:29:10.861159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520936+0000","last_change":"2024-03-16T17:47:50.504628+0000","last_active":"2024-03-16T17:47:52.520936+0000","last_peered":"2024-03-16T17:47:52.520936+0000","last_clean":"2024-03-16T17:47:52.520936+0000","last_became_active":"2024-03-16T17:47:50.503220+0000","last_became_peered":"2024-03-16T17:47:50.503220+0000","last_unstale":"2024-03-16T17:47:52.520936+0000","last_undegraded":"2024-03-16T17:47:52.520936+0000","last_fullsized":"2024-03-16T17:47:52.520936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:21:23.368591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521157+0000","last_change":"2024-03-16T17:47:49.486523+0000","last_active":"2024-03-16T17:47:52.521157+0000","last_peered":"2024-03-16T17:47:52.521157+0000","last_clean":"2024-03-16T17:47:52.521157+0000","last_became_active":"2024-03-16T17:47:49.486072+0000","last_became_peered":"2024-03-16T17:47:49.486072+0000","last_unstale":"2024-03-16T17:47:52.521157+0000","last_undegraded":"2024-03-16T17:47:52.521157+0000","last_fullsized":"2024-03-16T17:47:52.521157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:49:57.754681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.520972+0000","last_change":"2024-03-16T17:47:50.497830+0000","last_active":"2024-03-16T17:47:52.520972+0000","last_peered":"2024-03-16T17:47:52.520972+0000","last_clean":"2024-03-16T17:47:52.520972+0000","last_became_active":"2024-03-16T17:47:50.497566+0000","last_became_peered":"2024-03-16T17:47:50.497566+0000","last_unstale":"2024-03-16T17:47:52.520972+0000","last_undegraded":"2024-03-16T17:47:52.520972+0000","last_fullsized":"2024-03-16T17:47:52.520972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:49.460953+0000","last_clean_scrub_stamp":"2024-03-16T17:47:49.460953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:17:16.068516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-16T17:47:52.521251+0000","last_change":"2024-03-16T17:47:49.483468+0000","last_active":"2024-03-16T17:47:52.521251+0000","last_peered":"2024-03-16T17:47:52.521251+0000","last_clean":"2024-03-16T17:47:52.521251+0000","last_became_active":"2024-03-16T17:47:49.483189+0000","last_became_peered":"2024-03-16T17:47:49.483189+0000","last_unstale":"2024-03-16T17:47:52.521251+0000","last_undegraded":"2024-03-16T17:47:52.521251+0000","last_fullsized":"2024-03-16T17:47:52.521251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:48.456025+0000","last_clean_scrub_stamp":"2024-03-16T17:47:48.456025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:49:57.754681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T17:47:58.640 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-16T17:47:58.640 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-16T17:47:58.640 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-16T17:47:58.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-16T17:47:58.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.773+0000 7fdb0c556640 1 Processor -- start 2024-03-16T17:47:58.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.773+0000 7fdb0c556640 1 -- start start 2024-03-16T17:47:58.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.773+0000 7fdb0c556640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdb040b3560 0x7fdb040cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.773+0000 7fdb0c556640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb040d1980 0x7fdb040d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb0c556640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb040d0680 con 0x7fdb04161540 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb0c556640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb040b4f30 con 0x7fdb040b3560 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb0c556640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040d08d0 con 0x7fdb040d1980 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb0a2f2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdb04161540 0x7fdb040cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45808/0 (socket says 172.21.15.132:45808) 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb0a2f2640 1 -- 172.21.15.132:0/389063670 learned_addr learned my addr 172.21.15.132:0/389063670 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940382243 0 0) 0x7fdb040d0680 con 0x7fdb04161540 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb09af1640 1 --2- 172.21.15.132:0/389063670 >> v2:172.21.15.194:3300/0 conn(0x7fdb040b3560 0x7fdb040cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb0aaf3640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb040d1980 0x7fdb040d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf0003520 con 0x7fdb04161540 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1894085867 0 0) 0x7fdaf0003520 con 0x7fdb04161540 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb040d1980 msgr2=0x7fdb040d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:58.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb040d1980 0x7fdb040d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 >> v2:172.21.15.194:3300/0 conn(0x7fdb040b3560 msgr2=0x7fdb040cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 --2- 172.21.15.132:0/389063670 >> v2:172.21.15.194:3300/0 conn(0x7fdb040b3560 0x7fdb040cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb040d0bb0 con 0x7fdb04161540 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7fdb00001670 con 0x7fdb04161540 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 >> v1:172.21.15.132:6789/0 conn(0x7fdb04161540 legacy=0x7fdb040cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf0003970 0x7fdaf0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdaf00047c0 0x7fdaf0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb040d1980 0x7fdaf0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040b4f30 con 0x7fdaf00047c0 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040d08d0 con 0x7fdaf0003970 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf000b980 con 0x7fdb040d1980 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb09af1640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdaf00047c0 0x7fdaf0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb0a2f2640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf0003970 0x7fdaf0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.774+0000 7fdb0aaf3640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb040d1980 0x7fdaf0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.775+0000 7fdb09af1640 1 -- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb040d1980 msgr2=0x7fdaf0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.775+0000 7fdb09af1640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb040d1980 0x7fdaf0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.775+0000 7fdb09af1640 1 -- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf0003970 msgr2=0x7fdaf0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.775+0000 7fdb09af1640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf0003970 0x7fdaf0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.775+0000 7fdb09af1640 1 -- 172.21.15.132:0/389063670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf0003520 con 0x7fdaf00047c0 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.775+0000 7fdb09af1640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdaf00047c0 0x7fdaf0004c40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009ac0 tx=0x7fdaf00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce516f554fc1902 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.775+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf402c710 con 0x7fdaf00047c0 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.775+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf402c870 con 0x7fdaf00047c0 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.775+0000 7fdb092f0640 1 -- 172.21.15.132:0/389063670 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf402cc00 con 0x7fdaf00047c0 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.776+0000 7fdb0c556640 1 -- 172.21.15.132:0/389063670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdaf00047c0 msgr2=0x7fdaf0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.776+0000 7fdb0c556640 1 --2- 172.21.15.132:0/389063670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdaf00047c0 0x7fdaf0004c40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009ac0 tx=0x7fdaf00057f0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.776+0000 7fdb0aaf3640 1 -- 172.21.15.132:0/389063670 reap_dead start 2024-03-16T17:47:58.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.776+0000 7fdb0c556640 1 -- 172.21.15.132:0/389063670 shutdown_connections 2024-03-16T17:47:58.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.776+0000 7fdb0c556640 1 -- 172.21.15.132:0/389063670 >> 172.21.15.132:0/389063670 conn(0x7fdb0409d120 msgr2=0x7fdb040d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:58.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.776+0000 7fdb0c556640 1 -- 172.21.15.132:0/389063670 shutdown_connections 2024-03-16T17:47:58.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.776+0000 7fdb0c556640 1 -- 172.21.15.132:0/389063670 wait complete. 2024-03-16T17:47:58.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.777+0000 7fdb0c556640 1 Processor -- start 2024-03-16T17:47:58.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.777+0000 7fdb0c556640 1 -- start start 2024-03-16T17:47:58.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb0c556640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf00047c0 0x7fdb041f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb0c556640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb041f74d0 0x7fdb0415b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb0c556640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0415bf20 0x7fdb040b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb0c556640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041f3ff0 con 0x7fdb041f74d0 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb0c556640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041f5750 con 0x7fdaf00047c0 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb0c556640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041f79e0 con 0x7fdb0415bf20 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb09af1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb041f74d0 0x7fdb0415b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb09af1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb041f74d0 0x7fdb0415b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38748/0 (socket says 172.21.15.132:38748) 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb09af1640 1 -- 172.21.15.132:0/410384453 learned_addr learned my addr 172.21.15.132:0/410384453 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb0a2f2640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf00047c0 0x7fdb041f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb09af1640 1 -- 172.21.15.132:0/410384453 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0415bf20 msgr2=0x7fdb040b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb09af1640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0415bf20 0x7fdb040b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb09af1640 1 -- 172.21.15.132:0/410384453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf00047c0 msgr2=0x7fdb041f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:58.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb09af1640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf00047c0 0x7fdb041f6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb09af1640 1 -- 172.21.15.132:0/410384453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb041f7cc0 con 0x7fdb041f74d0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdb09af1640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb041f74d0 0x7fdb0415b9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4037040 tx=0x7fdaf4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.778+0000 7fdafaffd640 1 -- 172.21.15.132:0/410384453 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4003810 con 0x7fdb041f74d0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.779+0000 7fdafaffd640 1 -- 172.21.15.132:0/410384453 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf4003970 con 0x7fdb041f74d0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.779+0000 7fdafaffd640 1 -- 172.21.15.132:0/410384453 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4003d20 con 0x7fdb041f74d0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.779+0000 7fdb0c556640 1 -- 172.21.15.132:0/410384453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb041f3c80 con 0x7fdb041f74d0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.779+0000 7fdb0c556640 1 -- 172.21.15.132:0/410384453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb040b73a0 con 0x7fdb041f74d0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.780+0000 7fdb0c556640 1 -- 172.21.15.132:0/410384453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0404f2c0 con 0x7fdb041f74d0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.780+0000 7fdafaffd640 1 -- 172.21.15.132:0/410384453 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fdaf4040450 con 0x7fdb041f74d0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.780+0000 7fdafaffd640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdae806b3b0 0x7fdae806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.781+0000 7fdafaffd640 1 -- 172.21.15.132:0/410384453 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaf40abae0 con 0x7fdb041f74d0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.781+0000 7fdb0a2f2640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdae806b3b0 0x7fdae806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:58.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.781+0000 7fdb0a2f2640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdae806b3b0 0x7fdae806d870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb00001050 tx=0x7fdb00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:58.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:58.789+0000 7fdafaffd640 1 -- 172.21.15.132:0/410384453 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdaf40767d0 con 0x7fdb041f74d0 2024-03-16T17:47:59.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.004+0000 7fdb0c556640 1 -- 172.21.15.132:0/410384453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdb040683c0 con 0x7fdb041f74d0 2024-03-16T17:47:59.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.004+0000 7fdafaffd640 1 -- 172.21.15.132:0/410384453 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fdaf4079e90 con 0x7fdb041f74d0 2024-03-16T17:47:59.008 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:59.008 INFO:teuthology.orchestra.run.smithi132.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-16T17:47:59.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 -- 172.21.15.132:0/410384453 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdae806b3b0 msgr2=0x7fdae806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdae806b3b0 0x7fdae806d870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb00001050 tx=0x7fdb00009040 comp rx=0 tx=0).stop 2024-03-16T17:47:59.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 -- 172.21.15.132:0/410384453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb041f74d0 msgr2=0x7fdb0415b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb041f74d0 0x7fdb0415b9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4037040 tx=0x7fdaf4004730 comp rx=0 tx=0).stop 2024-03-16T17:47:59.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 -- 172.21.15.132:0/410384453 shutdown_connections 2024-03-16T17:47:59.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdae806b3b0 0x7fdae806d870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0415bf20 0x7fdb040b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb041f74d0 0x7fdb0415b9e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 --2- 172.21.15.132:0/410384453 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf00047c0 0x7fdb041f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 -- 172.21.15.132:0/410384453 >> 172.21.15.132:0/410384453 conn(0x7fdb0409d120 msgr2=0x7fdb0406ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:59.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 -- 172.21.15.132:0/410384453 shutdown_connections 2024-03-16T17:47:59.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.006+0000 7fdb0c556640 1 -- 172.21.15.132:0/410384453 wait complete. 2024-03-16T17:47:59.020 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-16T17:47:59.021 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:47:59.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.117+0000 7f7eb192c640 1 Processor -- start 2024-03-16T17:47:59.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.117+0000 7f7eb192c640 1 -- start start 2024-03-16T17:47:59.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eb192c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7eac15e3d0 0x7f7eac0d23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eb192c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7eac0d2910 0x7f7eac0b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eb192c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0b6e60 con 0x7f7eac15dff0 2024-03-16T17:47:59.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eb192c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0cff10 con 0x7f7eac15e3d0 2024-03-16T17:47:59.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eb192c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0b7140 con 0x7f7eac0d2910 2024-03-16T17:47:59.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eaa7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7eac15e3d0 0x7f7eac0d23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eaaffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7eac15dff0 0x7f7eac0cf490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45812/0 (socket says 172.21.15.132:45812) 2024-03-16T17:47:59.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eaa7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7eac15e3d0 0x7f7eac0d23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38750/0 (socket says 172.21.15.132:38750) 2024-03-16T17:47:59.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eaaffd640 1 -- 172.21.15.132:0/1206767885 learned_addr learned my addr 172.21.15.132:0/1206767885 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:59.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eab7fe640 1 --2- 172.21.15.132:0/1206767885 >> v2:172.21.15.194:3300/0 conn(0x7f7eac0d2910 0x7f7eac0b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eaa7fc640 1 -- 172.21.15.132:0/1206767885 >> v2:172.21.15.194:3300/0 conn(0x7f7eac0d2910 msgr2=0x7f7eac0b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:59.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eaa7fc640 1 --2- 172.21.15.132:0/1206767885 >> v2:172.21.15.194:3300/0 conn(0x7f7eac0d2910 0x7f7eac0b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eaa7fc640 1 -- 172.21.15.132:0/1206767885 >> v1:172.21.15.132:6789/0 conn(0x7f7eac15dff0 legacy=0x7f7eac0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.118+0000 7f7eaa7fc640 1 -- 172.21.15.132:0/1206767885 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0b7420 con 0x7f7eac15e3d0 2024-03-16T17:47:59.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.119+0000 7f7eaa7fc640 1 --2- 172.21.15.132:0/1206767885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 0x7f7eac0d23d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0ce6f0 tx=0x7f7e9c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3187d6f1d442ae0f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:59.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.119+0000 7f7ea9ffb640 1 -- 172.21.15.132:0/1206767885 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c030610 con 0x7f7eac15e3d0 2024-03-16T17:47:59.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.119+0000 7f7ea9ffb640 1 -- 172.21.15.132:0/1206767885 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c030770 con 0x7f7eac15e3d0 2024-03-16T17:47:59.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.119+0000 7f7ea9ffb640 1 -- 172.21.15.132:0/1206767885 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c030b00 con 0x7f7eac15e3d0 2024-03-16T17:47:59.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.120+0000 7f7eb192c640 1 -- 172.21.15.132:0/1206767885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 msgr2=0x7f7eac0d23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.120+0000 7f7eb192c640 1 --2- 172.21.15.132:0/1206767885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 0x7f7eac0d23d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7eac0ce6f0 tx=0x7f7e9c02b960 comp rx=0 tx=0).stop 2024-03-16T17:47:59.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.120+0000 7f7eb192c640 1 -- 172.21.15.132:0/1206767885 shutdown_connections 2024-03-16T17:47:59.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.120+0000 7f7eb192c640 1 --2- 172.21.15.132:0/1206767885 >> v2:172.21.15.194:3300/0 conn(0x7f7eac0d2910 0x7f7eac0b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.120+0000 7f7eb192c640 1 --2- 172.21.15.132:0/1206767885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 0x7f7eac0d23d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.120+0000 7f7eb192c640 1 -- 172.21.15.132:0/1206767885 >> 172.21.15.132:0/1206767885 conn(0x7f7eac0d3e70 msgr2=0x7f7eac0d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:59.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.120+0000 7f7eb192c640 1 -- 172.21.15.132:0/1206767885 shutdown_connections 2024-03-16T17:47:59.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.120+0000 7f7eb192c640 1 -- 172.21.15.132:0/1206767885 wait complete. 2024-03-16T17:47:59.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.122+0000 7f7eb192c640 1 Processor -- start 2024-03-16T17:47:59.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.122+0000 7f7eb192c640 1 -- start start 2024-03-16T17:47:59.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eb192c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eac0d2910 0x7f7eac158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eb192c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eac15dff0 0x7f7eac158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eb192c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 0x7f7eac159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eb192c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac15a700 con 0x7f7eac15e3d0 2024-03-16T17:47:59.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eb192c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac159a80 con 0x7f7eac0d2910 2024-03-16T17:47:59.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eb192c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac159d60 con 0x7f7eac15dff0 2024-03-16T17:47:59.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eab7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 0x7f7eac159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eab7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 0x7f7eac159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38752/0 (socket says 172.21.15.132:38752) 2024-03-16T17:47:59.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eab7fe640 1 -- 172.21.15.132:0/1583070435 learned_addr learned my addr 172.21.15.132:0/1583070435 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eaa7fc640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eac15dff0 0x7f7eac158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eab7fe640 1 -- 172.21.15.132:0/1583070435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eac15dff0 msgr2=0x7f7eac158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eaaffd640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eac0d2910 0x7f7eac158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eab7fe640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eac15dff0 0x7f7eac158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eab7fe640 1 -- 172.21.15.132:0/1583070435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eac0d2910 msgr2=0x7f7eac158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eab7fe640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eac0d2910 0x7f7eac158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eab7fe640 1 -- 172.21.15.132:0/1583070435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c009400 con 0x7f7eac15e3d0 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.123+0000 7f7eab7fe640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 0x7f7eac159010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4007e40 tx=0x7f7ea400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.124+0000 7f7e93fff640 1 -- 172.21.15.132:0/1583070435 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4014620 con 0x7f7eac15e3d0 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.124+0000 7f7e93fff640 1 -- 172.21.15.132:0/1583070435 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea400ee90 con 0x7f7eac15e3d0 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.124+0000 7f7eb192c640 1 -- 172.21.15.132:0/1583070435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac15a040 con 0x7f7eac15e3d0 2024-03-16T17:47:59.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.124+0000 7f7e93fff640 1 -- 172.21.15.132:0/1583070435 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40149e0 con 0x7f7eac15e3d0 2024-03-16T17:47:59.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.124+0000 7f7eb192c640 1 -- 172.21.15.132:0/1583070435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac159550 con 0x7f7eac15e3d0 2024-03-16T17:47:59.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.125+0000 7f7eb192c640 1 -- 172.21.15.132:0/1583070435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac15a840 con 0x7f7eac15e3d0 2024-03-16T17:47:59.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.125+0000 7f7e93fff640 1 -- 172.21.15.132:0/1583070435 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f7ea4014b40 con 0x7f7eac15e3d0 2024-03-16T17:47:59.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.125+0000 7f7e93fff640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7e9806b3b0 0x7f7e9806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.126+0000 7f7e93fff640 1 -- 172.21.15.132:0/1583070435 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ea408a550 con 0x7f7eac15e3d0 2024-03-16T17:47:59.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.126+0000 7f7eaaffd640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7e9806b3b0 0x7f7e9806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.126+0000 7f7eaaffd640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7e9806b3b0 0x7f7e9806d870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7eac157b80 tx=0x7f7ea0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:59.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.130+0000 7f7e93fff640 1 -- 172.21.15.132:0/1583070435 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7eac15a840 con 0x7f7eac15e3d0 2024-03-16T17:47:59.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.309+0000 7f7eb192c640 1 -- 172.21.15.132:0/1583070435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7eac15a840 con 0x7f7eac15e3d0 2024-03-16T17:47:59.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.310+0000 7f7e93fff640 1 -- 172.21.15.132:0/1583070435 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f7eac15a840 con 0x7f7eac15e3d0 2024-03-16T17:47:59.314 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:47:59.314 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 -- 172.21.15.132:0/1583070435 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7e9806b3b0 msgr2=0x7f7e9806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7e9806b3b0 0x7f7e9806d870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7eac157b80 tx=0x7f7ea0009040 comp rx=0 tx=0).stop 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 -- 172.21.15.132:0/1583070435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 msgr2=0x7f7eac159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 0x7f7eac159010 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4007e40 tx=0x7f7ea400e4b0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 -- 172.21.15.132:0/1583070435 shutdown_connections 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7e9806b3b0 0x7f7e9806d870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac15e3d0 0x7f7eac159010 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7eac15dff0 0x7f7eac158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 --2- 172.21.15.132:0/1583070435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7eac0d2910 0x7f7eac158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 -- 172.21.15.132:0/1583070435 >> 172.21.15.132:0/1583070435 conn(0x7f7eac0d3e70 msgr2=0x7f7eac1607c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 -- 172.21.15.132:0/1583070435 shutdown_connections 2024-03-16T17:47:59.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.312+0000 7f7eb192c640 1 -- 172.21.15.132:0/1583070435 wait complete. 2024-03-16T17:47:59.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:47:59.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:47:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.432+0000 7f566526b640 1 Processor -- start 2024-03-16T17:47:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.432+0000 7f566526b640 1 -- start start 2024-03-16T17:47:59.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.433+0000 7f566526b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56600d07b0 0x7f5660066c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.433+0000 7f566526b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566015f7e0 con 0x7f566015f400 2024-03-16T17:47:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.433+0000 7f566526b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56600ccb70 con 0x7f56600af730 2024-03-16T17:47:59.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.433+0000 7f566526b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56600cce50 con 0x7f56600d07b0 2024-03-16T17:47:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.433+0000 7f565effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f566015f400 0x7f56600d00a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45826/0 (socket says 172.21.15.132:45826) 2024-03-16T17:47:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.433+0000 7f565effd640 1 -- 172.21.15.132:0/955367533 learned_addr learned my addr 172.21.15.132:0/955367533 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:47:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.433+0000 7f56567fc640 1 --2- 172.21.15.132:0/955367533 >> v2:172.21.15.132:3300/0 conn(0x7f56600d07b0 0x7f5660066c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.434+0000 7f565e7fc640 1 -- 172.21.15.132:0/955367533 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056038800 0 0) 0x7f566015f7e0 con 0x7f566015f400 2024-03-16T17:47:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.434+0000 7f565e7fc640 1 -- 172.21.15.132:0/955367533 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5640003520 con 0x7f566015f400 2024-03-16T17:47:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.434+0000 7f56567fc640 1 -- 172.21.15.132:0/955367533 >> v1:172.21.15.194:6789/0 conn(0x7f56600af730 legacy=0x7f56600b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.434+0000 7f56567fc640 1 -- 172.21.15.132:0/955367533 >> v1:172.21.15.132:6789/0 conn(0x7f566015f400 legacy=0x7f56600d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.434+0000 7f565e7fc640 1 -- 172.21.15.132:0/955367533 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691200783 0 0) 0x7f56600ccb70 con 0x7f56600af730 2024-03-16T17:47:59.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.434+0000 7f56567fc640 1 -- 172.21.15.132:0/955367533 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56600cd130 con 0x7f56600d07b0 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.434+0000 7f56567fc640 1 --2- 172.21.15.132:0/955367533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 0x7f5660066c20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f56480097a0 tx=0x7f564802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a66ef9d8e5f9b3b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.435+0000 7f565e7fc640 1 -- 172.21.15.132:0/955367533 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648031830 con 0x7f56600d07b0 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.435+0000 7f565e7fc640 1 -- 172.21.15.132:0/955367533 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648031990 con 0x7f56600d07b0 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.435+0000 7f565e7fc640 1 -- 172.21.15.132:0/955367533 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648031d00 con 0x7f56600d07b0 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.435+0000 7f566526b640 1 -- 172.21.15.132:0/955367533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 msgr2=0x7f5660066c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.435+0000 7f566526b640 1 --2- 172.21.15.132:0/955367533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 0x7f5660066c20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f56480097a0 tx=0x7f564802b8d0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.435+0000 7f566526b640 1 -- 172.21.15.132:0/955367533 shutdown_connections 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.435+0000 7f566526b640 1 --2- 172.21.15.132:0/955367533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 0x7f5660066c20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.435+0000 7f566526b640 1 -- 172.21.15.132:0/955367533 >> 172.21.15.132:0/955367533 conn(0x7f56600b1f00 msgr2=0x7f56600b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.435+0000 7f566526b640 1 -- 172.21.15.132:0/955367533 shutdown_connections 2024-03-16T17:47:59.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.435+0000 7f566526b640 1 -- 172.21.15.132:0/955367533 wait complete. 2024-03-16T17:47:59.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.436+0000 7f566526b640 1 Processor -- start 2024-03-16T17:47:59.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f566526b640 1 -- start start 2024-03-16T17:47:59.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f566526b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56600af730 0x7f5660151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f566526b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 0x7f566014a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f566526b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015f400 0x7f566006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f566526b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566014ac40 con 0x7f56600d07b0 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f566526b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56601520b0 con 0x7f56600af730 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f566526b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5660152390 con 0x7f566015f400 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f56567fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 0x7f566014a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f56567fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 0x7f566014a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38768/0 (socket says 172.21.15.132:38768) 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f56567fc640 1 -- 172.21.15.132:0/2310538637 learned_addr learned my addr 172.21.15.132:0/2310538637 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f565effd640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56600af730 0x7f5660151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.437+0000 7f565f7fe640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015f400 0x7f566006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f56567fc640 1 -- 172.21.15.132:0/2310538637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015f400 msgr2=0x7f566006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f56567fc640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015f400 0x7f566006d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f56567fc640 1 -- 172.21.15.132:0/2310538637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56600af730 msgr2=0x7f5660151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f56567fc640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56600af730 0x7f5660151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f56567fc640 1 -- 172.21.15.132:0/2310538637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648009400 con 0x7f56600d07b0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f565f7fe640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015f400 0x7f566006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f56567fc640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 0x7f566014a700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5648000c00 tx=0x7f56480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f5657fff640 1 -- 172.21.15.132:0/2310538637 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480317b0 con 0x7f56600d07b0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f5657fff640 1 -- 172.21.15.132:0/2310538637 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648032e10 con 0x7f56600d07b0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f566526b640 1 -- 172.21.15.132:0/2310538637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5660152670 con 0x7f56600d07b0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f5657fff640 1 -- 172.21.15.132:0/2310538637 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648003850 con 0x7f56600d07b0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.438+0000 7f566526b640 1 -- 172.21.15.132:0/2310538637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5660152c30 con 0x7f56600d07b0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.439+0000 7f566526b640 1 -- 172.21.15.132:0/2310538637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566004f330 con 0x7f56600d07b0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.439+0000 7f5657fff640 1 -- 172.21.15.132:0/2310538637 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f56480039b0 con 0x7f56600d07b0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.440+0000 7f5657fff640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f564406b3b0 0x7f564406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.440+0000 7f565effd640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f564406b3b0 0x7f564406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.440+0000 7f5657fff640 1 -- 172.21.15.132:0/2310538637 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56480ab840 con 0x7f56600d07b0 2024-03-16T17:47:59.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.440+0000 7f565effd640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f564406b3b0 0x7f564406d870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5650005880 tx=0x7f5650009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:59.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.444+0000 7f5657fff640 1 -- 172.21.15.132:0/2310538637 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5648076550 con 0x7f56600d07b0 2024-03-16T17:47:59.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.618+0000 7f566526b640 1 -- 172.21.15.132:0/2310538637 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5660153f20 con 0x7f56600d07b0 2024-03-16T17:47:59.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.619+0000 7f5657fff640 1 -- 172.21.15.132:0/2310538637 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56480480a0 con 0x7f56600d07b0 2024-03-16T17:47:59.623 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 -- 172.21.15.132:0/2310538637 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f564406b3b0 msgr2=0x7f564406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f564406b3b0 0x7f564406d870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5650005880 tx=0x7f5650009040 comp rx=0 tx=0).stop 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 -- 172.21.15.132:0/2310538637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 msgr2=0x7f566014a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 0x7f566014a700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5648000c00 tx=0x7f56480046c0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 -- 172.21.15.132:0/2310538637 shutdown_connections 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f564406b3b0 0x7f564406d870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015f400 0x7f566006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56600d07b0 0x7f566014a700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 --2- 172.21.15.132:0/2310538637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56600af730 0x7f5660151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 -- 172.21.15.132:0/2310538637 >> 172.21.15.132:0/2310538637 conn(0x7f56600b1f00 msgr2=0x7f5660154440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 -- 172.21.15.132:0/2310538637 shutdown_connections 2024-03-16T17:47:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.621+0000 7f566526b640 1 -- 172.21.15.132:0/2310538637 wait complete. 2024-03-16T17:47:59.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:47:59.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.735+0000 7f4424a76640 1 Processor -- start 2024-03-16T17:47:59.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.735+0000 7f4424a76640 1 -- start start 2024-03-16T17:47:59.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4424a76640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4420161760 0x7f44200b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4424a76640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4420161b40 0x7f44200d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4424a76640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44200d49f0 0x7f44200d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4424a76640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44200cff20 con 0x7f4420161b40 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4424a76640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44200b5500 con 0x7f4420161760 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4424a76640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44200cf5f0 con 0x7f44200d49f0 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4417fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4420161b40 0x7f44200d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4417fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4420161b40 0x7f44200d0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38776/0 (socket says 172.21.15.132:38776) 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4417fff640 1 -- 172.21.15.132:0/306885373 learned_addr learned my addr 172.21.15.132:0/306885373 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f441e59c640 1 --2- 172.21.15.132:0/306885373 >> v2:172.21.15.194:3300/0 conn(0x7f4420161760 0x7f44200b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f441ed9d640 1 --2- 172.21.15.132:0/306885373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44200d49f0 0x7f44200d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4417fff640 1 -- 172.21.15.132:0/306885373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44200d49f0 msgr2=0x7f44200d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4417fff640 1 --2- 172.21.15.132:0/306885373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44200d49f0 0x7f44200d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4417fff640 1 -- 172.21.15.132:0/306885373 >> v2:172.21.15.194:3300/0 conn(0x7f4420161760 msgr2=0x7f44200b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:47:59.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.736+0000 7f4417fff640 1 --2- 172.21.15.132:0/306885373 >> v2:172.21.15.194:3300/0 conn(0x7f4420161760 0x7f44200b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.737+0000 7f4417fff640 1 -- 172.21.15.132:0/306885373 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44200cf8d0 con 0x7f4420161b40 2024-03-16T17:47:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f4417fff640 1 --2- 172.21.15.132:0/306885373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4420161b40 0x7f44200d0600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f442008e460 tx=0x7f440802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c9e28c854d20fb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f441dd9b640 1 -- 172.21.15.132:0/306885373 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408031870 con 0x7f4420161b40 2024-03-16T17:47:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f441dd9b640 1 -- 172.21.15.132:0/306885373 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44080319d0 con 0x7f4420161b40 2024-03-16T17:47:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f441dd9b640 1 -- 172.21.15.132:0/306885373 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408031d60 con 0x7f4420161b40 2024-03-16T17:47:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f4424a76640 1 -- 172.21.15.132:0/306885373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4420161b40 msgr2=0x7f44200d0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f4424a76640 1 --2- 172.21.15.132:0/306885373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4420161b40 0x7f44200d0600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f442008e460 tx=0x7f440802b910 comp rx=0 tx=0).stop 2024-03-16T17:47:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f4424a76640 1 -- 172.21.15.132:0/306885373 shutdown_connections 2024-03-16T17:47:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f4424a76640 1 --2- 172.21.15.132:0/306885373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44200d49f0 0x7f44200d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f4424a76640 1 --2- 172.21.15.132:0/306885373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4420161b40 0x7f44200d0600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f4424a76640 1 --2- 172.21.15.132:0/306885373 >> v2:172.21.15.194:3300/0 conn(0x7f4420161760 0x7f44200b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f4424a76640 1 -- 172.21.15.132:0/306885373 >> 172.21.15.132:0/306885373 conn(0x7f44200d3ed0 msgr2=0x7f44200d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f4424a76640 1 -- 172.21.15.132:0/306885373 shutdown_connections 2024-03-16T17:47:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.738+0000 7f4424a76640 1 -- 172.21.15.132:0/306885373 wait complete. 2024-03-16T17:47:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f4424a76640 1 Processor -- start 2024-03-16T17:47:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f4424a76640 1 -- start start 2024-03-16T17:47:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f4424a76640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44200d49f0 0x7f44201f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f4424a76640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4420161760 0x7f4420154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f4424a76640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4420161b40 0x7f44200ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f4424a76640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44201f4ef0 con 0x7f44200d49f0 2024-03-16T17:47:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f4424a76640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44201f5590 con 0x7f4420161760 2024-03-16T17:47:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f4424a76640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44201548b0 con 0x7f4420161b40 2024-03-16T17:47:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f441e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44200d49f0 0x7f44201f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f441e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44200d49f0 0x7f44201f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38788/0 (socket says 172.21.15.132:38788) 2024-03-16T17:47:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.740+0000 7f441e59c640 1 -- 172.21.15.132:0/3455249702 learned_addr learned my addr 172.21.15.132:0/3455249702 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f441ed9d640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4420161b40 0x7f44200ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f4417fff640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4420161760 0x7f4420154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f441e59c640 1 -- 172.21.15.132:0/3455249702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4420161b40 msgr2=0x7f44200ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f441e59c640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4420161b40 0x7f44200ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f441e59c640 1 -- 172.21.15.132:0/3455249702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4420161760 msgr2=0x7f4420154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f441e59c640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4420161760 0x7f4420154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f441e59c640 1 -- 172.21.15.132:0/3455249702 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44080094d0 con 0x7f44200d49f0 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f441e59c640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44200d49f0 0x7f44201f5050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f441000e9b0 tx=0x7f441000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f4416ffd640 1 -- 172.21.15.132:0/3455249702 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4410009670 con 0x7f44200d49f0 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f4416ffd640 1 -- 172.21.15.132:0/3455249702 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441000c9a0 con 0x7f44200d49f0 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f4416ffd640 1 -- 172.21.15.132:0/3455249702 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441000cd50 con 0x7f44200d49f0 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f4424a76640 1 -- 172.21.15.132:0/3455249702 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44201f4370 con 0x7f44200d49f0 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.741+0000 7f4424a76640 1 -- 172.21.15.132:0/3455249702 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44201f4930 con 0x7f44200d49f0 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.742+0000 7f4424a76640 1 -- 172.21.15.132:0/3455249702 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4420068450 con 0x7f44200d49f0 2024-03-16T17:47:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.743+0000 7f4416ffd640 1 -- 172.21.15.132:0/3455249702 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4410013470 con 0x7f44200d49f0 2024-03-16T17:47:59.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.743+0000 7f4416ffd640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f440006b3b0 0x7f440006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:47:59.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.743+0000 7f4417fff640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f440006b3b0 0x7f440006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:47:59.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.743+0000 7f4416ffd640 1 -- 172.21.15.132:0/3455249702 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4410089e20 con 0x7f44200d49f0 2024-03-16T17:47:59.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.743+0000 7f4417fff640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f440006b3b0 0x7f440006d870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4408036000 tx=0x7f440803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:47:59.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.747+0000 7f4416ffd640 1 -- 172.21.15.132:0/3455249702 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4410054b10 con 0x7f44200d49f0 2024-03-16T17:47:59.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.985+0000 7f4424a76640 1 -- 172.21.15.132:0/3455249702 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44200b6ac0 con 0x7f44200d49f0 2024-03-16T17:47:59.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.985+0000 7f4416ffd640 1 -- 172.21.15.132:0/3455249702 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4410017020 con 0x7f44200d49f0 2024-03-16T17:47:59.989 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:47:59.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 -- 172.21.15.132:0/3455249702 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f440006b3b0 msgr2=0x7f440006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f440006b3b0 0x7f440006d870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4408036000 tx=0x7f440803c040 comp rx=0 tx=0).stop 2024-03-16T17:47:59.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 -- 172.21.15.132:0/3455249702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44200d49f0 msgr2=0x7f44201f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:47:59.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44200d49f0 0x7f44201f5050 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f441000e9b0 tx=0x7f441000ee70 comp rx=0 tx=0).stop 2024-03-16T17:47:59.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 -- 172.21.15.132:0/3455249702 shutdown_connections 2024-03-16T17:47:59.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f440006b3b0 0x7f440006d870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4420161b40 0x7f44200ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4420161760 0x7f4420154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 --2- 172.21.15.132:0/3455249702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44200d49f0 0x7f44201f5050 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:47:59.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 -- 172.21.15.132:0/3455249702 >> 172.21.15.132:0/3455249702 conn(0x7f44200d3ed0 msgr2=0x7f442015e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:47:59.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 -- 172.21.15.132:0/3455249702 shutdown_connections 2024-03-16T17:47:59.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:47:59.988+0000 7f4424a76640 1 -- 172.21.15.132:0/3455249702 wait complete. 2024-03-16T17:48:00.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:00.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.103+0000 7f46eb083640 1 Processor -- start 2024-03-16T17:48:00.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.103+0000 7f46eb083640 1 -- start start 2024-03-16T17:48:00.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.103+0000 7f46eb083640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e415dff0 0x7f46e406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.103+0000 7f46eb083640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e40704a0 con 0x7f46e406ba70 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.103+0000 7f46eb083640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e40ad8e0 con 0x7f46e406aee0 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.103+0000 7f46eb083640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e415f3e0 con 0x7f46e415dff0 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e9620640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f46e406ba70 0x7f46e40ae330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45828/0 (socket says 172.21.15.132:45828) 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e9620640 1 -- 172.21.15.132:0/508558173 learned_addr learned my addr 172.21.15.132:0/508558173 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e8e1f640 1 --2- 172.21.15.132:0/508558173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e415dff0 0x7f46e406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e37fe640 1 -- 172.21.15.132:0/508558173 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200911923 0 0) 0x7f46e40704a0 con 0x7f46e406ba70 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e37fe640 1 -- 172.21.15.132:0/508558173 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d4003520 con 0x7f46e406ba70 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e37fe640 1 -- 172.21.15.132:0/508558173 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450959956 0 0) 0x7f46e40ad8e0 con 0x7f46e406aee0 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e37fe640 1 -- 172.21.15.132:0/508558173 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46e40704a0 con 0x7f46e406aee0 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e37fe640 1 -- 172.21.15.132:0/508558173 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1183842697 0 0) 0x7f46d4003520 con 0x7f46e406ba70 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e8e1f640 1 -- 172.21.15.132:0/508558173 >> v1:172.21.15.194:6789/0 conn(0x7f46e406aee0 legacy=0x7f46e406b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e8e1f640 1 -- 172.21.15.132:0/508558173 >> v1:172.21.15.132:6789/0 conn(0x7f46e406ba70 legacy=0x7f46e40ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.104+0000 7f46e8e1f640 1 -- 172.21.15.132:0/508558173 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40adea0 con 0x7f46e415dff0 2024-03-16T17:48:00.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.105+0000 7f46e8e1f640 1 --2- 172.21.15.132:0/508558173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e415dff0 0x7f46e406ff60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46d80097d0 tx=0x7f46d802b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b72e57afaa4731f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:00.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.105+0000 7f46e37fe640 1 -- 172.21.15.132:0/508558173 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0019f0 con 0x7f46e415dff0 2024-03-16T17:48:00.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.105+0000 7f46e37fe640 1 -- 172.21.15.132:0/508558173 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d802e050 con 0x7f46e415dff0 2024-03-16T17:48:00.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.105+0000 7f46e37fe640 1 -- 172.21.15.132:0/508558173 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8030730 con 0x7f46e415dff0 2024-03-16T17:48:00.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.105+0000 7f46eb083640 1 -- 172.21.15.132:0/508558173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e415dff0 msgr2=0x7f46e406ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.106+0000 7f46eb083640 1 --2- 172.21.15.132:0/508558173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e415dff0 0x7f46e406ff60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f46d80097d0 tx=0x7f46d802b770 comp rx=0 tx=0).stop 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.106+0000 7f46eb083640 1 -- 172.21.15.132:0/508558173 shutdown_connections 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.106+0000 7f46eb083640 1 --2- 172.21.15.132:0/508558173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e415dff0 0x7f46e406ff60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.106+0000 7f46eb083640 1 -- 172.21.15.132:0/508558173 >> 172.21.15.132:0/508558173 conn(0x7f46e40d0b00 msgr2=0x7f46e40d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.106+0000 7f46eb083640 1 -- 172.21.15.132:0/508558173 shutdown_connections 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.106+0000 7f46eb083640 1 -- 172.21.15.132:0/508558173 wait complete. 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.107+0000 7f46eb083640 1 Processor -- start 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.107+0000 7f46eb083640 1 -- start start 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46eb083640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e406aee0 0x7f46e4158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46eb083640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e406ba70 0x7f46e4145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46eb083640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46e415dff0 0x7f46e4148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46eb083640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e41474d0 con 0x7f46e406aee0 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46eb083640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e41468e0 con 0x7f46e415dff0 2024-03-16T17:48:00.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46eb083640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e4146b30 con 0x7f46e406ba70 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e8e1f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e406aee0 0x7f46e4158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e8e1f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e406aee0 0x7f46e4158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38798/0 (socket says 172.21.15.132:38798) 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e8e1f640 1 -- 172.21.15.132:0/3930974437 learned_addr learned my addr 172.21.15.132:0/3930974437 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e9620640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46e415dff0 0x7f46e4148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e3fff640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e406ba70 0x7f46e4145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e8e1f640 1 -- 172.21.15.132:0/3930974437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e406ba70 msgr2=0x7f46e4145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e8e1f640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e406ba70 0x7f46e4145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e8e1f640 1 -- 172.21.15.132:0/3930974437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46e415dff0 msgr2=0x7f46e4148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e8e1f640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46e415dff0 0x7f46e4148970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e8e1f640 1 -- 172.21.15.132:0/3930974437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d8009400 con 0x7f46e406aee0 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e8e1f640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e406aee0 0x7f46e4158bd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f46d8000c00 tx=0x7f46d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e17fa640 1 -- 172.21.15.132:0/3930974437 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8004230 con 0x7f46e406aee0 2024-03-16T17:48:00.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e17fa640 1 -- 172.21.15.132:0/3930974437 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d80043b0 con 0x7f46e406aee0 2024-03-16T17:48:00.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46eb083640 1 -- 172.21.15.132:0/3930974437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e4146e10 con 0x7f46e406aee0 2024-03-16T17:48:00.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46e17fa640 1 -- 172.21.15.132:0/3930974437 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8004520 con 0x7f46e406aee0 2024-03-16T17:48:00.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.108+0000 7f46eb083640 1 -- 172.21.15.132:0/3930974437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e4159110 con 0x7f46e406aee0 2024-03-16T17:48:00.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.109+0000 7f46eb083640 1 -- 172.21.15.132:0/3930974437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e41592a0 con 0x7f46e406aee0 2024-03-16T17:48:00.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.110+0000 7f46e17fa640 1 -- 172.21.15.132:0/3930974437 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f46d8039040 con 0x7f46e406aee0 2024-03-16T17:48:00.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.111+0000 7f46e17fa640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f46c806b3b0 0x7f46c806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.111+0000 7f46e3fff640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f46c806b3b0 0x7f46c806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.111+0000 7f46e17fa640 1 -- 172.21.15.132:0/3930974437 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46d80ab170 con 0x7f46e406aee0 2024-03-16T17:48:00.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.111+0000 7f46e3fff640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f46c806b3b0 0x7f46c806d870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46e40cfe10 tx=0x7f46d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:00.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.115+0000 7f46e17fa640 1 -- 172.21.15.132:0/3930974437 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f46d8075de0 con 0x7f46e406aee0 2024-03-16T17:48:00.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.369+0000 7f46eb083640 1 -- 172.21.15.132:0/3930974437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46e4073560 con 0x7f46e406aee0 2024-03-16T17:48:00.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.370+0000 7f46e17fa640 1 -- 172.21.15.132:0/3930974437 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46d8006e10 con 0x7f46e406aee0 2024-03-16T17:48:00.374 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:00.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 -- 172.21.15.132:0/3930974437 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f46c806b3b0 msgr2=0x7f46c806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f46c806b3b0 0x7f46c806d870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f46e40cfe10 tx=0x7f46d0009040 comp rx=0 tx=0).stop 2024-03-16T17:48:00.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 -- 172.21.15.132:0/3930974437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e406aee0 msgr2=0x7f46e4158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e406aee0 0x7f46e4158bd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f46d8000c00 tx=0x7f46d80046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 -- 172.21.15.132:0/3930974437 shutdown_connections 2024-03-16T17:48:00.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f46c806b3b0 0x7f46c806d870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46e415dff0 0x7f46e4148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46e406ba70 0x7f46e4145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 --2- 172.21.15.132:0/3930974437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e406aee0 0x7f46e4158bd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 -- 172.21.15.132:0/3930974437 >> 172.21.15.132:0/3930974437 conn(0x7f46e40d0b00 msgr2=0x7f46e40b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:00.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 -- 172.21.15.132:0/3930974437 shutdown_connections 2024-03-16T17:48:00.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.372+0000 7f46eb083640 1 -- 172.21.15.132:0/3930974437 wait complete. 2024-03-16T17:48:00.386 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:48:00.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.486+0000 7f518d1d7640 1 Processor -- start 2024-03-16T17:48:00.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.486+0000 7f518d1d7640 1 -- start start 2024-03-16T17:48:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f518d1d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d1e00 0x7f51880cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f518d1d7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51880d1640 0x7f5188157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f518d1d7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51880d0040 con 0x7f51880d21e0 2024-03-16T17:48:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f518d1d7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5188158ae0 con 0x7f51880d1640 2024-03-16T17:48:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f518d1d7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518815f530 con 0x7f51880d1e00 2024-03-16T17:48:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f517e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51880d1640 0x7f5188157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f518759e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f51880d21e0 0x7f51881583d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45836/0 (socket says 172.21.15.132:45836) 2024-03-16T17:48:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f518759e640 1 -- 172.21.15.132:0/1911630486 learned_addr learned my addr 172.21.15.132:0/1911630486 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f517e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f51880d1640 0x7f5188157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38806/0 (socket says 172.21.15.132:38806) 2024-03-16T17:48:00.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f5186d9d640 1 --2- 172.21.15.132:0/1911630486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d1e00 0x7f51880cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f517e59c640 1 -- 172.21.15.132:0/1911630486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d1e00 msgr2=0x7f51880cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:00.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f517e59c640 1 --2- 172.21.15.132:0/1911630486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d1e00 0x7f51880cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f517e59c640 1 -- 172.21.15.132:0/1911630486 >> v1:172.21.15.132:6789/0 conn(0x7f51880d21e0 legacy=0x7f51881583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f518659c640 1 -- 172.21.15.132:0/1911630486 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374174734 0 0) 0x7f5180001490 con 0x7f51880d21e0 2024-03-16T17:48:00.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f517e59c640 1 -- 172.21.15.132:0/1911630486 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518815e920 con 0x7f51880d1640 2024-03-16T17:48:00.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.487+0000 7f5186d9d640 1 --2- 172.21.15.132:0/1911630486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d1e00 0x7f51880cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:00.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.488+0000 7f517e59c640 1 --2- 172.21.15.132:0/1911630486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 0x7f5188157e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f51780097a0 tx=0x7f517802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f573b24f27bcbf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:00.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.488+0000 7f518659c640 1 -- 172.21.15.132:0/1911630486 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178031830 con 0x7f51880d1640 2024-03-16T17:48:00.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.488+0000 7f518659c640 1 -- 172.21.15.132:0/1911630486 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178031990 con 0x7f51880d1640 2024-03-16T17:48:00.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.488+0000 7f518659c640 1 -- 172.21.15.132:0/1911630486 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178031d20 con 0x7f51880d1640 2024-03-16T17:48:00.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.489+0000 7f518d1d7640 1 -- 172.21.15.132:0/1911630486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 msgr2=0x7f5188157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.489+0000 7f518d1d7640 1 --2- 172.21.15.132:0/1911630486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 0x7f5188157e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f51780097a0 tx=0x7f517802b8d0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.489+0000 7f518d1d7640 1 -- 172.21.15.132:0/1911630486 shutdown_connections 2024-03-16T17:48:00.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.489+0000 7f518d1d7640 1 --2- 172.21.15.132:0/1911630486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 0x7f5188157e90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.489+0000 7f518d1d7640 1 --2- 172.21.15.132:0/1911630486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d1e00 0x7f51880cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.489+0000 7f518d1d7640 1 -- 172.21.15.132:0/1911630486 >> 172.21.15.132:0/1911630486 conn(0x7f5188073220 msgr2=0x7f518809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:00.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.489+0000 7f518d1d7640 1 -- 172.21.15.132:0/1911630486 shutdown_connections 2024-03-16T17:48:00.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.489+0000 7f518d1d7640 1 -- 172.21.15.132:0/1911630486 wait complete. 2024-03-16T17:48:00.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.490+0000 7f518d1d7640 1 Processor -- start 2024-03-16T17:48:00.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.490+0000 7f518d1d7640 1 -- start start 2024-03-16T17:48:00.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f518d1d7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 0x7f51881f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f518d1d7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51880d1e00 0x7f51880b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f518d1d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d21e0 0x7f51881f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f518d1d7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51881f6130 con 0x7f51880d1640 2024-03-16T17:48:00.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f518d1d7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51881f5520 con 0x7f51880d1e00 2024-03-16T17:48:00.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f518d1d7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51881f5800 con 0x7f51880d21e0 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f5186d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 0x7f51881f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f5186d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 0x7f51881f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38820/0 (socket says 172.21.15.132:38820) 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f5186d9d640 1 -- 172.21.15.132:0/3775804582 learned_addr learned my addr 172.21.15.132:0/3775804582 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f517e59c640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51880d1e00 0x7f51880b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f518759e640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d21e0 0x7f51881f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f5186d9d640 1 -- 172.21.15.132:0/3775804582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d21e0 msgr2=0x7f51881f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f5186d9d640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d21e0 0x7f51881f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f5186d9d640 1 -- 172.21.15.132:0/3775804582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51880d1e00 msgr2=0x7f51880b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f5186d9d640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51880d1e00 0x7f51880b6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f5186d9d640 1 -- 172.21.15.132:0/3775804582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5178009400 con 0x7f51880d1640 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.491+0000 7f5186d9d640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 0x7f51881f4bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f517000e7e0 tx=0x7f517000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.492+0000 7f517ffff640 1 -- 172.21.15.132:0/3775804582 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5170004030 con 0x7f51880d1640 2024-03-16T17:48:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.492+0000 7f517ffff640 1 -- 172.21.15.132:0/3775804582 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5170004190 con 0x7f51880d1640 2024-03-16T17:48:00.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.492+0000 7f518d1d7640 1 -- 172.21.15.132:0/3775804582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51881f5ae0 con 0x7f51880d1640 2024-03-16T17:48:00.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.492+0000 7f517ffff640 1 -- 172.21.15.132:0/3775804582 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5170004520 con 0x7f51880d1640 2024-03-16T17:48:00.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.492+0000 7f518d1d7640 1 -- 172.21.15.132:0/3775804582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51881f5130 con 0x7f51880d1640 2024-03-16T17:48:00.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.493+0000 7f518d1d7640 1 -- 172.21.15.132:0/3775804582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5188074dc0 con 0x7f51880d1640 2024-03-16T17:48:00.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.493+0000 7f517ffff640 1 -- 172.21.15.132:0/3775804582 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f517000c6d0 con 0x7f51880d1640 2024-03-16T17:48:00.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.493+0000 7f517ffff640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f516c06b3b0 0x7f516c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.494+0000 7f517ffff640 1 -- 172.21.15.132:0/3775804582 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5170089900 con 0x7f51880d1640 2024-03-16T17:48:00.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.494+0000 7f517e59c640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f516c06b3b0 0x7f516c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.494+0000 7f517e59c640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f516c06b3b0 0x7f516c06d870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5178036000 tx=0x7f517803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:00.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.498+0000 7f517ffff640 1 -- 172.21.15.132:0/3775804582 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5170054560 con 0x7f51880d1640 2024-03-16T17:48:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.714+0000 7f518d1d7640 1 -- 172.21.15.132:0/3775804582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f518804f2c0 con 0x7f51880d1640 2024-03-16T17:48:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.714+0000 7f517ffff640 1 -- 172.21.15.132:0/3775804582 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4980 (secure 0 0 0) 0x7f5170057c20 con 0x7f51880d1640 2024-03-16T17:48:00.718 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:00.718 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/481194427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":481194427},{"type":"v1","addr":"172.21.15.194:6834","nonce":481194427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1590172463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1590172463},{"type":"v1","addr":"172.21.15.194:6835","nonce":1590172463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2008777747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2008777747},{"type":"v1","addr":"172.21.15.132:6835","nonce":2008777747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T17:47:49.814572+0000","modified":"2024-03-16T17:47:51.863322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1367984600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1367984600},{"type":"v1","addr":"172.21.15.132:6837","nonce":1367984600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-16T17:48:00.719 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 -- 172.21.15.132:0/3775804582 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f516c06b3b0 msgr2=0x7f516c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f516c06b3b0 0x7f516c06d870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5178036000 tx=0x7f517803c040 comp rx=0 tx=0).stop 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 -- 172.21.15.132:0/3775804582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 msgr2=0x7f51881f4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 0x7f51881f4bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f517000e7e0 tx=0x7f517000eca0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 -- 172.21.15.132:0/3775804582 shutdown_connections 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f516c06b3b0 0x7f516c06d870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51880d21e0 0x7f51881f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51880d1e00 0x7f51880b6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 --2- 172.21.15.132:0/3775804582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51880d1640 0x7f51881f4bf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 -- 172.21.15.132:0/3775804582 >> 172.21.15.132:0/3775804582 conn(0x7f5188073220 msgr2=0x7f518806f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:00.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 -- 172.21.15.132:0/3775804582 shutdown_connections 2024-03-16T17:48:00.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.717+0000 7f518d1d7640 1 -- 172.21.15.132:0/3775804582 wait complete. 2024-03-16T17:48:00.732 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:00.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.828+0000 7f6da0ced640 1 Processor -- start 2024-03-16T17:48:00.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.828+0000 7f6da0ced640 1 -- start start 2024-03-16T17:48:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.829+0000 7f6da0ced640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c15bec0 0x7f6d9c160470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.829+0000 7f6da0ced640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d9c0cd4f0 0x7f6d9c0cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.829+0000 7f6da0ced640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c0cd060 con 0x7f6d9c0d0510 2024-03-16T17:48:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.829+0000 7f6da0ced640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c0d0980 con 0x7f6d9c0cd4f0 2024-03-16T17:48:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.829+0000 7f6da0ced640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c1609b0 con 0x7f6d9c15bec0 2024-03-16T17:48:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.829+0000 7f6d9ad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6d9c0d0510 0x7f6d9c0b4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45844/0 (socket says 172.21.15.132:45844) 2024-03-16T17:48:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.829+0000 7f6d9ad9d640 1 -- 172.21.15.132:0/859347795 learned_addr learned my addr 172.21.15.132:0/859347795 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.829+0000 7f6d9a59c640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c15bec0 0x7f6d9c160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.829+0000 7f6d91d9b640 1 --2- 172.21.15.132:0/859347795 >> v2:172.21.15.194:3300/0 conn(0x7f6d9c0cd4f0 0x7f6d9c0cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.829+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410142352 0 0) 0x7f6d9c0cd060 con 0x7f6d9c0d0510 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d88003520 con 0x7f6d9c0d0510 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 824983247 0 0) 0x7f6d88003520 con 0x7f6d9c0d0510 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c15bec0 msgr2=0x7f6d9c160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c15bec0 0x7f6d9c160470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 >> v2:172.21.15.194:3300/0 conn(0x7f6d9c0cd4f0 msgr2=0x7f6d9c0cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 --2- 172.21.15.132:0/859347795 >> v2:172.21.15.194:3300/0 conn(0x7f6d9c0cd4f0 0x7f6d9c0cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0d2a00 con 0x7f6d9c0d0510 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f6d940019f0 con 0x7f6d9c0d0510 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 >> v1:172.21.15.132:6789/0 conn(0x7f6d9c0d0510 legacy=0x7f6d9c0b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c15bec0 0x7f6d88003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 0x7f6d880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d88004d00 0x7f6d88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0d0980 con 0x7f6d88003ef0 2024-03-16T17:48:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c1609b0 con 0x7f6d88004d00 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8800b980 con 0x7f6d9c15bec0 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d91d9b640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 0x7f6d880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d9a59c640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c15bec0 0x7f6d88003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d9ad9d640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d88004d00 0x7f6d88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d91d9b640 1 -- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c15bec0 msgr2=0x7f6d88003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d91d9b640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c15bec0 0x7f6d88003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d91d9b640 1 -- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d88004d00 msgr2=0x7f6d88005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d91d9b640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d88004d00 0x7f6d88005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.830+0000 7f6d91d9b640 1 -- 172.21.15.132:0/859347795 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88003520 con 0x7f6d88003ef0 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.831+0000 7f6d91d9b640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 0x7f6d880047c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009ac0 tx=0x7f6d880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae947fb9744b9863 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.831+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8402c6d0 con 0x7f6d88003ef0 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.831+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8402c830 con 0x7f6d88003ef0 2024-03-16T17:48:00.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.831+0000 7f6d99d9b640 1 -- 172.21.15.132:0/859347795 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8402cbc0 con 0x7f6d88003ef0 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.832+0000 7f6da0ced640 1 -- 172.21.15.132:0/859347795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 msgr2=0x7f6d880047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.832+0000 7f6da0ced640 1 --2- 172.21.15.132:0/859347795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 0x7f6d880047c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009ac0 tx=0x7f6d880057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.832+0000 7f6d9ad9d640 1 -- 172.21.15.132:0/859347795 reap_dead start 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.832+0000 7f6da0ced640 1 -- 172.21.15.132:0/859347795 shutdown_connections 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.832+0000 7f6da0ced640 1 -- 172.21.15.132:0/859347795 >> 172.21.15.132:0/859347795 conn(0x7f6d9c0d1c20 msgr2=0x7f6d9c0d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.832+0000 7f6da0ced640 1 -- 172.21.15.132:0/859347795 shutdown_connections 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.832+0000 7f6da0ced640 1 -- 172.21.15.132:0/859347795 wait complete. 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.833+0000 7f6da0ced640 1 Processor -- start 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.833+0000 7f6da0ced640 1 -- start start 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6da0ced640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 0x7f6d9c0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6da0ced640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d9c1547c0 0x7f6d9c154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6da0ced640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c1f42f0 0x7f6d9c1f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6da0ced640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c152990 con 0x7f6d88003ef0 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6da0ced640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c151b00 con 0x7f6d9c1547c0 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6da0ced640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c1f4cb0 con 0x7f6d9c1f42f0 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6d9a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 0x7f6d9c0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6d9a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 0x7f6d9c0c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38840/0 (socket says 172.21.15.132:38840) 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6d9a59c640 1 -- 172.21.15.132:0/2163279948 learned_addr learned my addr 172.21.15.132:0/2163279948 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6d91d9b640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d9c1547c0 0x7f6d9c154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6d9ad9d640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c1f42f0 0x7f6d9c1f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6d9a59c640 1 -- 172.21.15.132:0/2163279948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c1f42f0 msgr2=0x7f6d9c1f4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6d9a59c640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c1f42f0 0x7f6d9c1f4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6d9a59c640 1 -- 172.21.15.132:0/2163279948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d9c1547c0 msgr2=0x7f6d9c154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6d9a59c640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d9c1547c0 0x7f6d9c154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.834+0000 7f6d9a59c640 1 -- 172.21.15.132:0/2163279948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c154310 con 0x7f6d88003ef0 2024-03-16T17:48:00.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.835+0000 7f6d9a59c640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 0x7f6d9c0c6f00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0119a0 tx=0x7f6d8c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.835+0000 7f6d937fe640 1 -- 172.21.15.132:0/2163279948 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00faf0 con 0x7f6d88003ef0 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.835+0000 7f6d937fe640 1 -- 172.21.15.132:0/2163279948 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c00fc50 con 0x7f6d88003ef0 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.835+0000 7f6d937fe640 1 -- 172.21.15.132:0/2163279948 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c014440 con 0x7f6d88003ef0 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.835+0000 7f6da0ced640 1 -- 172.21.15.132:0/2163279948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c151d10 con 0x7f6d88003ef0 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.835+0000 7f6da0ced640 1 -- 172.21.15.132:0/2163279948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c1522d0 con 0x7f6d88003ef0 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.836+0000 7f6da0ced640 1 -- 172.21.15.132:0/2163279948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c04f2c0 con 0x7f6d88003ef0 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.836+0000 7f6d937fe640 1 -- 172.21.15.132:0/2163279948 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f6d8c0145a0 con 0x7f6d88003ef0 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.837+0000 7f6d937fe640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6d7c06b3b0 0x7f6d7c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.837+0000 7f6d91d9b640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6d7c06b3b0 0x7f6d7c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.837+0000 7f6d937fe640 1 -- 172.21.15.132:0/2163279948 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d8c08a3a0 con 0x7f6d88003ef0 2024-03-16T17:48:00.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.837+0000 7f6d91d9b640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6d7c06b3b0 0x7f6d7c06d870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d84036000 tx=0x7f6d84030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:00.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:00.841+0000 7f6d937fe640 1 -- 172.21.15.132:0/2163279948 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6d8c055090 con 0x7f6d88003ef0 2024-03-16T17:48:01.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.017+0000 7f6da0ced640 1 -- 172.21.15.132:0/2163279948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d9c070b90 con 0x7f6d88003ef0 2024-03-16T17:48:01.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.018+0000 7f6d937fe640 1 -- 172.21.15.132:0/2163279948 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f6d8c05de60 con 0x7f6d88003ef0 2024-03-16T17:48:01.022 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 -- 172.21.15.132:0/2163279948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6d7c06b3b0 msgr2=0x7f6d7c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6d7c06b3b0 0x7f6d7c06d870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d84036000 tx=0x7f6d84030000 comp rx=0 tx=0).stop 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 -- 172.21.15.132:0/2163279948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 msgr2=0x7f6d9c0c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 0x7f6d9c0c6f00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0119a0 tx=0x7f6d8c011e60 comp rx=0 tx=0).stop 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 -- 172.21.15.132:0/2163279948 shutdown_connections 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6d7c06b3b0 0x7f6d7c06d870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d9c1f42f0 0x7f6d9c1f4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d9c1547c0 0x7f6d9c154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 --2- 172.21.15.132:0/2163279948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6d88003ef0 0x7f6d9c0c6f00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 -- 172.21.15.132:0/2163279948 >> 172.21.15.132:0/2163279948 conn(0x7f6d9c0d1c20 msgr2=0x7f6d9c0ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 -- 172.21.15.132:0/2163279948 shutdown_connections 2024-03-16T17:48:01.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.021+0000 7f6da0ced640 1 -- 172.21.15.132:0/2163279948 wait complete. 2024-03-16T17:48:01.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:01.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:01.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.135+0000 7f8bfd183640 1 Processor -- start 2024-03-16T17:48:01.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.136+0000 7f8bfd183640 1 -- start start 2024-03-16T17:48:01.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bfd183640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8bf81601f0 0x7f8bf80b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bfd183640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf815f870 con 0x7f8bf815f490 2024-03-16T17:48:01.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bfd183640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80cd5c0 con 0x7f8bf81606a0 2024-03-16T17:48:01.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bfd183640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80cdb80 con 0x7f8bf81601f0 2024-03-16T17:48:01.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bf6d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8bf815f490 0x7f8bf806ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45848/0 (socket says 172.21.15.132:45848) 2024-03-16T17:48:01.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bf6d9d640 1 -- 172.21.15.132:0/3925542833 learned_addr learned my addr 172.21.15.132:0/3925542833 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:01.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bf759e640 1 --2- 172.21.15.132:0/3925542833 >> v2:172.21.15.194:3300/0 conn(0x7f8bf81601f0 0x7f8bf80b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bf659c640 1 -- 172.21.15.132:0/3925542833 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476015468 0 0) 0x7f8bf815f870 con 0x7f8bf815f490 2024-03-16T17:48:01.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bf659c640 1 -- 172.21.15.132:0/3925542833 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be4003520 con 0x7f8bf815f490 2024-03-16T17:48:01.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bf759e640 1 -- 172.21.15.132:0/3925542833 >> v1:172.21.15.194:6789/0 conn(0x7f8bf81606a0 legacy=0x7f8bf815fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bf759e640 1 -- 172.21.15.132:0/3925542833 >> v1:172.21.15.132:6789/0 conn(0x7f8bf815f490 legacy=0x7f8bf806ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.137+0000 7f8bf759e640 1 -- 172.21.15.132:0/3925542833 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80cd8a0 con 0x7f8bf81601f0 2024-03-16T17:48:01.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.138+0000 7f8bf759e640 1 --2- 172.21.15.132:0/3925542833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf81601f0 0x7f8bf80b4250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009d90 tx=0x7f8bf002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da44f357e077cfd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:01.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.138+0000 7f8bf659c640 1 -- 172.21.15.132:0/3925542833 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf002cbd0 con 0x7f8bf81601f0 2024-03-16T17:48:01.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.138+0000 7f8bf659c640 1 -- 172.21.15.132:0/3925542833 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf002cd30 con 0x7f8bf81601f0 2024-03-16T17:48:01.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.138+0000 7f8bf659c640 1 -- 172.21.15.132:0/3925542833 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf002cea0 con 0x7f8bf81601f0 2024-03-16T17:48:01.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.139+0000 7f8bfd183640 1 -- 172.21.15.132:0/3925542833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf81601f0 msgr2=0x7f8bf80b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.139+0000 7f8bfd183640 1 --2- 172.21.15.132:0/3925542833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf81601f0 0x7f8bf80b4250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009d90 tx=0x7f8bf002be20 comp rx=0 tx=0).stop 2024-03-16T17:48:01.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.139+0000 7f8bfd183640 1 -- 172.21.15.132:0/3925542833 shutdown_connections 2024-03-16T17:48:01.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.139+0000 7f8bfd183640 1 --2- 172.21.15.132:0/3925542833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf81601f0 0x7f8bf80b4250 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.139+0000 7f8bfd183640 1 -- 172.21.15.132:0/3925542833 >> 172.21.15.132:0/3925542833 conn(0x7f8bf80b3730 msgr2=0x7f8bf80b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:01.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.139+0000 7f8bfd183640 1 -- 172.21.15.132:0/3925542833 shutdown_connections 2024-03-16T17:48:01.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.139+0000 7f8bfd183640 1 -- 172.21.15.132:0/3925542833 wait complete. 2024-03-16T17:48:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.140+0000 7f8bfd183640 1 Processor -- start 2024-03-16T17:48:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.140+0000 7f8bfd183640 1 -- start start 2024-03-16T17:48:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bfd183640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bf815f490 0x7f8bf8158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bfd183640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bf81601f0 0x7f8bf80b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bfd183640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf81606a0 0x7f8bf80b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bfd183640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8159270 con 0x7f8bf815f490 2024-03-16T17:48:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bfd183640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80b7450 con 0x7f8bf81606a0 2024-03-16T17:48:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bfd183640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80aeab0 con 0x7f8bf81601f0 2024-03-16T17:48:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bf6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bf815f490 0x7f8bf8158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bf6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bf815f490 0x7f8bf8158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38852/0 (socket says 172.21.15.132:38852) 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bf6d9d640 1 -- 172.21.15.132:0/3978326302 learned_addr learned my addr 172.21.15.132:0/3978326302 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bf759e640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf81606a0 0x7f8bf80b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8beffff640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bf81601f0 0x7f8bf80b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bf6d9d640 1 -- 172.21.15.132:0/3978326302 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bf81601f0 msgr2=0x7f8bf80b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bf6d9d640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bf81601f0 0x7f8bf80b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bf6d9d640 1 -- 172.21.15.132:0/3978326302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf81606a0 msgr2=0x7f8bf80b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bf6d9d640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf81606a0 0x7f8bf80b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.141+0000 7f8bf6d9d640 1 -- 172.21.15.132:0/3978326302 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0009a70 con 0x7f8bf815f490 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.142+0000 7f8bf6d9d640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bf815f490 0x7f8bf8158d30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8be800c410 tx=0x7f8be800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.142+0000 7f8bef7fe640 1 -- 172.21.15.132:0/3978326302 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8005ce0 con 0x7f8bf815f490 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.142+0000 7f8bef7fe640 1 -- 172.21.15.132:0/3978326302 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be8005e40 con 0x7f8bf815f490 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.142+0000 7f8bef7fe640 1 -- 172.21.15.132:0/3978326302 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80072f0 con 0x7f8bf815f490 2024-03-16T17:48:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.142+0000 7f8bfd183640 1 -- 172.21.15.132:0/3978326302 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf80aed90 con 0x7f8bf815f490 2024-03-16T17:48:01.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.142+0000 7f8bfd183640 1 -- 172.21.15.132:0/3978326302 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf80b7730 con 0x7f8bf815f490 2024-03-16T17:48:01.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.143+0000 7f8bfd183640 1 -- 172.21.15.132:0/3978326302 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf8068450 con 0x7f8bf815f490 2024-03-16T17:48:01.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.143+0000 7f8bef7fe640 1 -- 172.21.15.132:0/3978326302 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f8be8007510 con 0x7f8bf815f490 2024-03-16T17:48:01.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.144+0000 7f8bef7fe640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8bd806b3b0 0x7f8bd806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.144+0000 7f8bef7fe640 1 -- 172.21.15.132:0/3978326302 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8be80891e0 con 0x7f8bf815f490 2024-03-16T17:48:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.144+0000 7f8beffff640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8bd806b3b0 0x7f8bd806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.144+0000 7f8beffff640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8bd806b3b0 0x7f8bd806d870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bf806f140 tx=0x7f8be0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:01.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.148+0000 7f8bef7fe640 1 -- 172.21.15.132:0/3978326302 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8be8053f90 con 0x7f8bf815f490 2024-03-16T17:48:01.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.324+0000 7f8bfd183640 1 -- 172.21.15.132:0/3978326302 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bf80af2b0 con 0x7f8bf815f490 2024-03-16T17:48:01.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.325+0000 7f8bef7fe640 1 -- 172.21.15.132:0/3978326302 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8be8057650 con 0x7f8bf815f490 2024-03-16T17:48:01.329 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:01.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 -- 172.21.15.132:0/3978326302 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8bd806b3b0 msgr2=0x7f8bd806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8bd806b3b0 0x7f8bd806d870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bf806f140 tx=0x7f8be0009040 comp rx=0 tx=0).stop 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 -- 172.21.15.132:0/3978326302 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bf815f490 msgr2=0x7f8bf8158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bf815f490 0x7f8bf8158d30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8be800c410 tx=0x7f8be800c8d0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 -- 172.21.15.132:0/3978326302 shutdown_connections 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8bd806b3b0 0x7f8bd806d870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bf81606a0 0x7f8bf80b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bf81601f0 0x7f8bf80b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 --2- 172.21.15.132:0/3978326302 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8bf815f490 0x7f8bf8158d30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 -- 172.21.15.132:0/3978326302 >> 172.21.15.132:0/3978326302 conn(0x7f8bf80b3730 msgr2=0x7f8bf80cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 -- 172.21.15.132:0/3978326302 shutdown_connections 2024-03-16T17:48:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.327+0000 7f8bfd183640 1 -- 172.21.15.132:0/3978326302 wait complete. 2024-03-16T17:48:01.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:01.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.453+0000 7f8e1b1e9640 1 Processor -- start 2024-03-16T17:48:01.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.453+0000 7f8e1b1e9640 1 -- start start 2024-03-16T17:48:01.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.453+0000 7f8e1b1e9640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8e14161760 0x7f8e140b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.453+0000 7f8e1b1e9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e140cff20 con 0x7f8e140d0d10 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.453+0000 7f8e1b1e9640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e140b5500 con 0x7f8e14161b40 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.453+0000 7f8e1b1e9640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e140cf5f0 con 0x7f8e14161760 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.453+0000 7f8e19786640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8e140d0d10 0x7f8e140c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45864/0 (socket says 172.21.15.132:45864) 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e19786640 1 -- 172.21.15.132:0/2861543017 learned_addr learned my addr 172.21.15.132:0/2861543017 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e18f85640 1 --2- 172.21.15.132:0/2861543017 >> v2:172.21.15.194:3300/0 conn(0x7f8e14161760 0x7f8e140b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882572636 0 0) 0x7f8e140cff20 con 0x7f8e140d0d10 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e04003520 con 0x7f8e140d0d10 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214733621 0 0) 0x7f8e140b5500 con 0x7f8e14161b40 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e140cff20 con 0x7f8e14161b40 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1653745841 0 0) 0x7f8e04003520 con 0x7f8e140d0d10 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 >> v2:172.21.15.194:3300/0 conn(0x7f8e14161760 msgr2=0x7f8e140b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 --2- 172.21.15.132:0/2861543017 >> v2:172.21.15.194:3300/0 conn(0x7f8e14161760 0x7f8e140b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 >> v1:172.21.15.194:6789/0 conn(0x7f8e14161b40 legacy=0x7f8e140d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e140cf8d0 con 0x7f8e140d0d10 2024-03-16T17:48:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f8e0c0019f0 con 0x7f8e140d0d10 2024-03-16T17:48:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e18f85640 1 --2- 172.21.15.132:0/2861543017 >> v2:172.21.15.194:3300/0 conn(0x7f8e14161760 0x7f8e140b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 >> v1:172.21.15.132:6789/0 conn(0x7f8e140d0d10 legacy=0x7f8e140c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e04003b50 0x7f8e04003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e040047c0 0x7f8e04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e0400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140cf5f0 con 0x7f8e04005180 2024-03-16T17:48:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0400c050 con 0x7f8e040047c0 2024-03-16T17:48:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0400c210 con 0x7f8e04003b50 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e19786640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e0400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e18f85640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e04003b50 0x7f8e04003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e13fff640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e040047c0 0x7f8e04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e19786640 1 -- 172.21.15.132:0/2861543017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e04003b50 msgr2=0x7f8e04003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e19786640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e04003b50 0x7f8e04003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e19786640 1 -- 172.21.15.132:0/2861543017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e040047c0 msgr2=0x7f8e04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e19786640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e040047c0 0x7f8e04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.454+0000 7f8e19786640 1 -- 172.21.15.132:0/2861543017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e04003520 con 0x7f8e04005180 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.455+0000 7f8e19786640 1 -- 172.21.15.132:0/2861543017 reap_dead start 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.455+0000 7f8e19786640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e0400b980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e1408cbf0 tx=0x7f8e040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4634142cf189a88 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.455+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c034630 con 0x7f8e04005180 2024-03-16T17:48:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.455+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0c02f070 con 0x7f8e04005180 2024-03-16T17:48:01.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.455+0000 7f8e137fe640 1 -- 172.21.15.132:0/2861543017 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0349d0 con 0x7f8e04005180 2024-03-16T17:48:01.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.456+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2861543017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 msgr2=0x7f8e0400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.456+0000 7f8e1b1e9640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e0400b980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8e1408cbf0 tx=0x7f8e040057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.456+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2861543017 shutdown_connections 2024-03-16T17:48:01.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.456+0000 7f8e1b1e9640 1 --2- 172.21.15.132:0/2861543017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e0400b980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.456+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2861543017 >> 172.21.15.132:0/2861543017 conn(0x7f8e140d3ed0 msgr2=0x7f8e140d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:01.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.456+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2861543017 shutdown_connections 2024-03-16T17:48:01.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.456+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2861543017 wait complete. 2024-03-16T17:48:01.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.457+0000 7f8e1b1e9640 1 Processor -- start 2024-03-16T17:48:01.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.457+0000 7f8e1b1e9640 1 -- start start 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e1b1e9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e141514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e1b1e9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e140a1300 0x7f8e1409e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e1b1e9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e140b8cc0 0x7f8e140b9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e1b1e9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140b96b0 con 0x7f8e04005180 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e1b1e9640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140a0540 con 0x7f8e140a1300 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e1b1e9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e140a0820 con 0x7f8e140b8cc0 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e18f85640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e141514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e18f85640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e141514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38880/0 (socket says 172.21.15.132:38880) 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e18f85640 1 -- 172.21.15.132:0/2246257576 learned_addr learned my addr 172.21.15.132:0/2246257576 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e18f85640 1 -- 172.21.15.132:0/2246257576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e140b8cc0 msgr2=0x7f8e140b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e18f85640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e140b8cc0 0x7f8e140b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e18f85640 1 -- 172.21.15.132:0/2246257576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e140a1300 msgr2=0x7f8e1409e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e18f85640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e140a1300 0x7f8e1409e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e18f85640 1 -- 172.21.15.132:0/2246257576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e140a0b00 con 0x7f8e04005180 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.458+0000 7f8e18f85640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e141514d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e08011a90 tx=0x7f8e08011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.459+0000 7f8e117fa640 1 -- 172.21.15.132:0/2246257576 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800fc10 con 0x7f8e04005180 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.459+0000 7f8e117fa640 1 -- 172.21.15.132:0/2246257576 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0800fd70 con 0x7f8e04005180 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.459+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2246257576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e140a0de0 con 0x7f8e04005180 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.459+0000 7f8e117fa640 1 -- 172.21.15.132:0/2246257576 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800fee0 con 0x7f8e04005180 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.459+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2246257576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e140a0160 con 0x7f8e04005180 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.460+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2246257576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e14068450 con 0x7f8e04005180 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.460+0000 7f8e117fa640 1 -- 172.21.15.132:0/2246257576 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f8e08004260 con 0x7f8e04005180 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.460+0000 7f8e117fa640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8df806b3e0 0x7f8df806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.461+0000 7f8e13fff640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8df806b3e0 0x7f8df806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.461+0000 7f8e117fa640 1 -- 172.21.15.132:0/2246257576 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e0808a230 con 0x7f8e04005180 2024-03-16T17:48:01.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.461+0000 7f8e13fff640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8df806b3e0 0x7f8df806d8a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8e1409e330 tx=0x7f8e00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:01.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.465+0000 7f8e117fa640 1 -- 172.21.15.132:0/2246257576 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8e08054f20 con 0x7f8e04005180 2024-03-16T17:48:01.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.649+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2246257576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e140a1d50 con 0x7f8e04005180 2024-03-16T17:48:01.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.649+0000 7f8e117fa640 1 -- 172.21.15.132:0/2246257576 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e080585e0 con 0x7f8e04005180 2024-03-16T17:48:01.653 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:01.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.651+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2246257576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8df806b3e0 msgr2=0x7f8df806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.651+0000 7f8e1b1e9640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8df806b3e0 0x7f8df806d8a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8e1409e330 tx=0x7f8e00009040 comp rx=0 tx=0).stop 2024-03-16T17:48:01.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.651+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2246257576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 msgr2=0x7f8e141514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.651+0000 7f8e1b1e9640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e141514d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e08011a90 tx=0x7f8e08011f50 comp rx=0 tx=0).stop 2024-03-16T17:48:01.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.651+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2246257576 shutdown_connections 2024-03-16T17:48:01.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.651+0000 7f8e1b1e9640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8df806b3e0 0x7f8df806d8a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.651+0000 7f8e1b1e9640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e140b8cc0 0x7f8e140b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.651+0000 7f8e1b1e9640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e140a1300 0x7f8e1409e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.651+0000 7f8e1b1e9640 1 --2- 172.21.15.132:0/2246257576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e04005180 0x7f8e141514d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.651+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2246257576 >> 172.21.15.132:0/2246257576 conn(0x7f8e140d3ed0 msgr2=0x7f8e1415f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:01.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.652+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2246257576 shutdown_connections 2024-03-16T17:48:01.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.652+0000 7f8e1b1e9640 1 -- 172.21.15.132:0/2246257576 wait complete. 2024-03-16T17:48:01.666 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:01.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.764+0000 7f720d14b640 1 Processor -- start 2024-03-16T17:48:01.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.764+0000 7f720d14b640 1 -- start start 2024-03-16T17:48:01.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.765+0000 7f720d14b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72080cf9a0 0x7f7208168ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.765+0000 7f720d14b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7208162980 con 0x7f72080d2960 2024-03-16T17:48:01.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.765+0000 7f720d14b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720815e700 con 0x7f720815e120 2024-03-16T17:48:01.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.765+0000 7f720d14b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720815e500 con 0x7f72080cf9a0 2024-03-16T17:48:01.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.765+0000 7f720759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72080cf9a0 0x7f7208168ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.765+0000 7f720659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f72080d2960 0x7f7208162270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45878/0 (socket says 172.21.15.132:45878) 2024-03-16T17:48:01.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.765+0000 7f720659c640 1 -- 172.21.15.132:0/1851376227 learned_addr learned my addr 172.21.15.132:0/1851376227 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:01.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.766+0000 7f720759e640 1 -- 172.21.15.132:0/1851376227 >> v1:172.21.15.194:6789/0 conn(0x7f720815e120 legacy=0x7f7208161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.766+0000 7f720759e640 1 -- 172.21.15.132:0/1851376227 >> v1:172.21.15.132:6789/0 conn(0x7f72080d2960 legacy=0x7f7208162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.766+0000 7f7205d9b640 1 -- 172.21.15.132:0/1851376227 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670834024 0 0) 0x7f7208162980 con 0x7f72080d2960 2024-03-16T17:48:01.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.766+0000 7f720759e640 1 -- 172.21.15.132:0/1851376227 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720815e9a0 con 0x7f72080cf9a0 2024-03-16T17:48:01.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.766+0000 7f720759e640 1 --2- 172.21.15.132:0/1851376227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 0x7f7208168ed0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f72000097a0 tx=0x7f720002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d735a0fb26e4a871 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:01.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.767+0000 7f7205d9b640 1 -- 172.21.15.132:0/1851376227 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200031830 con 0x7f72080cf9a0 2024-03-16T17:48:01.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.767+0000 7f7205d9b640 1 -- 172.21.15.132:0/1851376227 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7200031990 con 0x7f72080cf9a0 2024-03-16T17:48:01.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.767+0000 7f7205d9b640 1 -- 172.21.15.132:0/1851376227 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200031d20 con 0x7f72080cf9a0 2024-03-16T17:48:01.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.767+0000 7f720d14b640 1 -- 172.21.15.132:0/1851376227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 msgr2=0x7f7208168ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.767+0000 7f720d14b640 1 --2- 172.21.15.132:0/1851376227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 0x7f7208168ed0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f72000097a0 tx=0x7f720002b8d0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.767+0000 7f720d14b640 1 -- 172.21.15.132:0/1851376227 shutdown_connections 2024-03-16T17:48:01.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.767+0000 7f720d14b640 1 --2- 172.21.15.132:0/1851376227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 0x7f7208168ed0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.767+0000 7f720d14b640 1 -- 172.21.15.132:0/1851376227 >> 172.21.15.132:0/1851376227 conn(0x7f72080d3d80 msgr2=0x7f72080d4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:01.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.767+0000 7f720d14b640 1 -- 172.21.15.132:0/1851376227 shutdown_connections 2024-03-16T17:48:01.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.767+0000 7f720d14b640 1 -- 172.21.15.132:0/1851376227 wait complete. 2024-03-16T17:48:01.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f720d14b640 1 Processor -- start 2024-03-16T17:48:01.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f720d14b640 1 -- start start 2024-03-16T17:48:01.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f720d14b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 0x7f720815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f720d14b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72080d2960 0x7f72081e9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f720d14b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f720815e120 0x7f72080c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f720d14b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72081ea170 con 0x7f72080cf9a0 2024-03-16T17:48:01.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f720d14b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72081ea450 con 0x7f72080d2960 2024-03-16T17:48:01.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f720d14b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72081ea730 con 0x7f720815e120 2024-03-16T17:48:01.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f7206d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 0x7f720815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f7206d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 0x7f720815a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38890/0 (socket says 172.21.15.132:38890) 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.769+0000 7f7206d9d640 1 -- 172.21.15.132:0/2729566358 learned_addr learned my addr 172.21.15.132:0/2729566358 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f720659c640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72080d2960 0x7f72081e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f7206d9d640 1 -- 172.21.15.132:0/2729566358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f720815e120 msgr2=0x7f72080c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f7206d9d640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f720815e120 0x7f72080c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f7206d9d640 1 -- 172.21.15.132:0/2729566358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72080d2960 msgr2=0x7f72081e9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f7206d9d640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72080d2960 0x7f72081e9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f7206d9d640 1 -- 172.21.15.132:0/2729566358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7200009400 con 0x7f72080cf9a0 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f7206d9d640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 0x7f720815a150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71f800c870 tx=0x7f71f800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f71ff7fe640 1 -- 172.21.15.132:0/2729566358 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f8003b70 con 0x7f72080cf9a0 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f71ff7fe640 1 -- 172.21.15.132:0/2729566358 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f8003cf0 con 0x7f72080cf9a0 2024-03-16T17:48:01.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f720d14b640 1 -- 172.21.15.132:0/2729566358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72080cbd10 con 0x7f72080cf9a0 2024-03-16T17:48:01.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f71ff7fe640 1 -- 172.21.15.132:0/2729566358 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f800aa90 con 0x7f72080cf9a0 2024-03-16T17:48:01.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.770+0000 7f720d14b640 1 -- 172.21.15.132:0/2729566358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720815a690 con 0x7f72080cf9a0 2024-03-16T17:48:01.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.771+0000 7f720d14b640 1 -- 172.21.15.132:0/2729566358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72080cc230 con 0x7f72080cf9a0 2024-03-16T17:48:01.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.772+0000 7f71ff7fe640 1 -- 172.21.15.132:0/2729566358 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f71f800abf0 con 0x7f72080cf9a0 2024-03-16T17:48:01.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.772+0000 7f71ff7fe640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f71e806b3b0 0x7f71e806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:01.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.773+0000 7f71ff7fe640 1 -- 172.21.15.132:0/2729566358 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71f8089af0 con 0x7f72080cf9a0 2024-03-16T17:48:01.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.773+0000 7f720659c640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f71e806b3b0 0x7f71e806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:01.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.773+0000 7f720659c640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f71e806b3b0 0x7f71e806d870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f72081f7350 tx=0x7f71f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:01.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.777+0000 7f71ff7fe640 1 -- 172.21.15.132:0/2729566358 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f72080cc230 con 0x7f72080cf9a0 2024-03-16T17:48:01.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.953+0000 7f720d14b640 1 -- 172.21.15.132:0/2729566358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72080cc230 con 0x7f72080cf9a0 2024-03-16T17:48:01.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.954+0000 7f71ff7fe640 1 -- 172.21.15.132:0/2729566358 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f72080cc230 con 0x7f72080cf9a0 2024-03-16T17:48:01.958 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:01.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 -- 172.21.15.132:0/2729566358 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f71e806b3b0 msgr2=0x7f71e806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f71e806b3b0 0x7f71e806d870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f72081f7350 tx=0x7f71f0009040 comp rx=0 tx=0).stop 2024-03-16T17:48:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 -- 172.21.15.132:0/2729566358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 msgr2=0x7f720815a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 0x7f720815a150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f71f800c870 tx=0x7f71f800cd30 comp rx=0 tx=0).stop 2024-03-16T17:48:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 -- 172.21.15.132:0/2729566358 shutdown_connections 2024-03-16T17:48:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f71e806b3b0 0x7f71e806d870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f720815e120 0x7f72080c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72080d2960 0x7f72081e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 --2- 172.21.15.132:0/2729566358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72080cf9a0 0x7f720815a150 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 -- 172.21.15.132:0/2729566358 >> 172.21.15.132:0/2729566358 conn(0x7f72080d3d80 msgr2=0x7f720815f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 -- 172.21.15.132:0/2729566358 shutdown_connections 2024-03-16T17:48:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:01.956+0000 7f720d14b640 1 -- 172.21.15.132:0/2729566358 wait complete. 2024-03-16T17:48:01.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:48:02.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.068+0000 7f075dcc9640 1 Processor -- start 2024-03-16T17:48:02.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.069+0000 7f075dcc9640 1 -- start start 2024-03-16T17:48:02.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.069+0000 7f075dcc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07580d2020 0x7f07580cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.069+0000 7f075dcc9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075809b700 con 0x7f07580d1b90 2024-03-16T17:48:02.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.069+0000 7f075dcc9640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07581567f0 con 0x7f0758156410 2024-03-16T17:48:02.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.069+0000 7f075dcc9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075809b180 con 0x7f07580d2020 2024-03-16T17:48:02.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.069+0000 7f0757fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07580d2020 0x7f07580cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.069+0000 7f0757fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07580d2020 0x7f07580cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38894/0 (socket says 172.21.15.132:38894) 2024-03-16T17:48:02.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.069+0000 7f0757fff640 1 -- 172.21.15.132:0/2757062369 learned_addr learned my addr 172.21.15.132:0/2757062369 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:02.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.069+0000 7f0756ffd640 1 --1- 172.21.15.132:0/2757062369 >> v1:172.21.15.132:6789/0 conn(0x7f07580d1b90 0x7f07580ce550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45888/0 (socket says 172.21.15.132:45888) 2024-03-16T17:48:02.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.070+0000 7f0757fff640 1 -- 172.21.15.132:0/2757062369 >> v1:172.21.15.194:6789/0 conn(0x7f0758156410 legacy=0x7f075815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.070+0000 7f0757fff640 1 -- 172.21.15.132:0/2757062369 >> v1:172.21.15.132:6789/0 conn(0x7f07580d1b90 legacy=0x7f07580ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.070+0000 7f0757fff640 1 -- 172.21.15.132:0/2757062369 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580b30b0 con 0x7f07580d2020 2024-03-16T17:48:02.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.070+0000 7f0757fff640 1 --2- 172.21.15.132:0/2757062369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07580d2020 0x7f07580cec60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0750009870 tx=0x7f075002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af638604205b8a40 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:02.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.071+0000 7f07567fc640 1 -- 172.21.15.132:0/2757062369 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750031870 con 0x7f07580d2020 2024-03-16T17:48:02.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.071+0000 7f07567fc640 1 -- 172.21.15.132:0/2757062369 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500319d0 con 0x7f07580d2020 2024-03-16T17:48:02.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.071+0000 7f07567fc640 1 -- 172.21.15.132:0/2757062369 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750031d60 con 0x7f07580d2020 2024-03-16T17:48:02.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.071+0000 7f075dcc9640 1 -- 172.21.15.132:0/2757062369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07580d2020 msgr2=0x7f07580cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.071+0000 7f075dcc9640 1 --2- 172.21.15.132:0/2757062369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07580d2020 0x7f07580cec60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0750009870 tx=0x7f075002b910 comp rx=0 tx=0).stop 2024-03-16T17:48:02.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.071+0000 7f075dcc9640 1 -- 172.21.15.132:0/2757062369 shutdown_connections 2024-03-16T17:48:02.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.071+0000 7f075dcc9640 1 --2- 172.21.15.132:0/2757062369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07580d2020 0x7f07580cec60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.071+0000 7f075dcc9640 1 -- 172.21.15.132:0/2757062369 >> 172.21.15.132:0/2757062369 conn(0x7f0758073220 msgr2=0x7f075809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:02.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.071+0000 7f075dcc9640 1 -- 172.21.15.132:0/2757062369 shutdown_connections 2024-03-16T17:48:02.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.071+0000 7f075dcc9640 1 -- 172.21.15.132:0/2757062369 wait complete. 2024-03-16T17:48:02.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.072+0000 7f075dcc9640 1 Processor -- start 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.073+0000 7f075dcc9640 1 -- start start 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.073+0000 7f075dcc9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07580d1b90 0x7f0758149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.073+0000 7f075dcc9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07580d2020 0x7f0758147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.073+0000 7f075dcc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0758156410 0x7f0758154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.073+0000 7f075dcc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0758151ae0 con 0x7f0758156410 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.073+0000 7f075dcc9640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0758151dc0 con 0x7f07580d2020 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.073+0000 7f075dcc9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07581520a0 con 0x7f07580d1b90 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.073+0000 7f0757fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0758156410 0x7f0758154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.073+0000 7f0757fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0758156410 0x7f0758154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38908/0 (socket says 172.21.15.132:38908) 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.073+0000 7f0757fff640 1 -- 172.21.15.132:0/2900840965 learned_addr learned my addr 172.21.15.132:0/2900840965 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f0756ffd640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07580d2020 0x7f0758147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f07577fe640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07580d1b90 0x7f0758149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f0757fff640 1 -- 172.21.15.132:0/2900840965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07580d1b90 msgr2=0x7f0758149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f0757fff640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07580d1b90 0x7f0758149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f0757fff640 1 -- 172.21.15.132:0/2900840965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07580d2020 msgr2=0x7f0758147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f0757fff640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07580d2020 0x7f0758147e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f0757fff640 1 -- 172.21.15.132:0/2900840965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500094d0 con 0x7f0758156410 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f0756ffd640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07580d2020 0x7f0758147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f0757fff640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0758156410 0x7f0758154240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0750009870 tx=0x7f07500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f074ffff640 1 -- 172.21.15.132:0/2900840965 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750031800 con 0x7f0758156410 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f074ffff640 1 -- 172.21.15.132:0/2900840965 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07500443f0 con 0x7f0758156410 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f075dcc9640 1 -- 172.21.15.132:0/2900840965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0758152380 con 0x7f0758156410 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f074ffff640 1 -- 172.21.15.132:0/2900840965 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500447a0 con 0x7f0758156410 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.074+0000 7f075dcc9640 1 -- 172.21.15.132:0/2900840965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075814a110 con 0x7f0758156410 2024-03-16T17:48:02.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.075+0000 7f075dcc9640 1 -- 172.21.15.132:0/2900840965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0758074dc0 con 0x7f0758156410 2024-03-16T17:48:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.076+0000 7f074ffff640 1 -- 172.21.15.132:0/2900840965 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f075004d450 con 0x7f0758156410 2024-03-16T17:48:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.076+0000 7f074ffff640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f073806b3b0 0x7f073806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.076+0000 7f074ffff640 1 -- 172.21.15.132:0/2900840965 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f075002d040 con 0x7f0758156410 2024-03-16T17:48:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.076+0000 7f07577fe640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f073806b3b0 0x7f073806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.076+0000 7f07577fe640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f073806b3b0 0x7f073806d870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0748001e70 tx=0x7f0748009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:02.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.080+0000 7f074ffff640 1 -- 172.21.15.132:0/2900840965 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0750076fc0 con 0x7f0758156410 2024-03-16T17:48:02.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.445+0000 7f075dcc9640 1 -- 172.21.15.132:0/2900840965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07581528a0 con 0x7f0758156410 2024-03-16T17:48:02.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.445+0000 7f074ffff640 1 -- 172.21.15.132:0/2900840965 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4980 (secure 0 0 0) 0x7f07581528a0 con 0x7f0758156410 2024-03-16T17:48:02.449 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:02.449 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/481194427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":481194427},{"type":"v1","addr":"172.21.15.194:6834","nonce":481194427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1590172463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1590172463},{"type":"v1","addr":"172.21.15.194:6835","nonce":1590172463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2008777747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2008777747},{"type":"v1","addr":"172.21.15.132:6835","nonce":2008777747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T17:47:49.814572+0000","modified":"2024-03-16T17:47:51.863322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1367984600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1367984600},{"type":"v1","addr":"172.21.15.132:6837","nonce":1367984600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-16T17:48:02.450 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 -- 172.21.15.132:0/2900840965 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f073806b3b0 msgr2=0x7f073806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f073806b3b0 0x7f073806d870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0748001e70 tx=0x7f0748009040 comp rx=0 tx=0).stop 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 -- 172.21.15.132:0/2900840965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0758156410 msgr2=0x7f0758154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0758156410 0x7f0758154240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0750009870 tx=0x7f07500046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 -- 172.21.15.132:0/2900840965 shutdown_connections 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f073806b3b0 0x7f073806d870 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0758156410 0x7f0758154240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07580d2020 0x7f0758147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 --2- 172.21.15.132:0/2900840965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07580d1b90 0x7f0758149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 -- 172.21.15.132:0/2900840965 >> 172.21.15.132:0/2900840965 conn(0x7f0758073220 msgr2=0x7f075806f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 -- 172.21.15.132:0/2900840965 shutdown_connections 2024-03-16T17:48:02.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.448+0000 7f075dcc9640 1 -- 172.21.15.132:0/2900840965 wait complete. 2024-03-16T17:48:02.463 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:02.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.560+0000 7f3ebfa0e640 1 Processor -- start 2024-03-16T17:48:02.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.561+0000 7f3ebfa0e640 1 -- start start 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.561+0000 7f3ebfa0e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3eb815c9c0 0x7f3eb80d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.561+0000 7f3ebfa0e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3eb815cda0 0x7f3eb80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.561+0000 7f3ebfa0e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb80cd6e0 con 0x7f3eb80b66e0 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.561+0000 7f3ebfa0e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb80b6b70 con 0x7f3eb815cda0 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.561+0000 7f3ebfa0e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb81606b0 con 0x7f3eb815c9c0 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.561+0000 7f3ebcfa9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3eb815cda0 0x7f3eb80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.561+0000 7f3ebcfa9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3eb815cda0 0x7f3eb80b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38910/0 (socket says 172.21.15.132:38910) 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.562+0000 7f3ebcfa9640 1 -- 172.21.15.132:0/633844141 learned_addr learned my addr 172.21.15.132:0/633844141 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.562+0000 7f3ebd7aa640 1 --2- 172.21.15.132:0/633844141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3eb815c9c0 0x7f3eb80d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.562+0000 7f3ebcfa9640 1 -- 172.21.15.132:0/633844141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3eb815c9c0 msgr2=0x7f3eb80d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:02.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.562+0000 7f3ebcfa9640 1 --2- 172.21.15.132:0/633844141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3eb815c9c0 0x7f3eb80d0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.562+0000 7f3ebcfa9640 1 -- 172.21.15.132:0/633844141 >> v1:172.21.15.194:6789/0 conn(0x7f3eb80b66e0 legacy=0x7f3eb806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.562+0000 7f3ebcfa9640 1 -- 172.21.15.132:0/633844141 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb80d0a70 con 0x7f3eb815cda0 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.562+0000 7f3ebcfa9640 1 --2- 172.21.15.132:0/633844141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815cda0 0x7f3eb80b61a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009870 tx=0x7f3ea802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374fb87b4873423c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3eaffff640 1 -- 172.21.15.132:0/633844141 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8031640 con 0x7f3eb815cda0 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3eaffff640 1 -- 172.21.15.132:0/633844141 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea80317a0 con 0x7f3eb815cda0 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3eaffff640 1 -- 172.21.15.132:0/633844141 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8031b30 con 0x7f3eb815cda0 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/633844141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815cda0 msgr2=0x7f3eb80b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3ebfa0e640 1 --2- 172.21.15.132:0/633844141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815cda0 0x7f3eb80b61a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009870 tx=0x7f3ea802b8f0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/633844141 shutdown_connections 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3ebfa0e640 1 --2- 172.21.15.132:0/633844141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815cda0 0x7f3eb80b61a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3ebfa0e640 1 --2- 172.21.15.132:0/633844141 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3eb815c9c0 0x7f3eb80d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/633844141 >> 172.21.15.132:0/633844141 conn(0x7f3eb80b2b90 msgr2=0x7f3eb80b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:02.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/633844141 shutdown_connections 2024-03-16T17:48:02.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.563+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/633844141 wait complete. 2024-03-16T17:48:02.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.564+0000 7f3ebfa0e640 1 Processor -- start 2024-03-16T17:48:02.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.564+0000 7f3ebfa0e640 1 -- start start 2024-03-16T17:48:02.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebfa0e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb80b66e0 0x7f3eb814e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebfa0e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb815c9c0 0x7f3eb81f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebfa0e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3eb815cda0 0x7f3eb8150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebfa0e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb8151310 con 0x7f3eb80b66e0 2024-03-16T17:48:02.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebfa0e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb814e970 con 0x7f3eb815c9c0 2024-03-16T17:48:02.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebfa0e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb814ec50 con 0x7f3eb815cda0 2024-03-16T17:48:02.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebd7aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb80b66e0 0x7f3eb814e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebd7aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb80b66e0 0x7f3eb814e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38912/0 (socket says 172.21.15.132:38912) 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebd7aa640 1 -- 172.21.15.132:0/1869445573 learned_addr learned my addr 172.21.15.132:0/1869445573 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebd7aa640 1 -- 172.21.15.132:0/1869445573 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3eb815cda0 msgr2=0x7f3eb8150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebd7aa640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3eb815cda0 0x7f3eb8150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebd7aa640 1 -- 172.21.15.132:0/1869445573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb815c9c0 msgr2=0x7f3eb81f28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebd7aa640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb815c9c0 0x7f3eb81f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.565+0000 7f3ebd7aa640 1 -- 172.21.15.132:0/1869445573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80094d0 con 0x7f3eb80b66e0 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.566+0000 7f3ebd7aa640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb80b66e0 0x7f3eb814e390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400c7f0 tx=0x7f3eb400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.566+0000 7f3eadffb640 1 -- 172.21.15.132:0/1869445573 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4004220 con 0x7f3eb80b66e0 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.566+0000 7f3eadffb640 1 -- 172.21.15.132:0/1869445573 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb40043a0 con 0x7f3eb80b66e0 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.566+0000 7f3eadffb640 1 -- 172.21.15.132:0/1869445573 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4007860 con 0x7f3eb80b66e0 2024-03-16T17:48:02.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.566+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/1869445573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb814ef30 con 0x7f3eb80b66e0 2024-03-16T17:48:02.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.566+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/1869445573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb81f2de0 con 0x7f3eb80b66e0 2024-03-16T17:48:02.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.567+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/1869445573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb8151480 con 0x7f3eb80b66e0 2024-03-16T17:48:02.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.567+0000 7f3eadffb640 1 -- 172.21.15.132:0/1869445573 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f3eb4007bd0 con 0x7f3eb80b66e0 2024-03-16T17:48:02.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.568+0000 7f3eadffb640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3e9c06b3b0 0x7f3e9c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.568+0000 7f3eadffb640 1 -- 172.21.15.132:0/1869445573 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3eb4089b60 con 0x7f3eb80b66e0 2024-03-16T17:48:02.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.568+0000 7f3ebcfa9640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3e9c06b3b0 0x7f3e9c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.568+0000 7f3ebcfa9640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3e9c06b3b0 0x7f3e9c06d870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8036000 tx=0x7f3ea8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.576+0000 7f3eadffb640 1 -- 172.21.15.132:0/1869445573 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3eb4054850 con 0x7f3eb80b66e0 2024-03-16T17:48:02.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.760+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/1869445573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3eb804f2c0 con 0x7f3eb80b66e0 2024-03-16T17:48:02.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.761+0000 7f3eadffb640 1 -- 172.21.15.132:0/1869445573 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f3eb401e020 con 0x7f3eb80b66e0 2024-03-16T17:48:02.765 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:02.765 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.763+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/1869445573 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3e9c06b3b0 msgr2=0x7f3e9c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.763+0000 7f3ebfa0e640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3e9c06b3b0 0x7f3e9c06d870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8036000 tx=0x7f3ea8030000 comp rx=0 tx=0).stop 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.763+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/1869445573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb80b66e0 msgr2=0x7f3eb814e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.763+0000 7f3ebfa0e640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb80b66e0 0x7f3eb814e390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400c7f0 tx=0x7f3eb400ccb0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.763+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/1869445573 shutdown_connections 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.763+0000 7f3ebfa0e640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3e9c06b3b0 0x7f3e9c06d870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.763+0000 7f3ebfa0e640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3eb815cda0 0x7f3eb8150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.763+0000 7f3ebfa0e640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3eb815c9c0 0x7f3eb81f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.763+0000 7f3ebfa0e640 1 --2- 172.21.15.132:0/1869445573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb80b66e0 0x7f3eb814e390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.763+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/1869445573 >> 172.21.15.132:0/1869445573 conn(0x7f3eb80b2b90 msgr2=0x7f3eb8072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.764+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/1869445573 shutdown_connections 2024-03-16T17:48:02.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.764+0000 7f3ebfa0e640 1 -- 172.21.15.132:0/1869445573 wait complete. 2024-03-16T17:48:02.778 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:48:02.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.879+0000 7f3847415640 1 Processor -- start 2024-03-16T17:48:02.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.879+0000 7f3847415640 1 -- start start 2024-03-16T17:48:02.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f3847415640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f38401599b0 0x7f384006f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f3847415640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f38400cff10 0x7f38400b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f3847415640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38400cf370 con 0x7f38400b33c0 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f3847415640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384015d040 con 0x7f38400cff10 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f3847415640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38400ced20 con 0x7f38401599b0 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f38459b2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f38400cff10 0x7f38400b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f38459b2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f38400cff10 0x7f38400b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38914/0 (socket says 172.21.15.132:38914) 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f38459b2640 1 -- 172.21.15.132:0/1990957915 learned_addr learned my addr 172.21.15.132:0/1990957915 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f38451b1640 1 --2- 172.21.15.132:0/1990957915 >> v2:172.21.15.194:3300/0 conn(0x7f38401599b0 0x7f384006f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f38459b2640 1 -- 172.21.15.132:0/1990957915 >> v2:172.21.15.194:3300/0 conn(0x7f38401599b0 msgr2=0x7f384006f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f38459b2640 1 --2- 172.21.15.132:0/1990957915 >> v2:172.21.15.194:3300/0 conn(0x7f38401599b0 0x7f384006f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f38459b2640 1 -- 172.21.15.132:0/1990957915 >> v1:172.21.15.132:6789/0 conn(0x7f38400b33c0 legacy=0x7f38400cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.880+0000 7f38459b2640 1 -- 172.21.15.132:0/1990957915 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38400cf000 con 0x7f38400cff10 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.881+0000 7f38459b2640 1 --2- 172.21.15.132:0/1990957915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 0x7f38400b3840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f38400b5550 tx=0x7f383802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f9131304c39a40 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:02.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.881+0000 7f3837fff640 1 -- 172.21.15.132:0/1990957915 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383802cb10 con 0x7f38400cff10 2024-03-16T17:48:02.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.881+0000 7f3837fff640 1 -- 172.21.15.132:0/1990957915 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383802cc70 con 0x7f38400cff10 2024-03-16T17:48:02.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.881+0000 7f3837fff640 1 -- 172.21.15.132:0/1990957915 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38380343f0 con 0x7f38400cff10 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.882+0000 7f3847415640 1 -- 172.21.15.132:0/1990957915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 msgr2=0x7f38400b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.882+0000 7f3847415640 1 --2- 172.21.15.132:0/1990957915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 0x7f38400b3840 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f38400b5550 tx=0x7f383802bf70 comp rx=0 tx=0).stop 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.882+0000 7f3847415640 1 -- 172.21.15.132:0/1990957915 shutdown_connections 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.882+0000 7f3847415640 1 --2- 172.21.15.132:0/1990957915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 0x7f38400b3840 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.882+0000 7f3847415640 1 --2- 172.21.15.132:0/1990957915 >> v2:172.21.15.194:3300/0 conn(0x7f38401599b0 0x7f384006f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.882+0000 7f3847415640 1 -- 172.21.15.132:0/1990957915 >> 172.21.15.132:0/1990957915 conn(0x7f3840071470 msgr2=0x7f3840071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.882+0000 7f3847415640 1 -- 172.21.15.132:0/1990957915 shutdown_connections 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.882+0000 7f3847415640 1 -- 172.21.15.132:0/1990957915 wait complete. 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.883+0000 7f3847415640 1 Processor -- start 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.883+0000 7f3847415640 1 -- start start 2024-03-16T17:48:02.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.883+0000 7f3847415640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38400b33c0 0x7f38400b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.883+0000 7f3847415640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 0x7f3840142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.883+0000 7f3847415640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38401599b0 0x7f384014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f3847415640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384014d8a0 con 0x7f38400cff10 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f3847415640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384014cc90 con 0x7f38400b33c0 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f3847415640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384014cf70 con 0x7f38401599b0 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38449b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 0x7f3840142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38449b0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 0x7f3840142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38918/0 (socket says 172.21.15.132:38918) 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38449b0640 1 -- 172.21.15.132:0/2854254734 learned_addr learned my addr 172.21.15.132:0/2854254734 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38459b2640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38401599b0 0x7f384014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38451b1640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38400b33c0 0x7f38400b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38449b0640 1 -- 172.21.15.132:0/2854254734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38401599b0 msgr2=0x7f384014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38449b0640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38401599b0 0x7f384014dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38449b0640 1 -- 172.21.15.132:0/2854254734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38400b33c0 msgr2=0x7f38400b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38449b0640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38400b33c0 0x7f38400b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38449b0640 1 -- 172.21.15.132:0/2854254734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838009b30 con 0x7f38400cff10 2024-03-16T17:48:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38459b2640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38401599b0 0x7f384014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f38449b0640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 0x7f3840142ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f383000c400 tx=0x7f383000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f3835ffb640 1 -- 172.21.15.132:0/2854254734 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38300052d0 con 0x7f38400cff10 2024-03-16T17:48:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f3835ffb640 1 -- 172.21.15.132:0/2854254734 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3830005450 con 0x7f38400cff10 2024-03-16T17:48:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f3847415640 1 -- 172.21.15.132:0/2854254734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384014d250 con 0x7f38400cff10 2024-03-16T17:48:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f3835ffb640 1 -- 172.21.15.132:0/2854254734 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3830007260 con 0x7f38400cff10 2024-03-16T17:48:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.884+0000 7f3847415640 1 -- 172.21.15.132:0/2854254734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38400b1bd0 con 0x7f38400cff10 2024-03-16T17:48:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.885+0000 7f3847415640 1 -- 172.21.15.132:0/2854254734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38400cdce0 con 0x7f38400cff10 2024-03-16T17:48:02.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.886+0000 7f3835ffb640 1 -- 172.21.15.132:0/2854254734 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f38300073c0 con 0x7f38400cff10 2024-03-16T17:48:02.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.886+0000 7f3835ffb640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f382406b3b0 0x7f382406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:02.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.886+0000 7f38451b1640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f382406b3b0 0x7f382406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:02.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.886+0000 7f3835ffb640 1 -- 172.21.15.132:0/2854254734 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3830089040 con 0x7f38400cff10 2024-03-16T17:48:02.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.887+0000 7f38451b1640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f382406b3b0 0x7f382406d870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f383c006fd0 tx=0x7f383c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:02.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:02.891+0000 7f3835ffb640 1 -- 172.21.15.132:0/2854254734 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3830053ca0 con 0x7f38400cff10 2024-03-16T17:48:03.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.099+0000 7f3847415640 1 -- 172.21.15.132:0/2854254734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f384004f2c0 con 0x7f38400cff10 2024-03-16T17:48:03.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.100+0000 7f3835ffb640 1 -- 172.21.15.132:0/2854254734 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4980 (secure 0 0 0) 0x7f3830057360 con 0x7f38400cff10 2024-03-16T17:48:03.104 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:03.104 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/481194427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":481194427},{"type":"v1","addr":"172.21.15.194:6834","nonce":481194427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1590172463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1590172463},{"type":"v1","addr":"172.21.15.194:6835","nonce":1590172463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2008777747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2008777747},{"type":"v1","addr":"172.21.15.132:6835","nonce":2008777747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T17:47:49.814572+0000","modified":"2024-03-16T17:47:51.863322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1367984600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1367984600},{"type":"v1","addr":"172.21.15.132:6837","nonce":1367984600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-16T17:48:03.104 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 -- 172.21.15.132:0/2854254734 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f382406b3b0 msgr2=0x7f382406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f382406b3b0 0x7f382406d870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f383c006fd0 tx=0x7f383c008040 comp rx=0 tx=0).stop 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 -- 172.21.15.132:0/2854254734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 msgr2=0x7f3840142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 0x7f3840142ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f383000c400 tx=0x7f383000c8c0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 -- 172.21.15.132:0/2854254734 shutdown_connections 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f382406b3b0 0x7f382406d870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38401599b0 0x7f384014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38400cff10 0x7f3840142ab0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 --2- 172.21.15.132:0/2854254734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38400b33c0 0x7f38400b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 -- 172.21.15.132:0/2854254734 >> 172.21.15.132:0/2854254734 conn(0x7f3840071470 msgr2=0x7f384015d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 -- 172.21.15.132:0/2854254734 shutdown_connections 2024-03-16T17:48:03.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.102+0000 7f3847415640 1 -- 172.21.15.132:0/2854254734 wait complete. 2024-03-16T17:48:03.519 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T17:47:49.814572+0000', 'modified': '2024-03-16T17:47:51.863322+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6837/1367984600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6836', 'nonce': 1367984600}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 1367984600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-03-16T17:48:03.519 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T17:48:03.519 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-16T17:48:03.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.618+0000 7fd83b435640 1 Processor -- start 2024-03-16T17:48:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.618+0000 7fd83b435640 1 -- start start 2024-03-16T17:48:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd83b435640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4b00 0x7fd8340b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd83b435640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83406ed70 con 0x7fd8340b3bc0 2024-03-16T17:48:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd83b435640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8341448c0 con 0x7fd8341444e0 2024-03-16T17:48:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd83b435640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340b54d0 con 0x7fd8340b4b00 2024-03-16T17:48:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd8389d0640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd8340b3bc0 0x7fd83406f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45908/0 (socket says 172.21.15.132:45908) 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd8389d0640 1 -- 172.21.15.132:0/2090085190 learned_addr learned my addr 172.21.15.132:0/2090085190 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd8399d2640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4b00 0x7fd8340b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874266603 0 0) 0x7fd83406ed70 con 0x7fd8340b3bc0 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd820003520 con 0x7fd8340b3bc0 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394819886 0 0) 0x7fd8341448c0 con 0x7fd8341444e0 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd83406ed70 con 0x7fd8341444e0 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3175197217 0 0) 0x7fd820003520 con 0x7fd8340b3bc0 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4b00 msgr2=0x7fd8340b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd82bfff640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4b00 0x7fd8340b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 >> v1:172.21.15.194:6789/0 conn(0x7fd8341444e0 legacy=0x7fd83415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83415f690 con 0x7fd8340b3bc0 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7fd824001670 con 0x7fd8340b3bc0 2024-03-16T17:48:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.619+0000 7fd8399d2640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4b00 0x7fd8340b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 >> v1:172.21.15.132:6789/0 conn(0x7fd8340b3bc0 legacy=0x7fd83406f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd82bfff640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd820003b30 0x7fd820003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd82bfff640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 0x7fd820004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd82bfff640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4b00 0x7fd820005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340b54d0 con 0x7fd8200047c0 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82000ba30 con 0x7fd820003b30 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82000bbc0 con 0x7fd8340b4b00 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd8389d0640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 0x7fd820004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd8391d1640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd820003b30 0x7fd820003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd8399d2640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4b00 0x7fd820005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd8389d0640 1 -- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4b00 msgr2=0x7fd820005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd8389d0640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4b00 0x7fd820005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd8389d0640 1 -- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd820003b30 msgr2=0x7fd820003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd8389d0640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd820003b30 0x7fd820003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.620+0000 7fd8389d0640 1 -- 172.21.15.132:0/2090085190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009a70 con 0x7fd8200047c0 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.621+0000 7fd8389d0640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 0x7fd820004c40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8340b4000 tx=0x7fd8200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee52270aedd2f9a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.621+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824005ad0 con 0x7fd8200047c0 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.621+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824037070 con 0x7fd8200047c0 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.621+0000 7fd82bfff640 1 -- 172.21.15.132:0/2090085190 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824007070 con 0x7fd8200047c0 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.621+0000 7fd83b435640 1 -- 172.21.15.132:0/2090085190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 msgr2=0x7fd820004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.621+0000 7fd83b435640 1 --2- 172.21.15.132:0/2090085190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 0x7fd820004c40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8340b4000 tx=0x7fd8200057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.621+0000 7fd8399d2640 1 -- 172.21.15.132:0/2090085190 reap_dead start 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.621+0000 7fd83b435640 1 -- 172.21.15.132:0/2090085190 shutdown_connections 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.621+0000 7fd83b435640 1 -- 172.21.15.132:0/2090085190 >> 172.21.15.132:0/2090085190 conn(0x7fd83406bff0 msgr2=0x7fd83406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.622+0000 7fd83b435640 1 -- 172.21.15.132:0/2090085190 shutdown_connections 2024-03-16T17:48:03.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.622+0000 7fd83b435640 1 -- 172.21.15.132:0/2090085190 wait complete. 2024-03-16T17:48:03.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.623+0000 7fd83b435640 1 Processor -- start 2024-03-16T17:48:03.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.623+0000 7fd83b435640 1 -- start start 2024-03-16T17:48:03.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.623+0000 7fd83b435640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 0x7fd834149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.623+0000 7fd83b435640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415d7f0 0x7fd83414ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.623+0000 7fd83b435640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83414b0a0 0x7fd834140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.623+0000 7fd83b435640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83414a740 con 0x7fd8200047c0 2024-03-16T17:48:03.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.623+0000 7fd83b435640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340a9800 con 0x7fd83415d7f0 2024-03-16T17:48:03.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.623+0000 7fd83b435640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd834149ac0 con 0x7fd83414b0a0 2024-03-16T17:48:03.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.623+0000 7fd8391d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 0x7fd834149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8391d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 0x7fd834149490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38936/0 (socket says 172.21.15.132:38936) 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8391d1640 1 -- 172.21.15.132:0/200486274 learned_addr learned my addr 172.21.15.132:0/200486274 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8389d0640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415d7f0 0x7fd83414ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8399d2640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83414b0a0 0x7fd834140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8391d1640 1 -- 172.21.15.132:0/200486274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83414b0a0 msgr2=0x7fd834140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8391d1640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83414b0a0 0x7fd834140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8391d1640 1 -- 172.21.15.132:0/200486274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415d7f0 msgr2=0x7fd83414ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8391d1640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415d7f0 0x7fd83414ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8391d1640 1 -- 172.21.15.132:0/200486274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd834149da0 con 0x7fd8200047c0 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8389d0640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415d7f0 0x7fd83414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd8391d1640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 0x7fd834149490 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd83000f900 tx=0x7fd83000fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd829ffb640 1 -- 172.21.15.132:0/200486274 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8300014a0 con 0x7fd8200047c0 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd829ffb640 1 -- 172.21.15.132:0/200486274 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830005320 con 0x7fd8200047c0 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd83b435640 1 -- 172.21.15.132:0/200486274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83414a080 con 0x7fd8200047c0 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd829ffb640 1 -- 172.21.15.132:0/200486274 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000ea40 con 0x7fd8200047c0 2024-03-16T17:48:03.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.624+0000 7fd83b435640 1 -- 172.21.15.132:0/200486274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83415dc70 con 0x7fd8200047c0 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.626+0000 7fd829ffb640 1 -- 172.21.15.132:0/200486274 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fd83000eba0 con 0x7fd8200047c0 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.626+0000 7fd829ffb640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd81806b3b0 0x7fd81806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.626+0000 7fd829ffb640 1 -- 172.21.15.132:0/200486274 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd830089d10 con 0x7fd8200047c0 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.627+0000 7fd8389d0640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd81806b3b0 0x7fd81806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.627+0000 7fd8389d0640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd81806b3b0 0x7fd81806d870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd8200057a0 tx=0x7fd824037000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.627+0000 7fd83e00e740 1 Processor -- start 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.627+0000 7fd83e00e740 1 -- start start 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe21fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 0x55e55fe51dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe22510 0x55e55fe52300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd83e00e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55fde2cd0 con 0x55e55fe4f030 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd83e00e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55fd95f20 con 0x55e55fe22510 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd83e00e740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e55fd93450 con 0x55e55fe4f410 2024-03-16T17:48:03.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8391d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe21fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8391d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe21fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38944/0 (socket says 172.21.15.132:38944) 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8391d1640 1 -- 172.21.15.132:0/1675216063 learned_addr learned my addr 172.21.15.132:0/1675216063 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8399d2640 1 --2- 172.21.15.132:0/1675216063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe22510 0x55e55fe52300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8389d0640 1 --2- 172.21.15.132:0/1675216063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 0x55e55fe51dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8391d1640 1 -- 172.21.15.132:0/1675216063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 msgr2=0x55e55fe51dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8391d1640 1 --2- 172.21.15.132:0/1675216063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 0x55e55fe51dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8391d1640 1 -- 172.21.15.132:0/1675216063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe22510 msgr2=0x55e55fe52300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8391d1640 1 --2- 172.21.15.132:0/1675216063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe22510 0x55e55fe52300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8391d1640 1 -- 172.21.15.132:0/1675216063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e55fd43f20 con 0x55e55fe4f030 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8399d2640 1 --2- 172.21.15.132:0/1675216063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe22510 0x55e55fe52300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd8391d1640 1 --2- 172.21.15.132:0/1675216063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe21fd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd8300882f0 tx=0x7fd830058f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d438f3027cda59a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd81effd640 1 -- 172.21.15.132:0/1675216063 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830060e70 con 0x55e55fe4f030 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd81effd640 1 -- 172.21.15.132:0/1675216063 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830056a60 con 0x55e55fe4f030 2024-03-16T17:48:03.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.628+0000 7fd81effd640 1 -- 172.21.15.132:0/1675216063 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830070180 con 0x55e55fe4f030 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.629+0000 7fd83e00e740 1 -- 172.21.15.132:0/1675216063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 msgr2=0x55e55fe21fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.629+0000 7fd83e00e740 1 --2- 172.21.15.132:0/1675216063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe21fd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd8300882f0 tx=0x7fd830058f20 comp rx=0 tx=0).stop 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.629+0000 7fd83e00e740 1 -- 172.21.15.132:0/1675216063 shutdown_connections 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.629+0000 7fd83e00e740 1 --2- 172.21.15.132:0/1675216063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe22510 0x55e55fe52300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.629+0000 7fd83e00e740 1 --2- 172.21.15.132:0/1675216063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 0x55e55fe51dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.629+0000 7fd83e00e740 1 --2- 172.21.15.132:0/1675216063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe21fd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.629+0000 7fd83e00e740 1 -- 172.21.15.132:0/1675216063 >> 172.21.15.132:0/1675216063 conn(0x55e55fe24240 msgr2=0x55e55fe6cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.629+0000 7fd83e00e740 1 -- 172.21.15.132:0/1675216063 shutdown_connections 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.629+0000 7fd83e00e740 1 -- 172.21.15.132:0/1675216063 wait complete. 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.630+0000 7fd83e00e740 1 -- start start 2024-03-16T17:48:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.630+0000 7fd83e00e740 1 Processor -- start 2024-03-16T17:48:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.631+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe52db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.631+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe4f410 0x55e55fe3aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.631+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 0x55e55fe6d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.631+0000 7fd83e00e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55fd8ec30 con 0x55e55fe4f030 2024-03-16T17:48:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.631+0000 7fd83e00e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55fd33d30 con 0x55e55fe4f410 2024-03-16T17:48:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.631+0000 7fd83e00e740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e55fa62310 con 0x55e55fe392a0 2024-03-16T17:48:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.631+0000 7fd8391d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe52db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.631+0000 7fd83e00e740 10 client.0 _ll_register_callbacks cb 0x55e55fd3bd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T17:48:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd8391d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe52db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38954/0 (socket says 172.21.15.132:38954) 2024-03-16T17:48:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd8391d1640 1 -- 172.21.15.132:0/1064675471 learned_addr learned my addr 172.21.15.132:0/1064675471 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd8389d0640 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe4f410 0x55e55fe3aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd8399d2640 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 0x55e55fe6d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd8391d1640 1 -- 172.21.15.132:0/1064675471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 msgr2=0x55e55fe6d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd8391d1640 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 0x55e55fe6d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd8391d1640 1 -- 172.21.15.132:0/1064675471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe4f410 msgr2=0x55e55fe3aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd8391d1640 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe4f410 0x55e55fe3aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd8391d1640 1 -- 172.21.15.132:0/1064675471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83415dc70 con 0x55e55fe4f030 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd8391d1640 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe52db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd830060940 tx=0x7fd8300012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a02e342df4ff25 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd813fff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd813fff640 1 -- 172.21.15.132:0/1064675471 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830060e70 con 0x55e55fe4f030 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd813fff640 1 -- 172.21.15.132:0/1064675471 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd830071ba0 con 0x55e55fe4f030 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd83e00e740 1 -- 172.21.15.132:0/1064675471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e55fa8e6c0 con 0x55e55fe4f030 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd813fff640 1 -- 172.21.15.132:0/1064675471 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd830077300 con 0x55e55fe4f030 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd83e00e740 10 client.4650 fetch_fsmap learned FSMap version 6 2024-03-16T17:48:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd83e00e740 1 -- 172.21.15.132:0/1064675471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55e55fd8d2b0 con 0x55e55fe4f030 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd813fff640 1 -- 172.21.15.132:0/1064675471 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e55fa8e6c0 con 0x55e55fe4f030 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd813fff640 1 -- 172.21.15.132:0/1064675471 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 6) v1 ==== 3314+0+0 (secure 0 0 0) 0x7fd830077020 con 0x55e55fe4f030 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd83e00e740 10 client.4650 fetch_fsmap finished waiting for FSMap version 6 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd83e00e740 10 client.4650 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd83e00e740 20 client.4650 populate_metadata read hostname 'smithi132' 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd83e00e740 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.132:6836/1367984600,v1:172.21.15.132:6837/1367984600] conn(0x55e55fe3c070 0x55e55fe4f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd83e00e740 4 client.4650 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.632+0000 7fd83e00e740 1 -- 172.21.15.132:0/1064675471 --> [v2:172.21.15.132:6836/1367984600,v1:172.21.15.132:6837/1367984600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e55fadf270 con 0x55e55fe3c070 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.633+0000 7fd8389d0640 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.132:6836/1367984600,v1:172.21.15.132:6837/1367984600] conn(0x55e55fe3c070 0x55e55fe4f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.633+0000 7fd8389d0640 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.132:6836/1367984600,v1:172.21.15.132:6837/1367984600] conn(0x55e55fe3c070 0x55e55fe4f8b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b487d0c9af23acf server_cookie=6b4dc3a8cf9b7e84 in_seq=0 out_seq=0 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.633+0000 7fd813fff640 10 client.4650 ms_handle_connect on v2:172.21.15.132:6836/1367984600 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.633+0000 7fd813fff640 1 -- 172.21.15.132:0/1064675471 <== mds.0 v2:172.21.15.132:6836/1367984600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55e55fadf270 con 0x55e55fe3c070 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd813fff640 10 client.4650 handle_command_reply: tid=0 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 client.4650 shutdown 2024-03-16T17:48:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 -- 172.21.15.132:0/1064675471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 msgr2=0x55e55fe52db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe52db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd830060940 tx=0x7fd8300012d0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 -- 172.21.15.132:0/1064675471 shutdown_connections 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.132:6836/1367984600,v1:172.21.15.132:6837/1367984600] conn(0x55e55fe3c070 0x55e55fe4f8b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 0x55e55fe6d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe4f410 0x55e55fe3aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd813fff640 0 client.4650 ms_handle_reset on v2:172.21.15.132:6836/1367984600 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 --2- 172.21.15.132:0/1064675471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe52db0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 -- 172.21.15.132:0/1064675471 >> 172.21.15.132:0/1064675471 conn(0x55e55fe22510 msgr2=0x55e55fe702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 -- 172.21.15.132:0/1064675471 shutdown_connections 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 1 -- 172.21.15.132:0/1064675471 wait complete. 2024-03-16T17:48:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.634+0000 7fd83e00e740 20 client.4650 trim_cache size 0 max 16384 2024-03-16T17:48:03.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.651+0000 7fd83e00e740 1 Processor -- start 2024-03-16T17:48:03.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.651+0000 7fd83e00e740 1 -- start start 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.651+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 0x55e55fe25d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.651+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.651+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe4f410 0x55e55fe8f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.651+0000 7fd83e00e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55fd14490 con 0x55e55fe4f030 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.651+0000 7fd83e00e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55fe90480 con 0x55e55fe4f410 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.651+0000 7fd83e00e740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e55fe6f7d0 con 0x55e55fe392a0 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8389d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8389d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38970/0 (socket says 172.21.15.132:38970) 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8389d0640 1 -- 172.21.15.132:0/3789174397 learned_addr learned my addr 172.21.15.132:0/3789174397 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8399d2640 1 --2- 172.21.15.132:0/3789174397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe4f410 0x55e55fe8f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8391d1640 1 --2- 172.21.15.132:0/3789174397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 0x55e55fe25d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8389d0640 1 -- 172.21.15.132:0/3789174397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 msgr2=0x55e55fe25d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8389d0640 1 --2- 172.21.15.132:0/3789174397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 0x55e55fe25d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8389d0640 1 -- 172.21.15.132:0/3789174397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe4f410 msgr2=0x55e55fe8f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8389d0640 1 --2- 172.21.15.132:0/3789174397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe4f410 0x55e55fe8f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8389d0640 1 -- 172.21.15.132:0/3789174397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e55fd29a20 con 0x55e55fe4f030 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8391d1640 1 --2- 172.21.15.132:0/3789174397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 0x55e55fe25d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd8389d0640 1 --2- 172.21.15.132:0/3789174397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd824004a70 tx=0x7fd824009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcea5e4089fe15b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd81e7fc640 1 -- 172.21.15.132:0/3789174397 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824007540 con 0x55e55fe4f030 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd81e7fc640 1 -- 172.21.15.132:0/3789174397 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8240076a0 con 0x55e55fe4f030 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.652+0000 7fd81e7fc640 1 -- 172.21.15.132:0/3789174397 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824059ac0 con 0x55e55fe4f030 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 -- 172.21.15.132:0/3789174397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 msgr2=0x55e55fe8f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 --2- 172.21.15.132:0/3789174397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd824004a70 tx=0x7fd824009030 comp rx=0 tx=0).stop 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 -- 172.21.15.132:0/3789174397 shutdown_connections 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 --2- 172.21.15.132:0/3789174397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe4f410 0x55e55fe8f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 --2- 172.21.15.132:0/3789174397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 --2- 172.21.15.132:0/3789174397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe392a0 0x55e55fe25d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 -- 172.21.15.132:0/3789174397 >> 172.21.15.132:0/3789174397 conn(0x55e55fe22510 msgr2=0x55e55fe3aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:03.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 -- 172.21.15.132:0/3789174397 shutdown_connections 2024-03-16T17:48:03.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 -- 172.21.15.132:0/3789174397 wait complete. 2024-03-16T17:48:03.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 -- start start 2024-03-16T17:48:03.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.653+0000 7fd83e00e740 1 Processor -- start 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe392a0 0x55e55fed54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd83e00e740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 0x55e55fe8f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd83e00e740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55fe3a8d0 con 0x55e55fe4f030 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd83e00e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e55fe23470 con 0x55e55fe392a0 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd83e00e740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e55fe86c80 con 0x55e55fe4f410 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd83e00e740 10 client.0 _ll_register_callbacks cb 0x7fd8300580c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8389d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8389d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38980/0 (socket says 172.21.15.132:38980) 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8389d0640 1 -- 172.21.15.132:0/3263920104 learned_addr learned my addr 172.21.15.132:0/3263920104 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8391d1640 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe392a0 0x55e55fed54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8399d2640 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 0x55e55fe8f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8389d0640 1 -- 172.21.15.132:0/3263920104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 msgr2=0x55e55fe8f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8389d0640 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 0x55e55fe8f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8389d0640 1 -- 172.21.15.132:0/3263920104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe392a0 msgr2=0x55e55fed54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8389d0640 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe392a0 0x55e55fed54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8389d0640 1 -- 172.21.15.132:0/3263920104 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c009a70 con 0x55e55fe4f030 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8399d2640 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 0x55e55fe8f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.654+0000 7fd8391d1640 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe392a0 0x55e55fed54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd8389d0640 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd824004a70 tx=0x7fd824036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8066129259046373 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd813fff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd813fff640 1 -- 172.21.15.132:0/3263920104 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8240591d0 con 0x55e55fe4f030 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd813fff640 1 -- 172.21.15.132:0/3263920104 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd824063b10 con 0x55e55fe4f030 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd83e00e740 1 -- 172.21.15.132:0/3263920104 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd830056a60 con 0x55e55fe4f030 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd813fff640 1 -- 172.21.15.132:0/3263920104 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd824059330 con 0x55e55fe4f030 2024-03-16T17:48:03.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd83e00e740 10 client.4656 fetch_fsmap learned FSMap version 6 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd83e00e740 1 -- 172.21.15.132:0/3263920104 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55e55fd4f780 con 0x55e55fe4f030 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd813fff640 1 -- 172.21.15.132:0/3263920104 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830056a60 con 0x55e55fe4f030 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd813fff640 1 -- 172.21.15.132:0/3263920104 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 6) v1 ==== 3314+0+0 (secure 0 0 0) 0x7fd824063cd0 con 0x55e55fe4f030 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd83e00e740 10 client.4656 fetch_fsmap finished waiting for FSMap version 6 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd83e00e740 10 client.4656 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd83e00e740 20 client.4656 populate_metadata read hostname 'smithi132' 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd83e00e740 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.132:6836/1367984600,v1:172.21.15.132:6837/1367984600] conn(0x55e55feded10 0x55e55fedf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd83e00e740 4 client.4656 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd83e00e740 1 -- 172.21.15.132:0/3263920104 --> [v2:172.21.15.132:6836/1367984600,v1:172.21.15.132:6837/1367984600] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e55facb610 con 0x55e55feded10 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.655+0000 7fd8391d1640 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.132:6836/1367984600,v1:172.21.15.132:6837/1367984600] conn(0x55e55feded10 0x55e55fedf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd813fff640 10 client.4656 ms_handle_connect on v2:172.21.15.132:6836/1367984600 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd8391d1640 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.132:6836/1367984600,v1:172.21.15.132:6837/1367984600] conn(0x55e55feded10 0x55e55fedf0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7db3f777eda9b9df server_cookie=c4b30cc17b4c0eb0 in_seq=0 out_seq=0 2024-03-16T17:48:03.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd813fff640 1 -- 172.21.15.132:0/3263920104 <== mds.0 v2:172.21.15.132:6836/1367984600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e55facb610 con 0x55e55feded10 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd813fff640 10 client.4656 handle_command_reply: tid=0 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 client.4656 shutdown 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 -- 172.21.15.132:0/3263920104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 msgr2=0x55e55fe8f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd824004a70 tx=0x7fd824036000 comp rx=0 tx=0).stop 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 -- 172.21.15.132:0/3263920104 shutdown_connections 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.132:6836/1367984600,v1:172.21.15.132:6837/1367984600] conn(0x55e55feded10 0x55e55fedf0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55e55fe4f410 0x55e55fe8f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55e55fe4f030 0x55e55fe8f130 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd813fff640 0 client.4656 ms_handle_reset on v2:172.21.15.132:6836/1367984600 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 --2- 172.21.15.132:0/3263920104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e55fe392a0 0x55e55fed54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 -- 172.21.15.132:0/3263920104 >> 172.21.15.132:0/3263920104 conn(0x55e55fe22510 msgr2=0x55e55fe51a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 -- 172.21.15.132:0/3263920104 shutdown_connections 2024-03-16T17:48:03.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 1 -- 172.21.15.132:0/3263920104 wait complete. 2024-03-16T17:48:03.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.656+0000 7fd83e00e740 20 client.4656 trim_cache size 0 max 16384 2024-03-16T17:48:03.667 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-03-16T17:48:03.667 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e", 2024-03-16T17:48:03.667 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2024-03-16T17:48:03.667 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4278, 2024-03-16T17:48:03.667 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2024-03-16T17:48:03.667 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2024-03-16T17:48:03.667 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2024-03-16T17:48:03.667 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 13.169017617, 2024-03-16T17:48:03.668 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 6, 2024-03-16T17:48:03.668 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 20, 2024-03-16T17:48:03.668 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 20, 2024-03-16T17:48:03.668 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 20.254044284999999 2024-03-16T17:48:03.668 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-03-16T17:48:03.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 -- 172.21.15.132:0/200486274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd81806b3b0 msgr2=0x7fd81806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd81806b3b0 0x7fd81806d870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd8200057a0 tx=0x7fd824037000 comp rx=0 tx=0).stop 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 -- 172.21.15.132:0/200486274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 msgr2=0x7fd834149490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 0x7fd834149490 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd83000f900 tx=0x7fd83000fdc0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 -- 172.21.15.132:0/200486274 shutdown_connections 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd81806b3b0 0x7fd81806d870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd83414b0a0 0x7fd834140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415d7f0 0x7fd83414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 --2- 172.21.15.132:0/200486274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8200047c0 0x7fd834149490 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 -- 172.21.15.132:0/200486274 >> 172.21.15.132:0/200486274 conn(0x7fd83406bff0 msgr2=0x7fd8340cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 -- 172.21.15.132:0/200486274 shutdown_connections 2024-03-16T17:48:03.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:03.657+0000 7fd83b435640 1 -- 172.21.15.132:0/200486274 wait complete. 2024-03-16T17:48:03.671 INFO:teuthology.run_tasks:Running task kclient... 2024-03-16T17:48:03.704 INFO:tasks.kclient:Mounting kernel clients... 2024-03-16T17:48:03.705 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-16T17:48:03.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:03.705 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-03-16T17:48:03.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:03.720 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2024-03-16T17:48:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:Cannot find device "ceph-brx" 2024-03-16T17:48:03.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T17:48:03.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:03.791 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-03-16T17:48:03.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:03.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2024-03-16T17:48:03.915 INFO:teuthology.orchestra.run.smithi132.stderr:Cannot find device "ceph-brx" 2024-03-16T17:48:03.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T17:48:03.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:03.916 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-03-16T17:48:03.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:03.935 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-03-16T17:48:04.008 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-03-16T17:48:04.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T17:48:04.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:04.010 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-03-16T17:48:04.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:04.067 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-03-16T17:48:04.138 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-03-16T17:48:04.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T17:48:04.140 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-03-16T17:48:04.140 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-16T17:48:04.140 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T17:48:04.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T17:48:04.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.239+0000 7fc30a7ac640 1 Processor -- start 2024-03-16T17:48:04.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.239+0000 7fc30a7ac640 1 -- start start 2024-03-16T17:48:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.240+0000 7fc30a7ac640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3040b3560 0x7fc3040cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.240+0000 7fc30a7ac640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc3040d1980 0x7fc3040d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.240+0000 7fc30a7ac640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040d0680 con 0x7fc304161540 2024-03-16T17:48:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.240+0000 7fc30a7ac640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3040b4f30 con 0x7fc3040b3560 2024-03-16T17:48:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.240+0000 7fc30a7ac640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3040d08d0 con 0x7fc3040d1980 2024-03-16T17:48:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.240+0000 7fc3037fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3040b3560 0x7fc3040cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.240+0000 7fc3037fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3040b3560 0x7fc3040cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38984/0 (socket says 172.21.15.132:38984) 2024-03-16T17:48:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.240+0000 7fc3037fe640 1 -- 172.21.15.132:0/3632181779 learned_addr learned my addr 172.21.15.132:0/3632181779 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.240+0000 7fc303fff640 1 --1- 172.21.15.132:0/3632181779 >> v1:172.21.15.132:6789/0 conn(0x7fc304161540 0x7fc3040cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45924/0 (socket says 172.21.15.132:45924) 2024-03-16T17:48:04.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.240+0000 7fc308d49640 1 --2- 172.21.15.132:0/3632181779 >> v2:172.21.15.194:3300/0 conn(0x7fc3040d1980 0x7fc3040d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.241+0000 7fc3037fe640 1 -- 172.21.15.132:0/3632181779 >> v2:172.21.15.194:3300/0 conn(0x7fc3040d1980 msgr2=0x7fc3040d1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.241+0000 7fc3037fe640 1 --2- 172.21.15.132:0/3632181779 >> v2:172.21.15.194:3300/0 conn(0x7fc3040d1980 0x7fc3040d1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.241+0000 7fc3037fe640 1 -- 172.21.15.132:0/3632181779 >> v1:172.21.15.132:6789/0 conn(0x7fc304161540 legacy=0x7fc3040cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.241+0000 7fc3037fe640 1 -- 172.21.15.132:0/3632181779 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3040d0bb0 con 0x7fc3040b3560 2024-03-16T17:48:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.241+0000 7fc302ffd640 1 -- 172.21.15.132:0/3632181779 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853209686 0 0) 0x7fc3040d0680 con 0x7fc304161540 2024-03-16T17:48:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.241+0000 7fc3037fe640 1 --2- 172.21.15.132:0/3632181779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 0x7fc3040cf790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc3040d37a0 tx=0x7fc2f402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f519164eafb6a08 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.241+0000 7fc302ffd640 1 -- 172.21.15.132:0/3632181779 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4030860 con 0x7fc3040b3560 2024-03-16T17:48:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.241+0000 7fc302ffd640 1 -- 172.21.15.132:0/3632181779 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f40309c0 con 0x7fc3040b3560 2024-03-16T17:48:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.241+0000 7fc302ffd640 1 -- 172.21.15.132:0/3632181779 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4030d50 con 0x7fc3040b3560 2024-03-16T17:48:04.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.242+0000 7fc30a7ac640 1 -- 172.21.15.132:0/3632181779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 msgr2=0x7fc3040cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.242+0000 7fc30a7ac640 1 --2- 172.21.15.132:0/3632181779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 0x7fc3040cf790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc3040d37a0 tx=0x7fc2f402b9a0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.242+0000 7fc30a7ac640 1 -- 172.21.15.132:0/3632181779 shutdown_connections 2024-03-16T17:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.242+0000 7fc30a7ac640 1 --2- 172.21.15.132:0/3632181779 >> v2:172.21.15.194:3300/0 conn(0x7fc3040d1980 0x7fc3040d1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.242+0000 7fc30a7ac640 1 --2- 172.21.15.132:0/3632181779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 0x7fc3040cf790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.242+0000 7fc30a7ac640 1 -- 172.21.15.132:0/3632181779 >> 172.21.15.132:0/3632181779 conn(0x7fc30409d120 msgr2=0x7fc3040d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.242+0000 7fc30a7ac640 1 -- 172.21.15.132:0/3632181779 shutdown_connections 2024-03-16T17:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.242+0000 7fc30a7ac640 1 -- 172.21.15.132:0/3632181779 wait complete. 2024-03-16T17:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.243+0000 7fc30a7ac640 1 Processor -- start 2024-03-16T17:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.243+0000 7fc30a7ac640 1 -- start start 2024-03-16T17:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc30a7ac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 0x7fc3040c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc30a7ac640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3040d1980 0x7fc3040cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc30a7ac640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc304161540 0x7fc30415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc30a7ac640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040cdc80 con 0x7fc3040b3560 2024-03-16T17:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc30a7ac640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040cd6c0 con 0x7fc3040d1980 2024-03-16T17:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc30a7ac640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040cd9a0 con 0x7fc304161540 2024-03-16T17:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc303fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 0x7fc3040c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc303fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 0x7fc3040c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38988/0 (socket says 172.21.15.132:38988) 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc303fff640 1 -- 172.21.15.132:0/97880606 learned_addr learned my addr 172.21.15.132:0/97880606 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc303fff640 1 -- 172.21.15.132:0/97880606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc304161540 msgr2=0x7fc30415cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc303fff640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc304161540 0x7fc30415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc303fff640 1 -- 172.21.15.132:0/97880606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3040d1980 msgr2=0x7fc3040cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc3037fe640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3040d1980 0x7fc3040cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.244+0000 7fc303fff640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3040d1980 0x7fc3040cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.245+0000 7fc303fff640 1 -- 172.21.15.132:0/97880606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40094d0 con 0x7fc3040b3560 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.245+0000 7fc3037fe640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3040d1980 0x7fc3040cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.245+0000 7fc303fff640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 0x7fc3040c9a10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c430 tx=0x7fc2f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.245+0000 7fc300ff9640 1 -- 172.21.15.132:0/97880606 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80074e0 con 0x7fc3040b3560 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.245+0000 7fc300ff9640 1 -- 172.21.15.132:0/97880606 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f8007660 con 0x7fc3040b3560 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.245+0000 7fc30a7ac640 1 -- 172.21.15.132:0/97880606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3040c7810 con 0x7fc3040b3560 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.245+0000 7fc300ff9640 1 -- 172.21.15.132:0/97880606 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8004a20 con 0x7fc3040b3560 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.245+0000 7fc30a7ac640 1 -- 172.21.15.132:0/97880606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3040c9f50 con 0x7fc3040b3560 2024-03-16T17:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.246+0000 7fc30a7ac640 1 -- 172.21.15.132:0/97880606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3040c7d30 con 0x7fc3040b3560 2024-03-16T17:48:04.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.246+0000 7fc300ff9640 1 -- 172.21.15.132:0/97880606 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fc2f8004b80 con 0x7fc3040b3560 2024-03-16T17:48:04.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.247+0000 7fc300ff9640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc2f006b3b0 0x7fc2f006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:04.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.247+0000 7fc3037fe640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc2f006b3b0 0x7fc2f006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:04.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.247+0000 7fc300ff9640 1 -- 172.21.15.132:0/97880606 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2f8089a10 con 0x7fc3040b3560 2024-03-16T17:48:04.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.247+0000 7fc3037fe640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc2f006b3b0 0x7fc2f006d870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4036000 tx=0x7fc2f403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:04.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.251+0000 7fc300ff9640 1 -- 172.21.15.132:0/97880606 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc3040c7d30 con 0x7fc3040b3560 2024-03-16T17:48:04.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.462+0000 7fc30a7ac640 1 -- 172.21.15.132:0/97880606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc3040c7d30 con 0x7fc3040b3560 2024-03-16T17:48:04.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.462+0000 7fc300ff9640 1 -- 172.21.15.132:0/97880606 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc3040c7d30 con 0x7fc3040b3560 2024-03-16T17:48:04.465 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T17:48:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 -- 172.21.15.132:0/97880606 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc2f006b3b0 msgr2=0x7fc2f006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc2f006b3b0 0x7fc2f006d870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4036000 tx=0x7fc2f403b040 comp rx=0 tx=0).stop 2024-03-16T17:48:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 -- 172.21.15.132:0/97880606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 msgr2=0x7fc3040c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 0x7fc3040c9a10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c430 tx=0x7fc2f800c8f0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 -- 172.21.15.132:0/97880606 shutdown_connections 2024-03-16T17:48:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc2f006b3b0 0x7fc2f006d870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc304161540 0x7fc30415cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3040d1980 0x7fc3040cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 --2- 172.21.15.132:0/97880606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3040b3560 0x7fc3040c9a10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:04.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 -- 172.21.15.132:0/97880606 >> 172.21.15.132:0/97880606 conn(0x7fc30409d120 msgr2=0x7fc3040b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:04.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 -- 172.21.15.132:0/97880606 shutdown_connections 2024-03-16T17:48:04.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:04.464+0000 7fc30a7ac640 1 -- 172.21.15.132:0/97880606 wait complete. 2024-03-16T17:48:04.478 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T17:48:04.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T17:48:04.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2024-03-16T17:48:04.478 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T17:48:04.479 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T17:48:04.479 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T17:48:04.479 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T17:48:04.479 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T17:48:04.479 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T17:48:04.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:04.479 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2024-03-16T17:48:04.494 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T17:48:04.494 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T17:48:04.494 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T17:48:04.494 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:04.494 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-03-16T17:48:04.494 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:04.494 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:04.494 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42749sec preferred_lft 42749sec 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2024-03-16T17:48:04.495 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:04.496 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-16T17:48:04.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:04.496 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2024-03-16T17:48:04.496 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-03-16T17:48:04.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add name ceph-brx type bridge 2024-03-16T17:48:04.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr flush dev ceph-brx 2024-03-16T17:48:04.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set ceph-brx up 2024-03-16T17:48:04.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-16T17:48:04.496 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-03-16T17:48:04.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:04.664 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T17:48:04.689 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-03-16T17:48:04.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:04.690 DEBUG:teuthology.orchestra.run.smithi132:> route 2024-03-16T17:48:04.771 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2024-03-16T17:48:04.771 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T17:48:04.771 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-16T17:48:04.771 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-16T17:48:04.771 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T17:48:04.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:04.772 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2024-03-16T17:48:04.772 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-03-16T17:48:04.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-16T17:48:04.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-16T17:48:04.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-16T17:48:04.772 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-03-16T17:48:05.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.038 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-03-16T17:48:05.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.054 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2024-03-16T17:48:05.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.110 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2024-03-16T17:48:05.110 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-03-16T17:48:05.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T17:48:05.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-16T17:48:05.110 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-03-16T17:48:05.195 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-16T17:48:05.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.195 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2024-03-16T17:48:05.195 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-03-16T17:48:05.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-16T17:48:05.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-16T17:48:05.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-16T17:48:05.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-16T17:48:05.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-16T17:48:05.196 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-03-16T17:48:05.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.299 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2024-03-16T17:48:05.299 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-03-16T17:48:05.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2024-03-16T17:48:05.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.0 master ceph-brx 2024-03-16T17:48:05.299 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-03-16T17:48:05.341 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T17:48:05.341 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T17:48:05.397 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T17:48:05.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T17:48:05.397 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T17:48:05.452 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-16T17:48:05.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-16T17:48:05.538 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-16T17:48:05.538 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-16T17:48:05.538 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2024-03-16T17:48:05.663 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-16T17:48:05.664 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-16T17:48:05.664 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2024-03-16T17:48:05.664 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-03-16T17:48:05.664 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-16T17:48:05.674 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-16T17:48:05.674 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-16T17:48:05.674 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2024-03-16T17:48:05.674 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-03-16T17:48:05.674 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-16T17:48:05.674 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-03-16T17:48:05.674 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-03-16T17:48:05.675 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e" will pass to kernel 2024-03-16T17:48:05.675 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-16T17:48:05.675 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2024-03-16T17:48:05.675 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-16T17:48:05.675 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2024-03-16T17:48:05.676 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-16T17:48:05.677 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-16T17:48:05.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.677 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T17:48:05.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.705 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:05.765 INFO:teuthology.orchestra.run.smithi132.stdout:client4668 2024-03-16T17:48:05.765 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:48:05.765 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:05.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.822 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:05.884 INFO:teuthology.orchestra.run.smithi132.stdout:client4668 2024-03-16T17:48:05.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.884 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:05.943 INFO:teuthology.orchestra.run.smithi132.stdout:client4668 2024-03-16T17:48:05.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:05.944 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e.client4668/status') 2024-03-16T17:48:06.013 INFO:teuthology.orchestra.run.smithi132.stdout:instance: client.4668 (3)192.168.0.1:0/3810885117 2024-03-16T17:48:06.013 INFO:teuthology.orchestra.run.smithi132.stdout:blocklisted: false 2024-03-16T17:48:06.013 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2024-03-16T17:48:06.013 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2024-03-16T17:48:06.013 INFO:teuthology.orchestra.run.smithi132.stderr:69 bytes copied, 2.0399e-05 s, 3.4 MB/s 2024-03-16T17:48:06.014 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-03-16T17:48:06.014 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-16T17:48:06.014 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-16T17:48:06.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T17:48:06.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.156+0000 7f4b5d356640 1 Processor -- start 2024-03-16T17:48:06.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.156+0000 7f4b5d356640 1 -- start start 2024-03-16T17:48:06.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b5d356640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b5815ed40 0x7f4b580b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:06.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b5d356640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b58162210 con 0x7f4b5806b5f0 2024-03-16T17:48:06.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b5d356640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b580b5360 con 0x7f4b5815f120 2024-03-16T17:48:06.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b5d356640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b580b5080 con 0x7f4b5815ed40 2024-03-16T17:48:06.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b56ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b5815ed40 0x7f4b580b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:06.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b577fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4b5806b5f0 0x7f4b5806e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45940/0 (socket says 172.21.15.132:45940) 2024-03-16T17:48:06.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b577fe640 1 -- 172.21.15.132:0/217256948 learned_addr learned my addr 172.21.15.132:0/217256948 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:06.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b56ffd640 1 -- 172.21.15.132:0/217256948 >> v1:172.21.15.194:6789/0 conn(0x7f4b5815f120 legacy=0x7f4b5806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:06.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b56ffd640 1 -- 172.21.15.132:0/217256948 >> v1:172.21.15.132:6789/0 conn(0x7f4b5806b5f0 legacy=0x7f4b5806e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:06.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b56ffd640 1 -- 172.21.15.132:0/217256948 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b58161bc0 con 0x7f4b5815ed40 2024-03-16T17:48:06.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.158+0000 7f4b55ffb640 1 -- 172.21.15.132:0/217256948 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259851075 0 0) 0x7f4b58162210 con 0x7f4b5806b5f0 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.159+0000 7f4b56ffd640 1 --2- 172.21.15.132:0/217256948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815ed40 0x7f4b580b45e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b480097a0 tx=0x7f4b4802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa0885fb833aa70 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.159+0000 7f4b55ffb640 1 -- 172.21.15.132:0/217256948 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48030610 con 0x7f4b5815ed40 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.159+0000 7f4b55ffb640 1 -- 172.21.15.132:0/217256948 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b48030770 con 0x7f4b5815ed40 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.159+0000 7f4b55ffb640 1 -- 172.21.15.132:0/217256948 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48030b00 con 0x7f4b5815ed40 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.160+0000 7f4b5d356640 1 -- 172.21.15.132:0/217256948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815ed40 msgr2=0x7f4b580b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.160+0000 7f4b5d356640 1 --2- 172.21.15.132:0/217256948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815ed40 0x7f4b580b45e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b480097a0 tx=0x7f4b4802b960 comp rx=0 tx=0).stop 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.160+0000 7f4b5d356640 1 -- 172.21.15.132:0/217256948 shutdown_connections 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.160+0000 7f4b5d356640 1 --2- 172.21.15.132:0/217256948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815ed40 0x7f4b580b45e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.160+0000 7f4b5d356640 1 -- 172.21.15.132:0/217256948 >> 172.21.15.132:0/217256948 conn(0x7f4b5806bff0 msgr2=0x7f4b5806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.160+0000 7f4b5d356640 1 -- 172.21.15.132:0/217256948 shutdown_connections 2024-03-16T17:48:06.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.160+0000 7f4b5d356640 1 -- 172.21.15.132:0/217256948 wait complete. 2024-03-16T17:48:06.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.161+0000 7f4b5d356640 1 Processor -- start 2024-03-16T17:48:06.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.161+0000 7f4b5d356640 1 -- start start 2024-03-16T17:48:06.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b5d356640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b5806b5f0 0x7f4b580ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:06.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b5d356640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b5815ed40 0x7f4b58146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:06.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b5d356640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815f120 0x7f4b58146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b5d356640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b580ae710 con 0x7f4b5815f120 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b5d356640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58144a80 con 0x7f4b5806b5f0 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b5d356640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b58143f00 con 0x7f4b5815ed40 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b577fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815f120 0x7f4b58146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b577fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815f120 0x7f4b58146740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39012/0 (socket says 172.21.15.132:39012) 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b577fe640 1 -- 172.21.15.132:0/2941581006 learned_addr learned my addr 172.21.15.132:0/2941581006 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b56ffd640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b5806b5f0 0x7f4b580ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b567fc640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b5815ed40 0x7f4b58146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.162+0000 7f4b577fe640 1 -- 172.21.15.132:0/2941581006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b5815ed40 msgr2=0x7f4b58146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b577fe640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b5815ed40 0x7f4b58146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b577fe640 1 -- 172.21.15.132:0/2941581006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b5806b5f0 msgr2=0x7f4b580ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:06.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b577fe640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b5806b5f0 0x7f4b580ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b577fe640 1 -- 172.21.15.132:0/2941581006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b48009400 con 0x7f4b5815f120 2024-03-16T17:48:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b56ffd640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b5806b5f0 0x7f4b580ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b577fe640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815f120 0x7f4b58146740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c7b0 tx=0x7f4b5000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b3f7fe640 1 -- 172.21.15.132:0/2941581006 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5000a640 con 0x7f4b5815f120 2024-03-16T17:48:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b3f7fe640 1 -- 172.21.15.132:0/2941581006 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5000a7a0 con 0x7f4b5815f120 2024-03-16T17:48:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b5d356640 1 -- 172.21.15.132:0/2941581006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b58144150 con 0x7f4b5815f120 2024-03-16T17:48:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b3f7fe640 1 -- 172.21.15.132:0/2941581006 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5000ab90 con 0x7f4b5815f120 2024-03-16T17:48:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.163+0000 7f4b5d356640 1 -- 172.21.15.132:0/2941581006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b58144710 con 0x7f4b5815f120 2024-03-16T17:48:06.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.164+0000 7f4b5d356640 1 -- 172.21.15.132:0/2941581006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b58144c30 con 0x7f4b5815f120 2024-03-16T17:48:06.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.164+0000 7f4b3f7fe640 1 -- 172.21.15.132:0/2941581006 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4b5000acf0 con 0x7f4b5815f120 2024-03-16T17:48:06.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.165+0000 7f4b3f7fe640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4b4406b3b0 0x7f4b4406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:06.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.165+0000 7f4b56ffd640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4b4406b3b0 0x7f4b4406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:06.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.165+0000 7f4b3f7fe640 1 -- 172.21.15.132:0/2941581006 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b50089400 con 0x7f4b5815f120 2024-03-16T17:48:06.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.165+0000 7f4b56ffd640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4b4406b3b0 0x7f4b4406d870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b48036000 tx=0x7f4b4803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:06.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.173+0000 7f4b3f7fe640 1 -- 172.21.15.132:0/2941581006 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4b58144c30 con 0x7f4b5815f120 2024-03-16T17:48:06.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.387+0000 7f4b5d356640 1 -- 172.21.15.132:0/2941581006 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4b58144c30 con 0x7f4b5815f120 2024-03-16T17:48:06.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.387+0000 7f4b3f7fe640 1 -- 172.21.15.132:0/2941581006 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4b58144c30 con 0x7f4b5815f120 2024-03-16T17:48:06.391 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T17:48:06.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.389+0000 7f4b5d356640 1 -- 172.21.15.132:0/2941581006 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4b4406b3b0 msgr2=0x7f4b4406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:06.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.389+0000 7f4b5d356640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4b4406b3b0 0x7f4b4406d870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b48036000 tx=0x7f4b4803b040 comp rx=0 tx=0).stop 2024-03-16T17:48:06.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.389+0000 7f4b5d356640 1 -- 172.21.15.132:0/2941581006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815f120 msgr2=0x7f4b58146740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.389+0000 7f4b5d356640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815f120 0x7f4b58146740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4b5000c7b0 tx=0x7f4b5000cc70 comp rx=0 tx=0).stop 2024-03-16T17:48:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.389+0000 7f4b5d356640 1 -- 172.21.15.132:0/2941581006 shutdown_connections 2024-03-16T17:48:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.389+0000 7f4b5d356640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4b4406b3b0 0x7f4b4406d870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.389+0000 7f4b5d356640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b5815f120 0x7f4b58146740 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.389+0000 7f4b5d356640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b5815ed40 0x7f4b58146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.389+0000 7f4b5d356640 1 --2- 172.21.15.132:0/2941581006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b5806b5f0 0x7f4b580ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.390+0000 7f4b5d356640 1 -- 172.21.15.132:0/2941581006 >> 172.21.15.132:0/2941581006 conn(0x7f4b5806bff0 msgr2=0x7f4b580b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.390+0000 7f4b5d356640 1 -- 172.21.15.132:0/2941581006 shutdown_connections 2024-03-16T17:48:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:06.390+0000 7f4b5d356640 1 -- 172.21.15.132:0/2941581006 wait complete. 2024-03-16T17:48:06.404 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T17:48:06.404 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T17:48:06.404 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2024-03-16T17:48:06.404 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-16T17:48:06.404 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-16T17:48:06.404 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T17:48:06.404 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T17:48:06.404 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T17:48:06.404 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-16T17:48:06.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:06.405 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2024-03-16T17:48:06.419 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:06.420 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 62:13:04:58:2e:e9 brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::9cfe:f6ff:fe35:4/64 scope link 2024-03-16T17:48:06.421 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.422 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T17:48:06.422 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 62:13:04:58:2e:e9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T17:48:06.422 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::6013:4ff:fe58:2ee9/64 scope link tentative 2024-03-16T17:48:06.422 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:06.422 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T17:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-03-16T17:48:06.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:06.488 DEBUG:teuthology.orchestra.run.smithi132:> route 2024-03-16T17:48:06.544 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2024-03-16T17:48:06.544 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T17:48:06.544 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-16T17:48:06.544 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-16T17:48:06.544 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T17:48:06.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:06.545 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2024-03-16T17:48:06.545 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-03-16T17:48:06.545 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-16T17:48:06.545 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-16T17:48:06.545 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-16T17:48:06.545 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-03-16T17:48:06.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:06.640 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-03-16T17:48:06.654 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T17:48:06.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:06.655 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2024-03-16T17:48:06.708 INFO:teuthology.orchestra.run.smithi132.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-16T17:48:06.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:06.709 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2024-03-16T17:48:06.709 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-03-16T17:48:06.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-16T17:48:06.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-16T17:48:06.709 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-03-16T17:48:06.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:06.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-16T17:48:06.860 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T17:48:06.860 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T17:48:06.860 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T17:48:06.860 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.860 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-03-16T17:48:06.860 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.861 INFO:teuthology.orchestra.run.smithi132.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T17:48:06.861 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether f2:bc:13:df:81:f7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-16T17:48:06.861 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-16T17:48:06.861 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.861 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::f0bc:13ff:fedf:81f7/64 scope link tentative 2024-03-16T17:48:06.861 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:06.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-16T17:48:06.928 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T17:48:06.928 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T17:48:06.928 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T17:48:06.928 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.928 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-03-16T17:48:06.928 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.928 INFO:teuthology.orchestra.run.smithi132.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T17:48:06.928 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether f2:bc:13:df:81:f7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-16T17:48:06.929 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-16T17:48:06.929 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.929 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::f0bc:13ff:fedf:81f7/64 scope link tentative 2024-03-16T17:48:06.929 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:06.930 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-16T17:48:06.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:06.930 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2024-03-16T17:48:06.930 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-03-16T17:48:06.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-16T17:48:06.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-16T17:48:06.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-16T17:48:06.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-16T17:48:06.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-16T17:48:06.931 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-03-16T17:48:07.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:07.056 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2024-03-16T17:48:07.056 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-03-16T17:48:07.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.1 up 2024-03-16T17:48:07.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.1 master ceph-brx 2024-03-16T17:48:07.056 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-03-16T17:48:07.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T17:48:07.098 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-16T17:48:07.152 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-16T17:48:07.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T17:48:07.152 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-16T17:48:07.207 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-16T17:48:07.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:07.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-16T17:48:07.291 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-16T17:48:07.291 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-16T17:48:07.291 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2024-03-16T17:48:07.303 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-16T17:48:07.303 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-16T17:48:07.303 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2024-03-16T17:48:07.303 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-03-16T17:48:07.303 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-16T17:48:07.314 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-16T17:48:07.314 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-16T17:48:07.314 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2024-03-16T17:48:07.315 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-03-16T17:48:07.315 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-16T17:48:07.315 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-03-16T17:48:07.315 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-03-16T17:48:07.315 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e" will pass to kernel 2024-03-16T17:48:07.315 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-16T17:48:07.315 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2024-03-16T17:48:07.315 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-16T17:48:07.315 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2024-03-16T17:48:07.316 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-16T17:48:07.317 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-16T17:48:07.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:07.317 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-16T17:48:07.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:07.343 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:07.399 INFO:teuthology.orchestra.run.smithi132.stdout:client4648 2024-03-16T17:48:07.399 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:48:07.400 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:07.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:07.455 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:07.509 INFO:teuthology.orchestra.run.smithi132.stdout:client4648 2024-03-16T17:48:07.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:07.510 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:07.565 INFO:teuthology.orchestra.run.smithi132.stdout:client4648 2024-03-16T17:48:07.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:07.566 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e.client4648/status') 2024-03-16T17:48:07.632 INFO:teuthology.orchestra.run.smithi132.stdout:instance: client.4648 (3)172.21.15.132:0/3400419263 2024-03-16T17:48:07.632 INFO:teuthology.orchestra.run.smithi132.stdout:blocklisted: false 2024-03-16T17:48:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2024-03-16T17:48:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2024-03-16T17:48:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:71 bytes copied, 2.0553e-05 s, 3.5 MB/s 2024-03-16T17:48:07.633 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-03-16T17:48:07.634 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-16T17:48:07.634 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T17:48:07.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T17:48:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.769+0000 7f3202181640 1 Processor -- start 2024-03-16T17:48:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.769+0000 7f3202181640 1 -- start start 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.770+0000 7f3202181640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc0d1b90 0x7f31fc0d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.770+0000 7f3202181640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31fc0d2530 con 0x7f31fc0ce550 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.770+0000 7f3202181640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31fc09b700 con 0x7f31fc156410 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.770+0000 7f3202181640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc1567f0 con 0x7f31fc0d1b90 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fbfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f31fc0ce550 0x7f31fc0ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48180/0 (socket says 172.21.15.132:48180) 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fbfff640 1 -- 172.21.15.132:0/1332786795 learned_addr learned my addr 172.21.15.132:0/1332786795 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31faffd640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc0d1b90 0x7f31fc0d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201941708 0 0) 0x7f31fc0d2530 con 0x7f31fc0ce550 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e4003520 con 0x7f31fc0ce550 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1395802773 0 0) 0x7f31e4003520 con 0x7f31fc0ce550 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc0d1b90 msgr2=0x7f31fc0d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:07.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc0d1b90 0x7f31fc0d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 >> v1:172.21.15.194:6789/0 conn(0x7f31fc156410 legacy=0x7f31fc15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc09b180 con 0x7f31fc0ce550 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f31f40019f0 con 0x7f31fc0ce550 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 >> v1:172.21.15.132:6789/0 conn(0x7f31fc0ce550 legacy=0x7f31fc0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e40039a0 0x7f31e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31e40047c0 0x7f31e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc0d1b90 0x7f31e4005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc1567f0 con 0x7f31e40039a0 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e400bb70 con 0x7f31e40047c0 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e400bd30 con 0x7f31fc0d1b90 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fb7fe640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e40039a0 0x7f31e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31fbfff640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc0d1b90 0x7f31e4005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:07.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.771+0000 7f31faffd640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31e40047c0 0x7f31e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.772+0000 7f31fb7fe640 1 -- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc0d1b90 msgr2=0x7f31e4005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.772+0000 7f31fb7fe640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc0d1b90 0x7f31e4005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.772+0000 7f31fb7fe640 1 -- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31e40047c0 msgr2=0x7f31e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.772+0000 7f31fb7fe640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31e40047c0 0x7f31e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.772+0000 7f31fb7fe640 1 -- 172.21.15.132:0/1332786795 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4003520 con 0x7f31e40039a0 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.772+0000 7f31fbfff640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc0d1b90 0x7f31e4005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.772+0000 7f31fb7fe640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e40039a0 0x7f31e4003dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f31ec001750 tx=0x7f31e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05366eaa5c88157 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.772+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0052d0 con 0x7f31e40039a0 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.772+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec02e050 con 0x7f31e40039a0 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.772+0000 7f31fa7fc640 1 -- 172.21.15.132:0/1332786795 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0035f0 con 0x7f31e40039a0 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.773+0000 7f3202181640 1 -- 172.21.15.132:0/1332786795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e40039a0 msgr2=0x7f31e4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.773+0000 7f3202181640 1 --2- 172.21.15.132:0/1332786795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e40039a0 0x7f31e4003dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f31ec001750 tx=0x7f31e40057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:07.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.773+0000 7f31fbfff640 1 -- 172.21.15.132:0/1332786795 reap_dead start 2024-03-16T17:48:07.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.773+0000 7f3202181640 1 -- 172.21.15.132:0/1332786795 shutdown_connections 2024-03-16T17:48:07.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.773+0000 7f3202181640 1 -- 172.21.15.132:0/1332786795 >> 172.21.15.132:0/1332786795 conn(0x7f31fc073220 msgr2=0x7f31fc09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:07.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.773+0000 7f3202181640 1 -- 172.21.15.132:0/1332786795 shutdown_connections 2024-03-16T17:48:07.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.773+0000 7f3202181640 1 -- 172.21.15.132:0/1332786795 wait complete. 2024-03-16T17:48:07.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.774+0000 7f3202181640 1 Processor -- start 2024-03-16T17:48:07.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.774+0000 7f3202181640 1 -- start start 2024-03-16T17:48:07.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f3202181640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31e40039a0 0x7f31fc1f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:07.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f3202181640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31fc1f3c60 0x7f31fc15f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f3202181640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc06c7b0 0x7f31fc0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f3202181640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc06bff0 con 0x7f31fc1f3c60 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f3202181640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc1f4490 con 0x7f31e40039a0 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f3202181640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc1f4770 con 0x7f31fc06c7b0 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f31faffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31fc1f3c60 0x7f31fc15f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f31faffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31fc1f3c60 0x7f31fc15f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40830/0 (socket says 172.21.15.132:40830) 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f31faffd640 1 -- 172.21.15.132:0/208751471 learned_addr learned my addr 172.21.15.132:0/208751471 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f31faffd640 1 -- 172.21.15.132:0/208751471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc06c7b0 msgr2=0x7f31fc0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f31fbfff640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc06c7b0 0x7f31fc0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f31fb7fe640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31e40039a0 0x7f31fc1f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f31faffd640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc06c7b0 0x7f31fc0cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f31faffd640 1 -- 172.21.15.132:0/208751471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31e40039a0 msgr2=0x7f31fc1f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f31faffd640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31e40039a0 0x7f31fc1f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.775+0000 7f31faffd640 1 -- 172.21.15.132:0/208751471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc1f4a50 con 0x7f31fc1f3c60 2024-03-16T17:48:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.776+0000 7f31faffd640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31fc1f3c60 0x7f31fc15f510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f31f0011600 tx=0x7f31f0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.776+0000 7f31e3fff640 1 -- 172.21.15.132:0/208751471 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000f920 con 0x7f31fc1f3c60 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.776+0000 7f31e3fff640 1 -- 172.21.15.132:0/208751471 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000fa80 con 0x7f31fc1f3c60 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.776+0000 7f3202181640 1 -- 172.21.15.132:0/208751471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31fc06c290 con 0x7f31fc1f3c60 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.776+0000 7f31e3fff640 1 -- 172.21.15.132:0/208751471 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000fdf0 con 0x7f31fc1f3c60 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.776+0000 7f3202181640 1 -- 172.21.15.132:0/208751471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc15fa50 con 0x7f31fc1f3c60 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.777+0000 7f3202181640 1 -- 172.21.15.132:0/208751471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc074dc0 con 0x7f31fc1f3c60 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.777+0000 7f31e3fff640 1 -- 172.21.15.132:0/208751471 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f31f0015460 con 0x7f31fc1f3c60 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.778+0000 7f31e3fff640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f31e806b3e0 0x7f31e806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.778+0000 7f31fb7fe640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f31e806b3e0 0x7f31e806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.778+0000 7f31e3fff640 1 -- 172.21.15.132:0/208751471 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31f008a3a0 con 0x7f31fc1f3c60 2024-03-16T17:48:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.778+0000 7f31fb7fe640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f31e806b3e0 0x7f31e806d8a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f31ec033000 tx=0x7f31ec009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:07.782+0000 7f31e3fff640 1 -- 172.21.15.132:0/208751471 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f31f0055000 con 0x7f31fc1f3c60 2024-03-16T17:48:08.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.045+0000 7f3202181640 1 -- 172.21.15.132:0/208751471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f31fc1f4be0 con 0x7f31fc1f3c60 2024-03-16T17:48:08.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.046+0000 7f31e3fff640 1 -- 172.21.15.132:0/208751471 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f31f00586c0 con 0x7f31fc1f3c60 2024-03-16T17:48:08.049 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 -- 172.21.15.132:0/208751471 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f31e806b3e0 msgr2=0x7f31e806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f31e806b3e0 0x7f31e806d8a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f31ec033000 tx=0x7f31ec009030 comp rx=0 tx=0).stop 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 -- 172.21.15.132:0/208751471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31fc1f3c60 msgr2=0x7f31fc15f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31fc1f3c60 0x7f31fc15f510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f31f0011600 tx=0x7f31f0011ac0 comp rx=0 tx=0).stop 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 -- 172.21.15.132:0/208751471 shutdown_connections 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f31e806b3e0 0x7f31e806d8a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f31fc06c7b0 0x7f31fc0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31fc1f3c60 0x7f31fc15f510 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 --2- 172.21.15.132:0/208751471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31e40039a0 0x7f31fc1f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 -- 172.21.15.132:0/208751471 >> 172.21.15.132:0/208751471 conn(0x7f31fc073220 msgr2=0x7f31fc155640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:08.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 -- 172.21.15.132:0/208751471 shutdown_connections 2024-03-16T17:48:08.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:08.048+0000 7f3202181640 1 -- 172.21.15.132:0/208751471 wait complete. 2024-03-16T17:48:08.062 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T17:48:08.062 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T17:48:08.062 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-03-16T17:48:08.062 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-16T17:48:08.062 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-16T17:48:08.063 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T17:48:08.063 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T17:48:08.063 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T17:48:08.063 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-16T17:48:08.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:08.063 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:08.082 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:08.083 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-03-16T17:48:08.083 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:08.083 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:08.083 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T17:48:08.083 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:08.083 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-16T17:48:08.083 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42731sec preferred_lft 42731sec 2024-03-16T17:48:08.083 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2024-03-16T17:48:08.083 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:08.083 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-16T17:48:08.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:08.084 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-16T17:48:08.084 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-16T17:48:08.084 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add name ceph-brx type bridge 2024-03-16T17:48:08.084 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr flush dev ceph-brx 2024-03-16T17:48:08.084 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set ceph-brx up 2024-03-16T17:48:08.084 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-16T17:48:08.084 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-16T17:48:08.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:08.269 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T17:48:08.296 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-03-16T17:48:08.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:08.298 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-03-16T17:48:08.364 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-03-16T17:48:08.364 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T17:48:08.364 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-16T17:48:08.364 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-16T17:48:08.364 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T17:48:08.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:08.365 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-16T17:48:08.365 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-16T17:48:08.365 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-16T17:48:08.365 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-16T17:48:08.365 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-16T17:48:08.365 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-16T17:48:08.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:08.652 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-03-16T17:48:08.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:08.667 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2024-03-16T17:48:08.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:08.721 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-16T17:48:08.722 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-16T17:48:08.722 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T17:48:08.722 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-16T17:48:08.722 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-16T17:48:08.806 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-16T17:48:08.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:08.806 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-16T17:48:08.806 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-16T17:48:08.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-16T17:48:08.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-16T17:48:08.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-16T17:48:08.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-16T17:48:08.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-16T17:48:08.807 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-16T17:48:08.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:08.911 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-16T17:48:08.911 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-16T17:48:08.911 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-03-16T17:48:08.911 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.0 master ceph-brx 2024-03-16T17:48:08.911 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-16T17:48:08.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T17:48:08.953 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-16T17:48:09.008 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-16T17:48:09.009 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T17:48:09.009 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-16T17:48:09.063 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-16T17:48:09.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:09.063 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-16T17:48:09.148 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-16T17:48:09.149 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-16T17:48:09.149 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-03-16T17:48:09.244 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-16T17:48:09.244 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-16T17:48:09.244 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-03-16T17:48:09.244 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-03-16T17:48:09.244 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-16T17:48:09.250 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-16T17:48:09.250 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-16T17:48:09.250 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-03-16T17:48:09.250 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-03-16T17:48:09.250 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-16T17:48:09.250 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-03-16T17:48:09.250 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-03-16T17:48:09.250 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e" will pass to kernel 2024-03-16T17:48:09.251 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-16T17:48:09.251 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-03-16T17:48:09.251 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-16T17:48:09.252 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-03-16T17:48:09.252 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-16T17:48:09.253 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-16T17:48:09.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:09.253 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-16T17:48:09.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:09.280 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:09.336 INFO:teuthology.orchestra.run.smithi194.stdout:client4686 2024-03-16T17:48:09.336 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:48:09.336 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:09.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:09.391 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:09.447 INFO:teuthology.orchestra.run.smithi194.stdout:client4686 2024-03-16T17:48:09.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:09.447 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:09.503 INFO:teuthology.orchestra.run.smithi194.stdout:client4686 2024-03-16T17:48:09.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:09.504 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e.client4686/status') 2024-03-16T17:48:09.569 INFO:teuthology.orchestra.run.smithi194.stdout:instance: client.4686 (3)172.21.15.194:0/1170812867 2024-03-16T17:48:09.570 INFO:teuthology.orchestra.run.smithi194.stdout:blocklisted: false 2024-03-16T17:48:09.570 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records in 2024-03-16T17:48:09.570 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records out 2024-03-16T17:48:09.570 INFO:teuthology.orchestra.run.smithi194.stderr:71 bytes copied, 2.0675e-05 s, 3.4 MB/s 2024-03-16T17:48:09.571 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-03-16T17:48:09.571 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-16T17:48:09.571 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-16T17:48:09.571 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T17:48:09.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.673+0000 7f502991e640 1 Processor -- start 2024-03-16T17:48:09.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.673+0000 7f502991e640 1 -- start start 2024-03-16T17:48:09.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.673+0000 7f502991e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5024151470 0x7f50240729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:09.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.673+0000 7f502991e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f50240b2bb0 0x7f502406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:09.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.673+0000 7f502991e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502415b670 con 0x7f5024072000 2024-03-16T17:48:09.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.673+0000 7f502991e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f502406d310 con 0x7f5024151470 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.673+0000 7f502991e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50240b2ff0 con 0x7f50240b2bb0 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.674+0000 7f5022ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5024151470 0x7f50240729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.674+0000 7f5022ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5024151470 0x7f50240729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40832/0 (socket says 172.21.15.132:40832) 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.674+0000 7f5022ffd640 1 -- 172.21.15.132:0/4076532470 learned_addr learned my addr 172.21.15.132:0/4076532470 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.674+0000 7f501bfff640 1 --2- 172.21.15.132:0/4076532470 >> v2:172.21.15.194:3300/0 conn(0x7f50240b2bb0 0x7f502406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.674+0000 7f5022ffd640 1 -- 172.21.15.132:0/4076532470 >> v2:172.21.15.194:3300/0 conn(0x7f50240b2bb0 msgr2=0x7f502406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.674+0000 7f5022ffd640 1 --2- 172.21.15.132:0/4076532470 >> v2:172.21.15.194:3300/0 conn(0x7f50240b2bb0 0x7f502406d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.674+0000 7f5022ffd640 1 -- 172.21.15.132:0/4076532470 >> v1:172.21.15.194:6789/0 conn(0x7f5024072000 legacy=0x7f502406cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.674+0000 7f5022ffd640 1 -- 172.21.15.132:0/4076532470 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502415ad40 con 0x7f5024151470 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f5022ffd640 1 --2- 172.21.15.132:0/4076532470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024151470 0x7f50240729d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5024068760 tx=0x7f501402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc41f69aac4c54a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f50227fc640 1 -- 172.21.15.132:0/4076532470 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014030860 con 0x7f5024151470 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f50227fc640 1 -- 172.21.15.132:0/4076532470 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50140309c0 con 0x7f5024151470 2024-03-16T17:48:09.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f50227fc640 1 -- 172.21.15.132:0/4076532470 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014030d50 con 0x7f5024151470 2024-03-16T17:48:09.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f502991e640 1 -- 172.21.15.132:0/4076532470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024151470 msgr2=0x7f50240729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:09.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f502991e640 1 --2- 172.21.15.132:0/4076532470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024151470 0x7f50240729d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5024068760 tx=0x7f501402b9a0 comp rx=0 tx=0).stop 2024-03-16T17:48:09.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f502991e640 1 -- 172.21.15.132:0/4076532470 shutdown_connections 2024-03-16T17:48:09.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f502991e640 1 --2- 172.21.15.132:0/4076532470 >> v2:172.21.15.194:3300/0 conn(0x7f50240b2bb0 0x7f502406d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:09.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f502991e640 1 --2- 172.21.15.132:0/4076532470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024151470 0x7f50240729d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:09.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f502991e640 1 -- 172.21.15.132:0/4076532470 >> 172.21.15.132:0/4076532470 conn(0x7f502406aee0 msgr2=0x7f502406b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:09.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f502991e640 1 -- 172.21.15.132:0/4076532470 shutdown_connections 2024-03-16T17:48:09.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.675+0000 7f502991e640 1 -- 172.21.15.132:0/4076532470 wait complete. 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.676+0000 7f502991e640 1 Processor -- start 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.677+0000 7f502991e640 1 -- start start 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.677+0000 7f502991e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024072000 0x7f50241f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.677+0000 7f502991e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50240b2bb0 0x7f50241f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.677+0000 7f502991e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5024151470 0x7f50240ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.677+0000 7f502991e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502414fdb0 con 0x7f5024072000 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.677+0000 7f502991e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50241e4df0 con 0x7f5024151470 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.677+0000 7f502991e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50241e50d0 con 0x7f50240b2bb0 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.677+0000 7f5022ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024072000 0x7f50241f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.677+0000 7f5022ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024072000 0x7f50241f1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40836/0 (socket says 172.21.15.132:40836) 2024-03-16T17:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.677+0000 7f5022ffd640 1 -- 172.21.15.132:0/1882938157 learned_addr learned my addr 172.21.15.132:0/1882938157 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f50237fe640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5024151470 0x7f50240ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f501bfff640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50240b2bb0 0x7f50241f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f5022ffd640 1 -- 172.21.15.132:0/1882938157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50240b2bb0 msgr2=0x7f50241f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f5022ffd640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50240b2bb0 0x7f50241f2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f5022ffd640 1 -- 172.21.15.132:0/1882938157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5024151470 msgr2=0x7f50240ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f5022ffd640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5024151470 0x7f50240ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f5022ffd640 1 -- 172.21.15.132:0/1882938157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50140094d0 con 0x7f5024072000 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f50237fe640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5024151470 0x7f50240ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f5022ffd640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024072000 0x7f50241f1820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f501402b9e0 tx=0x7f5014004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f5020ff9640 1 -- 172.21.15.132:0/1882938157 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014039b60 con 0x7f5024072000 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f5020ff9640 1 -- 172.21.15.132:0/1882938157 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5014039ce0 con 0x7f5024072000 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f502991e640 1 -- 172.21.15.132:0/1882938157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50241e53b0 con 0x7f5024072000 2024-03-16T17:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f5020ff9640 1 -- 172.21.15.132:0/1882938157 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5014043650 con 0x7f5024072000 2024-03-16T17:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.678+0000 7f502991e640 1 -- 172.21.15.132:0/1882938157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50241f27d0 con 0x7f5024072000 2024-03-16T17:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.679+0000 7f502991e640 1 -- 172.21.15.132:0/1882938157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502404f2c0 con 0x7f5024072000 2024-03-16T17:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.680+0000 7f5020ff9640 1 -- 172.21.15.132:0/1882938157 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f501404c3b0 con 0x7f5024072000 2024-03-16T17:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.680+0000 7f5020ff9640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f500406b3b0 0x7f500406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.680+0000 7f5020ff9640 1 -- 172.21.15.132:0/1882938157 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50140ac110 con 0x7f5024072000 2024-03-16T17:48:09.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.680+0000 7f501bfff640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f500406b3b0 0x7f500406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:09.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.680+0000 7f501bfff640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f500406b3b0 0x7f500406d870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f50240cf010 tx=0x7f500c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:09.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.684+0000 7f5020ff9640 1 -- 172.21.15.132:0/1882938157 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5014076e00 con 0x7f5024072000 2024-03-16T17:48:09.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.894+0000 7f502991e640 1 -- 172.21.15.132:0/1882938157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f502406bde0 con 0x7f5024072000 2024-03-16T17:48:09.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.895+0000 7f5020ff9640 1 -- 172.21.15.132:0/1882938157 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f501407a4c0 con 0x7f5024072000 2024-03-16T17:48:09.898 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T17:48:09.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 -- 172.21.15.132:0/1882938157 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f500406b3b0 msgr2=0x7f500406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:09.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f500406b3b0 0x7f500406d870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f50240cf010 tx=0x7f500c008040 comp rx=0 tx=0).stop 2024-03-16T17:48:09.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 -- 172.21.15.132:0/1882938157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024072000 msgr2=0x7f50241f1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:09.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024072000 0x7f50241f1820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f501402b9e0 tx=0x7f5014004730 comp rx=0 tx=0).stop 2024-03-16T17:48:09.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 -- 172.21.15.132:0/1882938157 shutdown_connections 2024-03-16T17:48:09.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f500406b3b0 0x7f500406d870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:09.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5024151470 0x7f50240ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:09.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50240b2bb0 0x7f50241f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:09.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 --2- 172.21.15.132:0/1882938157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5024072000 0x7f50241f1820 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:09.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 -- 172.21.15.132:0/1882938157 >> 172.21.15.132:0/1882938157 conn(0x7f502406aee0 msgr2=0x7f50240b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:09.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 -- 172.21.15.132:0/1882938157 shutdown_connections 2024-03-16T17:48:09.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:09.897+0000 7f502991e640 1 -- 172.21.15.132:0/1882938157 wait complete. 2024-03-16T17:48:09.911 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-16T17:48:09.911 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T17:48:09.911 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-03-16T17:48:09.912 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-16T17:48:09.912 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-16T17:48:09.912 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-16T17:48:09.912 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-16T17:48:09.912 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T17:48:09.912 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-16T17:48:09.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:09.912 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-03-16T17:48:09.928 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T17:48:09.928 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T17:48:09.928 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T17:48:09.928 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:09.928 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-03-16T17:48:09.928 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:09.928 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42729sec preferred_lft 42729sec 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T17:48:09.929 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 5a:53:53:ea:69:d7 brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:09.930 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T17:48:09.930 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:09.930 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::4473:fbff:fe10:780b/64 scope link 2024-03-16T17:48:09.930 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:09.930 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T17:48:09.930 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 5a:53:53:ea:69:d7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-16T17:48:09.930 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::5853:53ff:feea:69d7/64 scope link tentative 2024-03-16T17:48:09.930 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:09.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:09.930 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T17:48:09.995 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-03-16T17:48:09.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:09.996 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-03-16T17:48:10.052 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-03-16T17:48:10.052 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T17:48:10.052 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-16T17:48:10.052 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-16T17:48:10.052 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T17:48:10.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.053 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-16T17:48:10.053 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-16T17:48:10.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-16T17:48:10.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-16T17:48:10.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-16T17:48:10.053 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-16T17:48:10.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.214 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-03-16T17:48:10.229 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-16T17:48:10.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.230 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2024-03-16T17:48:10.284 INFO:teuthology.orchestra.run.smithi194.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-16T17:48:10.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.285 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-16T17:48:10.285 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-16T17:48:10.286 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-16T17:48:10.286 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-16T17:48:10.286 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-16T17:48:10.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.366 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-16T17:48:10.433 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T17:48:10.433 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T17:48:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T17:48:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-03-16T17:48:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:10.434 INFO:teuthology.orchestra.run.smithi194.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T17:48:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 4e:9a:06:bd:88:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-16T17:48:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-16T17:48:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::4c9a:6ff:febd:88f4/64 scope link 2024-03-16T17:48:10.434 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:10.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.435 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-16T17:48:10.502 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T17:48:10.502 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T17:48:10.502 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T17:48:10.502 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:10.502 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-03-16T17:48:10.502 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:10.502 INFO:teuthology.orchestra.run.smithi194.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T17:48:10.502 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 4e:9a:06:bd:88:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-16T17:48:10.502 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-16T17:48:10.502 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:10.503 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::4c9a:6ff:febd:88f4/64 scope link 2024-03-16T17:48:10.503 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:10.504 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-16T17:48:10.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.504 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-16T17:48:10.504 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-16T17:48:10.504 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-16T17:48:10.504 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-16T17:48:10.504 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-16T17:48:10.504 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-16T17:48:10.504 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-16T17:48:10.504 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-16T17:48:10.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.629 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-16T17:48:10.629 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-16T17:48:10.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.1 up 2024-03-16T17:48:10.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.1 master ceph-brx 2024-03-16T17:48:10.629 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-16T17:48:10.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T17:48:10.671 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-16T17:48:10.726 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-16T17:48:10.727 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T17:48:10.727 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-16T17:48:10.780 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-16T17:48:10.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.780 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-16T17:48:10.864 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-16T17:48:10.865 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-16T17:48:10.865 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-03-16T17:48:10.873 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-16T17:48:10.873 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-16T17:48:10.873 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-03-16T17:48:10.873 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-03-16T17:48:10.873 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-16T17:48:10.884 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-16T17:48:10.884 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-16T17:48:10.884 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-03-16T17:48:10.884 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-03-16T17:48:10.884 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-16T17:48:10.884 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-03-16T17:48:10.885 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-03-16T17:48:10.885 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e" will pass to kernel 2024-03-16T17:48:10.885 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-16T17:48:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-03-16T17:48:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-16T17:48:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-03-16T17:48:10.885 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-16T17:48:10.887 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-16T17:48:10.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.887 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-16T17:48:10.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:10.914 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:client4695 2024-03-16T17:48:10.971 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:48:10.971 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:11.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:11.026 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:11.081 INFO:teuthology.orchestra.run.smithi194.stdout:client4695 2024-03-16T17:48:11.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:11.081 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:11.137 INFO:teuthology.orchestra.run.smithi194.stdout:client4695 2024-03-16T17:48:11.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:11.137 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e.client4695/status') 2024-03-16T17:48:11.204 INFO:teuthology.orchestra.run.smithi194.stdout:instance: client.4695 (3)172.21.15.194:0/2275344006 2024-03-16T17:48:11.204 INFO:teuthology.orchestra.run.smithi194.stdout:blocklisted: false 2024-03-16T17:48:11.204 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records in 2024-03-16T17:48:11.205 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records out 2024-03-16T17:48:11.205 INFO:teuthology.orchestra.run.smithi194.stderr:71 bytes copied, 2.29e-05 s, 3.1 MB/s 2024-03-16T17:48:11.206 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-16T17:48:11.237 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:11.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.334+0000 7f3f3976c640 1 Processor -- start 2024-03-16T17:48:11.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.334+0000 7f3f3976c640 1 -- start start 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.334+0000 7f3f3976c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f3415e040 0x7f3f340b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.334+0000 7f3f3976c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f3406fff0 0x7f3f340b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.334+0000 7f3f3976c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3406d640 con 0x7f3f3406dad0 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.334+0000 7f3f3976c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3406caa0 con 0x7f3f3415e040 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.334+0000 7f3f3976c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3406cd10 con 0x7f3f3406fff0 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.335+0000 7f3f32ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f3415e040 0x7f3f340b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.335+0000 7f3f32ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f3415e040 0x7f3f340b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40852/0 (socket says 172.21.15.132:40852) 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.335+0000 7f3f32ffd640 1 -- 172.21.15.132:0/1339829795 learned_addr learned my addr 172.21.15.132:0/1339829795 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.335+0000 7f3f337fe640 1 --2- 172.21.15.132:0/1339829795 >> v2:172.21.15.194:3300/0 conn(0x7f3f3406fff0 0x7f3f340b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.335+0000 7f3f32ffd640 1 -- 172.21.15.132:0/1339829795 >> v2:172.21.15.194:3300/0 conn(0x7f3f3406fff0 msgr2=0x7f3f340b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:11.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.335+0000 7f3f32ffd640 1 --2- 172.21.15.132:0/1339829795 >> v2:172.21.15.194:3300/0 conn(0x7f3f3406fff0 0x7f3f340b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.335+0000 7f3f32ffd640 1 -- 172.21.15.132:0/1339829795 >> v1:172.21.15.194:6789/0 conn(0x7f3f3406dad0 legacy=0x7f3f3406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.335+0000 7f3f32ffd640 1 -- 172.21.15.132:0/1339829795 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3406cff0 con 0x7f3f3415e040 2024-03-16T17:48:11.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.336+0000 7f3f32ffd640 1 --2- 172.21.15.132:0/1339829795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 0x7f3f340b11b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f34072cb0 tx=0x7f3f2402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8112d4fdf530c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:11.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.336+0000 7f3f327fc640 1 -- 172.21.15.132:0/1339829795 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24030860 con 0x7f3f3415e040 2024-03-16T17:48:11.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.336+0000 7f3f327fc640 1 -- 172.21.15.132:0/1339829795 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f240309c0 con 0x7f3f3415e040 2024-03-16T17:48:11.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.336+0000 7f3f327fc640 1 -- 172.21.15.132:0/1339829795 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24030d50 con 0x7f3f3415e040 2024-03-16T17:48:11.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.337+0000 7f3f3976c640 1 -- 172.21.15.132:0/1339829795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 msgr2=0x7f3f340b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.337+0000 7f3f3976c640 1 --2- 172.21.15.132:0/1339829795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 0x7f3f340b11b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f34072cb0 tx=0x7f3f2402b9a0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.337+0000 7f3f3976c640 1 -- 172.21.15.132:0/1339829795 shutdown_connections 2024-03-16T17:48:11.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.337+0000 7f3f3976c640 1 --2- 172.21.15.132:0/1339829795 >> v2:172.21.15.194:3300/0 conn(0x7f3f3406fff0 0x7f3f340b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.337+0000 7f3f3976c640 1 --2- 172.21.15.132:0/1339829795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 0x7f3f340b11b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.337+0000 7f3f3976c640 1 -- 172.21.15.132:0/1339829795 >> 172.21.15.132:0/1339829795 conn(0x7f3f3409aa70 msgr2=0x7f3f3409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:11.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.337+0000 7f3f3976c640 1 -- 172.21.15.132:0/1339829795 shutdown_connections 2024-03-16T17:48:11.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.337+0000 7f3f3976c640 1 -- 172.21.15.132:0/1339829795 wait complete. 2024-03-16T17:48:11.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.338+0000 7f3f3976c640 1 Processor -- start 2024-03-16T17:48:11.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.338+0000 7f3f3976c640 1 -- start start 2024-03-16T17:48:11.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f3976c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f3406dad0 0x7f3f340b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f3976c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f3406fff0 0x7f3f3409e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f3976c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 0x7f3f34154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f3976c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3409efe0 con 0x7f3f3415e040 2024-03-16T17:48:11.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f3976c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3409f2c0 con 0x7f3f3406fff0 2024-03-16T17:48:11.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f3976c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3409f5a0 con 0x7f3f3406dad0 2024-03-16T17:48:11.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 0x7f3f34154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 0x7f3f34154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40864/0 (socket says 172.21.15.132:40864) 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f337fe640 1 -- 172.21.15.132:0/3015967683 learned_addr learned my addr 172.21.15.132:0/3015967683 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f2bfff640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f3406fff0 0x7f3f3409e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f32ffd640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f3406dad0 0x7f3f340b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f337fe640 1 -- 172.21.15.132:0/3015967683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f3406dad0 msgr2=0x7f3f340b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f337fe640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f3406dad0 0x7f3f340b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f337fe640 1 -- 172.21.15.132:0/3015967683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f3406fff0 msgr2=0x7f3f3409e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f337fe640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f3406fff0 0x7f3f3409e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f337fe640 1 -- 172.21.15.132:0/3015967683 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f240094d0 con 0x7f3f3415e040 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f337fe640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 0x7f3f34154bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00efc0 tx=0x7f3f2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f2b7fe640 1 -- 172.21.15.132:0/3015967683 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c009ca0 con 0x7f3f3415e040 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f2b7fe640 1 -- 172.21.15.132:0/3015967683 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c00f040 con 0x7f3f3415e040 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f3976c640 1 -- 172.21.15.132:0/3015967683 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3409f880 con 0x7f3f3415e040 2024-03-16T17:48:11.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f2b7fe640 1 -- 172.21.15.132:0/3015967683 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0146c0 con 0x7f3f3415e040 2024-03-16T17:48:11.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.339+0000 7f3f3976c640 1 -- 172.21.15.132:0/3015967683 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f340b0890 con 0x7f3f3415e040 2024-03-16T17:48:11.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.340+0000 7f3f3976c640 1 -- 172.21.15.132:0/3015967683 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f34155cb0 con 0x7f3f3415e040 2024-03-16T17:48:11.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.341+0000 7f3f2b7fe640 1 -- 172.21.15.132:0/3015967683 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f3f2c014820 con 0x7f3f3415e040 2024-03-16T17:48:11.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.341+0000 7f3f2b7fe640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3f1406b3b0 0x7f3f1406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.341+0000 7f3f2b7fe640 1 -- 172.21.15.132:0/3015967683 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f2c08aac0 con 0x7f3f3415e040 2024-03-16T17:48:11.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.341+0000 7f3f32ffd640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3f1406b3b0 0x7f3f1406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.342+0000 7f3f32ffd640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3f1406b3b0 0x7f3f1406d870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3f24036000 tx=0x7f3f24008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:11.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.346+0000 7f3f2b7fe640 1 -- 172.21.15.132:0/3015967683 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3f2c0557d0 con 0x7f3f3415e040 2024-03-16T17:48:11.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.570+0000 7f3f3976c640 1 -- 172.21.15.132:0/3015967683 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f3404f2c0 con 0x7f3f3415e040 2024-03-16T17:48:11.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.571+0000 7f3f2b7fe640 1 -- 172.21.15.132:0/3015967683 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f3f2c058e90 con 0x7f3f3415e040 2024-03-16T17:48:11.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:11.575 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:11.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 -- 172.21.15.132:0/3015967683 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3f1406b3b0 msgr2=0x7f3f1406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3f1406b3b0 0x7f3f1406d870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3f24036000 tx=0x7f3f24008030 comp rx=0 tx=0).stop 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 -- 172.21.15.132:0/3015967683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 msgr2=0x7f3f34154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 0x7f3f34154bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00efc0 tx=0x7f3f2c00c490 comp rx=0 tx=0).stop 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 -- 172.21.15.132:0/3015967683 shutdown_connections 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f3f1406b3b0 0x7f3f1406d870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3415e040 0x7f3f34154bf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f3406fff0 0x7f3f3409e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 --2- 172.21.15.132:0/3015967683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f3406dad0 0x7f3f340b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 -- 172.21.15.132:0/3015967683 >> 172.21.15.132:0/3015967683 conn(0x7f3f3409aa70 msgr2=0x7f3f3415d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 -- 172.21.15.132:0/3015967683 shutdown_connections 2024-03-16T17:48:11.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.574+0000 7f3f3976c640 1 -- 172.21.15.132:0/3015967683 wait complete. 2024-03-16T17:48:11.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:11.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:11.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.690+0000 7fe0d376c640 1 Processor -- start 2024-03-16T17:48:11.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.690+0000 7fe0d376c640 1 -- start start 2024-03-16T17:48:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.691+0000 7fe0d376c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0cc15b900 0x7fe0cc15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.691+0000 7fe0d376c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0cc15e7c0 0x7fe0cc15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.691+0000 7fe0d376c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc15f0c0 con 0x7fe0cc15ec20 2024-03-16T17:48:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d376c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc15f3a0 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d376c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc15f680 con 0x7fe0cc15b900 2024-03-16T17:48:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d0d07640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0cc15e7c0 0x7fe0cc15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d1508640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0cc15b900 0x7fe0cc15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d0d07640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0cc15e7c0 0x7fe0cc15c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40878/0 (socket says 172.21.15.132:40878) 2024-03-16T17:48:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d0d07640 1 -- 172.21.15.132:0/388239567 learned_addr learned my addr 172.21.15.132:0/388239567 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d1d09640 1 --1- 172.21.15.132:0/388239567 >> v1:172.21.15.194:6789/0 conn(0x7fe0cc15ec20 0x7fe0cc06f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46600/0 (socket says 172.21.15.132:46600) 2024-03-16T17:48:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d0d07640 1 -- 172.21.15.132:0/388239567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0cc15b900 msgr2=0x7fe0cc15bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d0d07640 1 --2- 172.21.15.132:0/388239567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0cc15b900 0x7fe0cc15bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d0d07640 1 -- 172.21.15.132:0/388239567 >> v1:172.21.15.194:6789/0 conn(0x7fe0cc15ec20 legacy=0x7fe0cc06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0c3fff640 1 -- 172.21.15.132:0/388239567 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983143242 0 0) 0x7fe0cc15f0c0 con 0x7fe0cc15ec20 2024-03-16T17:48:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.692+0000 7fe0d0d07640 1 -- 172.21.15.132:0/388239567 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc06e980 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.693+0000 7fe0d0d07640 1 --2- 172.21.15.132:0/388239567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 0x7fe0cc15c390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009870 tx=0x7fe0bc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccfcb90493f4cab server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:11.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.693+0000 7fe0c3fff640 1 -- 172.21.15.132:0/388239567 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc030840 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.693+0000 7fe0c3fff640 1 -- 172.21.15.132:0/388239567 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc0309a0 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.693+0000 7fe0c3fff640 1 -- 172.21.15.132:0/388239567 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc030d30 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.693+0000 7fe0d376c640 1 -- 172.21.15.132:0/388239567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 msgr2=0x7fe0cc15c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.693+0000 7fe0d376c640 1 --2- 172.21.15.132:0/388239567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 0x7fe0cc15c390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009870 tx=0x7fe0bc02b980 comp rx=0 tx=0).stop 2024-03-16T17:48:11.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.693+0000 7fe0d376c640 1 -- 172.21.15.132:0/388239567 shutdown_connections 2024-03-16T17:48:11.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.693+0000 7fe0d376c640 1 --2- 172.21.15.132:0/388239567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 0x7fe0cc15c390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.693+0000 7fe0d376c640 1 --2- 172.21.15.132:0/388239567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0cc15b900 0x7fe0cc15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.693+0000 7fe0d376c640 1 -- 172.21.15.132:0/388239567 >> 172.21.15.132:0/388239567 conn(0x7fe0cc06bff0 msgr2=0x7fe0cc06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.694+0000 7fe0d376c640 1 -- 172.21.15.132:0/388239567 shutdown_connections 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.694+0000 7fe0d376c640 1 -- 172.21.15.132:0/388239567 wait complete. 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.695+0000 7fe0d376c640 1 Processor -- start 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.695+0000 7fe0d376c640 1 -- start start 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.695+0000 7fe0d376c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0cc15b900 0x7fe0cc1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.695+0000 7fe0d376c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 0x7fe0cc157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.695+0000 7fe0d376c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0cc15ec20 0x7fe0cc150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.695+0000 7fe0d376c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0cef40 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.695+0000 7fe0d376c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0b23a0 con 0x7fe0cc15b900 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.695+0000 7fe0d376c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc155230 con 0x7fe0cc15ec20 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.695+0000 7fe0d0d07640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 0x7fe0cc157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d0d07640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 0x7fe0cc157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40882/0 (socket says 172.21.15.132:40882) 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d0d07640 1 -- 172.21.15.132:0/716977327 learned_addr learned my addr 172.21.15.132:0/716977327 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d1508640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0cc15b900 0x7fe0cc1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d1d09640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0cc15ec20 0x7fe0cc150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d0d07640 1 -- 172.21.15.132:0/716977327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0cc15ec20 msgr2=0x7fe0cc150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d0d07640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0cc15ec20 0x7fe0cc150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d0d07640 1 -- 172.21.15.132:0/716977327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0cc15b900 msgr2=0x7fe0cc1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d0d07640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0cc15b900 0x7fe0cc1510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d0d07640 1 -- 172.21.15.132:0/716977327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0094d0 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d0d07640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 0x7fe0cc157b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009870 tx=0x7fe0bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0c1ffb640 1 -- 172.21.15.132:0/716977327 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc03e040 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0c1ffb640 1 -- 172.21.15.132:0/716977327 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc039c90 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d376c640 1 -- 172.21.15.132:0/716977327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc155510 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0c1ffb640 1 -- 172.21.15.132:0/716977327 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc004030 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.696+0000 7fe0d376c640 1 -- 172.21.15.132:0/716977327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc154e50 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.697+0000 7fe0d376c640 1 -- 172.21.15.132:0/716977327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc1550a0 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.698+0000 7fe0c1ffb640 1 -- 172.21.15.132:0/716977327 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fe0bc0041b0 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.698+0000 7fe0c1ffb640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fe0b006b3b0 0x7fe0b006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:11.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.698+0000 7fe0d1508640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fe0b006b3b0 0x7fe0b006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:11.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.698+0000 7fe0c1ffb640 1 -- 172.21.15.132:0/716977327 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0bc0ac190 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.699+0000 7fe0d1508640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fe0b006b3b0 0x7fe0b006d870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0b06c0 tx=0x7fe0c8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:11.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.702+0000 7fe0c1ffb640 1 -- 172.21.15.132:0/716977327 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe0bc076ea0 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.946+0000 7fe0d376c640 1 -- 172.21.15.132:0/716977327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0cc155370 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.946+0000 7fe0c1ffb640 1 -- 172.21.15.132:0/716977327 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0cc155370 con 0x7fe0cc15e7c0 2024-03-16T17:48:11.950 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.948+0000 7fe0d376c640 1 -- 172.21.15.132:0/716977327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fe0b006b3b0 msgr2=0x7fe0b006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.948+0000 7fe0d376c640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fe0b006b3b0 0x7fe0b006d870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0b06c0 tx=0x7fe0c8009190 comp rx=0 tx=0).stop 2024-03-16T17:48:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.948+0000 7fe0d376c640 1 -- 172.21.15.132:0/716977327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 msgr2=0x7fe0cc157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:11.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.948+0000 7fe0d376c640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 0x7fe0cc157b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009870 tx=0x7fe0bc004730 comp rx=0 tx=0).stop 2024-03-16T17:48:11.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.948+0000 7fe0d376c640 1 -- 172.21.15.132:0/716977327 shutdown_connections 2024-03-16T17:48:11.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.948+0000 7fe0d376c640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fe0b006b3b0 0x7fe0b006d870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.948+0000 7fe0d376c640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0cc15ec20 0x7fe0cc150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.948+0000 7fe0d376c640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0cc15e7c0 0x7fe0cc157b10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.948+0000 7fe0d376c640 1 --2- 172.21.15.132:0/716977327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0cc15b900 0x7fe0cc1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:11.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.948+0000 7fe0d376c640 1 -- 172.21.15.132:0/716977327 >> 172.21.15.132:0/716977327 conn(0x7fe0cc06bff0 msgr2=0x7fe0cc159190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:11.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.949+0000 7fe0d376c640 1 -- 172.21.15.132:0/716977327 shutdown_connections 2024-03-16T17:48:11.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:11.949+0000 7fe0d376c640 1 -- 172.21.15.132:0/716977327 wait complete. 2024-03-16T17:48:11.963 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:12.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.063+0000 7f22726a4640 1 Processor -- start 2024-03-16T17:48:12.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.063+0000 7f22726a4640 1 -- start start 2024-03-16T17:48:12.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.064+0000 7f22726a4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f226c15c4f0 0x7f226c0d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.064+0000 7f22726a4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c0ce2e0 con 0x7f226c15d640 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.064+0000 7f22726a4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c0ceb80 con 0x7f226c0b30d0 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.064+0000 7f22726a4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0cf720 con 0x7f226c15c4f0 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.064+0000 7f2270c41640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f226c15d640 0x7f226c15dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48182/0 (socket says 172.21.15.132:48182) 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.064+0000 7f2270c41640 1 -- 172.21.15.132:0/3606742745 learned_addr learned my addr 172.21.15.132:0/3606742745 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226bfff640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f226c15c4f0 0x7f226c0d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432075253 0 0) 0x7f226c0ce2e0 con 0x7f226c15d640 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2254003520 con 0x7f226c15d640 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399973734 0 0) 0x7f226c0ceb80 con 0x7f226c0b30d0 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f226c0ce2e0 con 0x7f226c0b30d0 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2253460729 0 0) 0x7f2254003520 con 0x7f226c15d640 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f226c15c4f0 msgr2=0x7f226c0d1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f226c15c4f0 0x7f226c0d1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 >> v1:172.21.15.194:6789/0 conn(0x7f226c0b30d0 legacy=0x7f226c0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c0d2610 con 0x7f226c15d640 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f22640019f0 con 0x7f226c15d640 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 >> v1:172.21.15.132:6789/0 conn(0x7f226c15d640 legacy=0x7f226c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f226c15c4f0 0x7f2254003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540040e0 0x7f22540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254004d00 0x7f2254005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0cf720 con 0x7f22540040e0 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225400bac0 con 0x7f2254004d00 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225400bc80 con 0x7f226c15c4f0 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226b7fe640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540040e0 0x7f22540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226bfff640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f226c15c4f0 0x7f2254003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f2270c41640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254004d00 0x7f2254005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226b7fe640 1 -- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f226c15c4f0 msgr2=0x7f2254003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226b7fe640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f226c15c4f0 0x7f2254003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226b7fe640 1 -- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254004d00 msgr2=0x7f2254005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226b7fe640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2254004d00 0x7f2254005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.065+0000 7f226b7fe640 1 -- 172.21.15.132:0/3606742745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254003520 con 0x7f22540040e0 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.066+0000 7f226b7fe640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540040e0 0x7f22540047c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f22600018d0 tx=0x7f22540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7383de5bdf26635 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.066+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226002f050 con 0x7f22540040e0 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.066+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600052d0 con 0x7f22540040e0 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.066+0000 7f226affd640 1 -- 172.21.15.132:0/3606742745 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260003810 con 0x7f22540040e0 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.067+0000 7f22726a4640 1 -- 172.21.15.132:0/3606742745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540040e0 msgr2=0x7f22540047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.067+0000 7f22726a4640 1 --2- 172.21.15.132:0/3606742745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22540040e0 0x7f22540047c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f22600018d0 tx=0x7f22540057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.067+0000 7f2270c41640 1 -- 172.21.15.132:0/3606742745 reap_dead start 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.067+0000 7f22726a4640 1 -- 172.21.15.132:0/3606742745 shutdown_connections 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.067+0000 7f22726a4640 1 -- 172.21.15.132:0/3606742745 >> 172.21.15.132:0/3606742745 conn(0x7f226c073220 msgr2=0x7f226c09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:12.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.067+0000 7f22726a4640 1 -- 172.21.15.132:0/3606742745 shutdown_connections 2024-03-16T17:48:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.067+0000 7f22726a4640 1 -- 172.21.15.132:0/3606742745 wait complete. 2024-03-16T17:48:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.069+0000 7f22726a4640 1 Processor -- start 2024-03-16T17:48:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.069+0000 7f22726a4640 1 -- start start 2024-03-16T17:48:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.070+0000 7f22726a4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22540040e0 0x7f226c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.070+0000 7f22726a4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226c09f800 0x7f226c09c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.070+0000 7f22726a4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f226c09bc00 0x7f226c09c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.070+0000 7f22726a4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c09c5f0 con 0x7f226c09bc00 2024-03-16T17:48:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.070+0000 7f22726a4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c09e130 con 0x7f226c09f800 2024-03-16T17:48:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.070+0000 7f22726a4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c1f1940 con 0x7f22540040e0 2024-03-16T17:48:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.070+0000 7f2270c41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f226c09bc00 0x7f226c09c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.070+0000 7f2270c41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f226c09bc00 0x7f226c09c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40892/0 (socket says 172.21.15.132:40892) 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.070+0000 7f2270c41640 1 -- 172.21.15.132:0/1906755636 learned_addr learned my addr 172.21.15.132:0/1906755636 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.070+0000 7f226b7fe640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226c09f800 0x7f226c09c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f226bfff640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22540040e0 0x7f226c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f2270c41640 1 -- 172.21.15.132:0/1906755636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22540040e0 msgr2=0x7f226c151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f2270c41640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22540040e0 0x7f226c151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f2270c41640 1 -- 172.21.15.132:0/1906755636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226c09f800 msgr2=0x7f226c09c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f2270c41640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226c09f800 0x7f226c09c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f2270c41640 1 -- 172.21.15.132:0/1906755636 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c09d250 con 0x7f226c09bc00 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f226b7fe640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226c09f800 0x7f226c09c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f2270c41640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f226c09bc00 0x7f226c09c0b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f226c0cdf40 tx=0x7f2264007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f2268ff9640 1 -- 172.21.15.132:0/1906755636 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226400aa90 con 0x7f226c09bc00 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f2268ff9640 1 -- 172.21.15.132:0/1906755636 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226400abf0 con 0x7f226c09bc00 2024-03-16T17:48:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f22726a4640 1 -- 172.21.15.132:0/1906755636 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c1f1bc0 con 0x7f226c09bc00 2024-03-16T17:48:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f2268ff9640 1 -- 172.21.15.132:0/1906755636 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22640133f0 con 0x7f226c09bc00 2024-03-16T17:48:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.071+0000 7f22726a4640 1 -- 172.21.15.132:0/1906755636 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c1f2180 con 0x7f226c09bc00 2024-03-16T17:48:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.072+0000 7f22726a4640 1 -- 172.21.15.132:0/1906755636 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c1f2370 con 0x7f226c09bc00 2024-03-16T17:48:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.072+0000 7f2268ff9640 1 -- 172.21.15.132:0/1906755636 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f2264013550 con 0x7f226c09bc00 2024-03-16T17:48:12.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.073+0000 7f2268ff9640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f225806b3e0 0x7f225806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.073+0000 7f2268ff9640 1 -- 172.21.15.132:0/1906755636 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f226408a4e0 con 0x7f226c09bc00 2024-03-16T17:48:12.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.073+0000 7f226bfff640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f225806b3e0 0x7f225806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.073+0000 7f226bfff640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f225806b3e0 0x7f225806d8a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f225c009900 tx=0x7f225c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.077+0000 7f2268ff9640 1 -- 172.21.15.132:0/1906755636 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f22640551d0 con 0x7f226c09bc00 2024-03-16T17:48:12.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.254+0000 7f22726a4640 1 -- 172.21.15.132:0/1906755636 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f226c09fe70 con 0x7f226c09bc00 2024-03-16T17:48:12.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.255+0000 7f2268ff9640 1 -- 172.21.15.132:0/1906755636 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2264058890 con 0x7f226c09bc00 2024-03-16T17:48:12.259 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 -- 172.21.15.132:0/1906755636 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f225806b3e0 msgr2=0x7f225806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f225806b3e0 0x7f225806d8a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f225c009900 tx=0x7f225c008040 comp rx=0 tx=0).stop 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 -- 172.21.15.132:0/1906755636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f226c09bc00 msgr2=0x7f226c09c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f226c09bc00 0x7f226c09c0b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f226c0cdf40 tx=0x7f2264007bd0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 -- 172.21.15.132:0/1906755636 shutdown_connections 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f225806b3e0 0x7f225806d8a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f226c09bc00 0x7f226c09c0b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226c09f800 0x7f226c09c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 --2- 172.21.15.132:0/1906755636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22540040e0 0x7f226c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 -- 172.21.15.132:0/1906755636 >> 172.21.15.132:0/1906755636 conn(0x7f226c073220 msgr2=0x7f226c0d1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:12.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 -- 172.21.15.132:0/1906755636 shutdown_connections 2024-03-16T17:48:12.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.257+0000 7f22726a4640 1 -- 172.21.15.132:0/1906755636 wait complete. 2024-03-16T17:48:12.275 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:12.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.375+0000 7f5e2d581640 1 Processor -- start 2024-03-16T17:48:12.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.375+0000 7f5e2d581640 1 -- start start 2024-03-16T17:48:12.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.376+0000 7f5e2d581640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e2806b5f0 0x7f5e28166cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.376+0000 7f5e2d581640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e280cd800 con 0x7f5e28159b50 2024-03-16T17:48:12.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.376+0000 7f5e2d581640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e280b5f60 con 0x7f5e280b57c0 2024-03-16T17:48:12.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.376+0000 7f5e2d581640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2815c2e0 con 0x7f5e2806b5f0 2024-03-16T17:48:12.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.376+0000 7f5e277fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e2806b5f0 0x7f5e28166cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.376+0000 7f5e277fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e2806b5f0 0x7f5e28166cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40900/0 (socket says 172.21.15.132:40900) 2024-03-16T17:48:12.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.376+0000 7f5e277fe640 1 -- 172.21.15.132:0/1256681272 learned_addr learned my addr 172.21.15.132:0/1256681272 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:12.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.376+0000 7f5e26ffd640 1 --1- 172.21.15.132:0/1256681272 >> v1:172.21.15.132:6789/0 conn(0x7f5e28159b50 0x7f5e28160330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48196/0 (socket says 172.21.15.132:48196) 2024-03-16T17:48:12.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.377+0000 7f5e277fe640 1 -- 172.21.15.132:0/1256681272 >> v1:172.21.15.194:6789/0 conn(0x7f5e280b57c0 legacy=0x7f5e2806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:12.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.377+0000 7f5e277fe640 1 -- 172.21.15.132:0/1256681272 >> v1:172.21.15.132:6789/0 conn(0x7f5e28159b50 legacy=0x7f5e28160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.377+0000 7f5e267fc640 1 -- 172.21.15.132:0/1256681272 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929997855 0 0) 0x7f5e280cd800 con 0x7f5e28159b50 2024-03-16T17:48:12.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.377+0000 7f5e277fe640 1 -- 172.21.15.132:0/1256681272 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e280b5c80 con 0x7f5e2806b5f0 2024-03-16T17:48:12.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.378+0000 7f5e277fe640 1 --2- 172.21.15.132:0/1256681272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e2806b5f0 0x7f5e28166cb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009e50 tx=0x7f5e2002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26abbb670e8a8bbd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:12.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.378+0000 7f5e267fc640 1 -- 172.21.15.132:0/1256681272 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2002cb20 con 0x7f5e2806b5f0 2024-03-16T17:48:12.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.378+0000 7f5e267fc640 1 -- 172.21.15.132:0/1256681272 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2002cc80 con 0x7f5e2806b5f0 2024-03-16T17:48:12.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.378+0000 7f5e267fc640 1 -- 172.21.15.132:0/1256681272 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e200343f0 con 0x7f5e2806b5f0 2024-03-16T17:48:12.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.379+0000 7f5e2d581640 1 -- 172.21.15.132:0/1256681272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e2806b5f0 msgr2=0x7f5e28166cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.379+0000 7f5e2d581640 1 --2- 172.21.15.132:0/1256681272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e2806b5f0 0x7f5e28166cb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009e50 tx=0x7f5e2002bf80 comp rx=0 tx=0).stop 2024-03-16T17:48:12.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.379+0000 7f5e2d581640 1 -- 172.21.15.132:0/1256681272 shutdown_connections 2024-03-16T17:48:12.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.379+0000 7f5e2d581640 1 --2- 172.21.15.132:0/1256681272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e2806b5f0 0x7f5e28166cb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.379+0000 7f5e2d581640 1 -- 172.21.15.132:0/1256681272 >> 172.21.15.132:0/1256681272 conn(0x7f5e2806bff0 msgr2=0x7f5e2806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:12.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.379+0000 7f5e2d581640 1 -- 172.21.15.132:0/1256681272 shutdown_connections 2024-03-16T17:48:12.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.379+0000 7f5e2d581640 1 -- 172.21.15.132:0/1256681272 wait complete. 2024-03-16T17:48:12.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.380+0000 7f5e2d581640 1 Processor -- start 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.380+0000 7f5e2d581640 1 -- start start 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.380+0000 7f5e2d581640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e2806b5f0 0x7f5e2813e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.380+0000 7f5e2d581640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e280b57c0 0x7f5e281f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.380+0000 7f5e2d581640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e28159b50 0x7f5e2815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.380+0000 7f5e2d581640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e28140fa0 con 0x7f5e28159b50 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e2d581640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e28141180 con 0x7f5e280b57c0 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e2d581640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e28141460 con 0x7f5e2806b5f0 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e277fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e28159b50 0x7f5e2815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e277fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e28159b50 0x7f5e2815d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40910/0 (socket says 172.21.15.132:40910) 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e277fe640 1 -- 172.21.15.132:0/4112030779 learned_addr learned my addr 172.21.15.132:0/4112030779 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:12.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e1ffff640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e280b57c0 0x7f5e281f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e26ffd640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e2806b5f0 0x7f5e2813e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e277fe640 1 -- 172.21.15.132:0/4112030779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e2806b5f0 msgr2=0x7f5e2813e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e277fe640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e2806b5f0 0x7f5e2813e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e277fe640 1 -- 172.21.15.132:0/4112030779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e280b57c0 msgr2=0x7f5e281f2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e277fe640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e280b57c0 0x7f5e281f2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e277fe640 1 -- 172.21.15.132:0/4112030779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20009b30 con 0x7f5e28159b50 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e277fe640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e28159b50 0x7f5e2815d3d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009e50 tx=0x7f5e20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/4112030779 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20009510 con 0x7f5e28159b50 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/4112030779 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2003e450 con 0x7f5e28159b50 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e2d581640 1 -- 172.21.15.132:0/4112030779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e28141740 con 0x7f5e28159b50 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/4112030779 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2003e600 con 0x7f5e28159b50 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.381+0000 7f5e2d581640 1 -- 172.21.15.132:0/4112030779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e28141d00 con 0x7f5e28159b50 2024-03-16T17:48:12.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.382+0000 7f5e2d581640 1 -- 172.21.15.132:0/4112030779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e28141ef0 con 0x7f5e28159b50 2024-03-16T17:48:12.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.383+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/4112030779 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f5e2003e760 con 0x7f5e28159b50 2024-03-16T17:48:12.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.383+0000 7f5e1f7fe640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5e0806b3b0 0x7f5e0806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.384+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/4112030779 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e200ac440 con 0x7f5e28159b50 2024-03-16T17:48:12.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.384+0000 7f5e26ffd640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5e0806b3b0 0x7f5e0806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.384+0000 7f5e26ffd640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5e0806b3b0 0x7f5e0806d870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e18007fd0 tx=0x7f5e18007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:12.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.388+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/4112030779 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5e20077160 con 0x7f5e28159b50 2024-03-16T17:48:12.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.565+0000 7f5e2d581640 1 -- 172.21.15.132:0/4112030779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e280734e0 con 0x7f5e28159b50 2024-03-16T17:48:12.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.566+0000 7f5e1f7fe640 1 -- 172.21.15.132:0/4112030779 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e2007a820 con 0x7f5e28159b50 2024-03-16T17:48:12.570 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:12.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 -- 172.21.15.132:0/4112030779 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5e0806b3b0 msgr2=0x7f5e0806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5e0806b3b0 0x7f5e0806d870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5e18007fd0 tx=0x7f5e18007c20 comp rx=0 tx=0).stop 2024-03-16T17:48:12.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 -- 172.21.15.132:0/4112030779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e28159b50 msgr2=0x7f5e2815d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e28159b50 0x7f5e2815d3d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009e50 tx=0x7f5e20004a40 comp rx=0 tx=0).stop 2024-03-16T17:48:12.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 -- 172.21.15.132:0/4112030779 shutdown_connections 2024-03-16T17:48:12.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5e0806b3b0 0x7f5e0806d870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e28159b50 0x7f5e2815d3d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e280b57c0 0x7f5e281f2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 --2- 172.21.15.132:0/4112030779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e2806b5f0 0x7f5e2813e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 -- 172.21.15.132:0/4112030779 >> 172.21.15.132:0/4112030779 conn(0x7f5e2806bff0 msgr2=0x7f5e2815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:12.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 -- 172.21.15.132:0/4112030779 shutdown_connections 2024-03-16T17:48:12.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.568+0000 7f5e2d581640 1 -- 172.21.15.132:0/4112030779 wait complete. 2024-03-16T17:48:12.583 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:12.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.680+0000 7f6e6a52c640 1 Processor -- start 2024-03-16T17:48:12.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.680+0000 7f6e6a52c640 1 -- start start 2024-03-16T17:48:12.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e6a52c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6e6406bff0 0x7f6e6406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e6a52c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e6415e910 0x7f6e6415eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e6a52c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e640cda10 con 0x7f6e640cdea0 2024-03-16T17:48:12.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e6a52c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e640b59b0 con 0x7f6e6406bff0 2024-03-16T17:48:12.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e6a52c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6406e160 con 0x7f6e6415e910 2024-03-16T17:48:12.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e63fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6e6406bff0 0x7f6e6406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e63fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6e6406bff0 0x7f6e6406c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:33036/0 (socket says 172.21.15.132:33036) 2024-03-16T17:48:12.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e63fff640 1 -- 172.21.15.132:0/3896226492 learned_addr learned my addr 172.21.15.132:0/3896226492 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:12.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e68ac9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e6415e910 0x7f6e6415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e637fe640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f6e640cdea0 0x7f6e6406da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:46628/0 (socket says 172.21.15.132:46628) 2024-03-16T17:48:12.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e63fff640 1 -- 172.21.15.132:0/3896226492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e6415e910 msgr2=0x7f6e6415eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e63fff640 1 --2- 172.21.15.132:0/3896226492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e6415e910 0x7f6e6415eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e63fff640 1 -- 172.21.15.132:0/3896226492 >> v1:172.21.15.194:6789/0 conn(0x7f6e640cdea0 legacy=0x7f6e6406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e63fff640 1 -- 172.21.15.132:0/3896226492 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e640cd6e0 con 0x7f6e6406bff0 2024-03-16T17:48:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.682+0000 7f6e68ac9640 1 --2- 172.21.15.132:0/3896226492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e6415e910 0x7f6e6415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:12.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.683+0000 7f6e63fff640 1 --2- 172.21.15.132:0/3896226492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6406bff0 0x7f6e6406c3d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6e580098a0 tx=0x7f6e5802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85f83a683fa66f06 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:12.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.683+0000 7f6e62ffd640 1 -- 172.21.15.132:0/3896226492 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58030840 con 0x7f6e6406bff0 2024-03-16T17:48:12.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.683+0000 7f6e62ffd640 1 -- 172.21.15.132:0/3896226492 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e580309a0 con 0x7f6e6406bff0 2024-03-16T17:48:12.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.683+0000 7f6e62ffd640 1 -- 172.21.15.132:0/3896226492 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58030d30 con 0x7f6e6406bff0 2024-03-16T17:48:12.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.684+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3896226492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6406bff0 msgr2=0x7f6e6406c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.684+0000 7f6e6a52c640 1 --2- 172.21.15.132:0/3896226492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6406bff0 0x7f6e6406c3d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6e580098a0 tx=0x7f6e5802b980 comp rx=0 tx=0).stop 2024-03-16T17:48:12.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.684+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3896226492 shutdown_connections 2024-03-16T17:48:12.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.684+0000 7f6e6a52c640 1 --2- 172.21.15.132:0/3896226492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e6415e910 0x7f6e6415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.684+0000 7f6e6a52c640 1 --2- 172.21.15.132:0/3896226492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6406bff0 0x7f6e6406c3d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.684+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3896226492 >> 172.21.15.132:0/3896226492 conn(0x7f6e640d0bb0 msgr2=0x7f6e640d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.684+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3896226492 shutdown_connections 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.684+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3896226492 wait complete. 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.685+0000 7f6e6a52c640 1 Processor -- start 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.685+0000 7f6e6a52c640 1 -- start start 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e6a52c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6406bff0 0x7f6e6409af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e6a52c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e640cdea0 0x7f6e641efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e6a52c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6415e910 0x7f6e641539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e6a52c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6409dbe0 con 0x7f6e6406bff0 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e6a52c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6409b550 con 0x7f6e6415e910 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e6a52c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6409b830 con 0x7f6e640cdea0 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e63fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6406bff0 0x7f6e6409af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e63fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6406bff0 0x7f6e6409af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40924/0 (socket says 172.21.15.132:40924) 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e63fff640 1 -- 172.21.15.132:0/3892690212 learned_addr learned my addr 172.21.15.132:0/3892690212 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e68ac9640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6415e910 0x7f6e641539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e637fe640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e640cdea0 0x7f6e641efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e63fff640 1 -- 172.21.15.132:0/3892690212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e640cdea0 msgr2=0x7f6e641efae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e63fff640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e640cdea0 0x7f6e641efae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e63fff640 1 -- 172.21.15.132:0/3892690212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6415e910 msgr2=0x7f6e641539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e63fff640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6415e910 0x7f6e641539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e63fff640 1 -- 172.21.15.132:0/3892690212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c009a70 con 0x7f6e6406bff0 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.686+0000 7f6e68ac9640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6415e910 0x7f6e641539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.687+0000 7f6e63fff640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6406bff0 0x7f6e6409af70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6e58000c00 tx=0x7f6e58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.687+0000 7f6e60ff9640 1 -- 172.21.15.132:0/3892690212 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58039c90 con 0x7f6e6406bff0 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.687+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3892690212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e580094d0 con 0x7f6e6406bff0 2024-03-16T17:48:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.687+0000 7f6e60ff9640 1 -- 172.21.15.132:0/3892690212 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e58039df0 con 0x7f6e6406bff0 2024-03-16T17:48:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.687+0000 7f6e60ff9640 1 -- 172.21.15.132:0/3892690212 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58043640 con 0x7f6e6406bff0 2024-03-16T17:48:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.687+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3892690212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6409bdf0 con 0x7f6e6406bff0 2024-03-16T17:48:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.688+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3892690212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e64068450 con 0x7f6e6406bff0 2024-03-16T17:48:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.688+0000 7f6e60ff9640 1 -- 172.21.15.132:0/3892690212 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f6e580437a0 con 0x7f6e6406bff0 2024-03-16T17:48:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.689+0000 7f6e60ff9640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e5006b3b0 0x7f6e5006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.689+0000 7f6e637fe640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e5006b3b0 0x7f6e5006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.689+0000 7f6e60ff9640 1 -- 172.21.15.132:0/3892690212 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e5803e070 con 0x7f6e6406bff0 2024-03-16T17:48:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.689+0000 7f6e637fe640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e5006b3b0 0x7f6e5006d870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e54000f60 tx=0x7f6e54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.693+0000 7f6e60ff9640 1 -- 172.21.15.132:0/3892690212 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6e58077900 con 0x7f6e6406bff0 2024-03-16T17:48:12.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.872+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3892690212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e6404f2c0 con 0x7f6e6406bff0 2024-03-16T17:48:12.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.873+0000 7f6e60ff9640 1 -- 172.21.15.132:0/3892690212 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f6e5807afc0 con 0x7f6e6406bff0 2024-03-16T17:48:12.876 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:12.877 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3892690212 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e5006b3b0 msgr2=0x7f6e5006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e5006b3b0 0x7f6e5006d870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e54000f60 tx=0x7f6e54009040 comp rx=0 tx=0).stop 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3892690212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6406bff0 msgr2=0x7f6e6409af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6406bff0 0x7f6e6409af70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6e58000c00 tx=0x7f6e58004730 comp rx=0 tx=0).stop 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3892690212 shutdown_connections 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e5006b3b0 0x7f6e5006d870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6415e910 0x7f6e641539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e640cdea0 0x7f6e641efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 --2- 172.21.15.132:0/3892690212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6406bff0 0x7f6e6409af70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3892690212 >> 172.21.15.132:0/3892690212 conn(0x7f6e640d0bb0 msgr2=0x7f6e640cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3892690212 shutdown_connections 2024-03-16T17:48:12.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.875+0000 7f6e6a52c640 1 -- 172.21.15.132:0/3892690212 wait complete. 2024-03-16T17:48:12.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:12.895 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:12.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.995+0000 7f3133617640 1 Processor -- start 2024-03-16T17:48:12.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.995+0000 7f3133617640 1 -- start start 2024-03-16T17:48:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.996+0000 7f3133617640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f312c145520 0x7f312c0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.996+0000 7f3133617640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c06aee0 0x7f312c06b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.996+0000 7f3133617640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c0cf080 con 0x7f312c06dbf0 2024-03-16T17:48:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.996+0000 7f3133617640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0d0dd0 con 0x7f312c145520 2024-03-16T17:48:13.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.996+0000 7f3133617640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c06b8b0 con 0x7f312c06aee0 2024-03-16T17:48:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.997+0000 7f31313b3640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f312c145520 0x7f312c0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.997+0000 7f3131bb4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c06aee0 0x7f312c06b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.997+0000 7f31313b3640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f312c145520 0x7f312c0cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:33056/0 (socket says 172.21.15.132:33056) 2024-03-16T17:48:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.997+0000 7f3131bb4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c06aee0 0x7f312c06b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:52166/0 (socket says 172.21.15.132:52166) 2024-03-16T17:48:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.997+0000 7f31313b3640 1 -- 172.21.15.132:0/215468545 learned_addr learned my addr 172.21.15.132:0/215468545 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.997+0000 7f31313b3640 1 -- 172.21.15.132:0/215468545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c06aee0 msgr2=0x7f312c06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.997+0000 7f31313b3640 1 --2- 172.21.15.132:0/215468545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c06aee0 0x7f312c06b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.997+0000 7f31313b3640 1 -- 172.21.15.132:0/215468545 >> v1:172.21.15.194:6789/0 conn(0x7f312c06dbf0 legacy=0x7f312c0d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.997+0000 7f31313b3640 1 -- 172.21.15.132:0/215468545 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c0d0fc0 con 0x7f312c145520 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.998+0000 7f31313b3640 1 --2- 172.21.15.132:0/215468545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c145520 0x7f312c0cd700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f31280098a0 tx=0x7f312802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0a9078e6fbd91a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.998+0000 7f3123fff640 1 -- 172.21.15.132:0/215468545 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128030840 con 0x7f312c145520 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.998+0000 7f3123fff640 1 -- 172.21.15.132:0/215468545 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31280309a0 con 0x7f312c145520 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.998+0000 7f3123fff640 1 -- 172.21.15.132:0/215468545 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128030d30 con 0x7f312c145520 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.998+0000 7f3133617640 1 -- 172.21.15.132:0/215468545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c145520 msgr2=0x7f312c0cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.998+0000 7f3133617640 1 --2- 172.21.15.132:0/215468545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c145520 0x7f312c0cd700 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f31280098a0 tx=0x7f312802b980 comp rx=0 tx=0).stop 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.998+0000 7f3133617640 1 -- 172.21.15.132:0/215468545 shutdown_connections 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.998+0000 7f3133617640 1 --2- 172.21.15.132:0/215468545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c06aee0 0x7f312c06b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.998+0000 7f3133617640 1 --2- 172.21.15.132:0/215468545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c145520 0x7f312c0cd700 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.998+0000 7f3133617640 1 -- 172.21.15.132:0/215468545 >> 172.21.15.132:0/215468545 conn(0x7f312c06bff0 msgr2=0x7f312c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:13.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.999+0000 7f3133617640 1 -- 172.21.15.132:0/215468545 shutdown_connections 2024-03-16T17:48:13.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:12.999+0000 7f3133617640 1 -- 172.21.15.132:0/215468545 wait complete. 2024-03-16T17:48:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.000+0000 7f3133617640 1 Processor -- start 2024-03-16T17:48:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.000+0000 7f3133617640 1 -- start start 2024-03-16T17:48:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.000+0000 7f3133617640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c06aee0 0x7f312c1f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.000+0000 7f3133617640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f312c06dbf0 0x7f312c1f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.000+0000 7f3133617640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c145520 0x7f312c1f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.000+0000 7f3133617640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c15a110 con 0x7f312c06dbf0 2024-03-16T17:48:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.000+0000 7f3133617640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c159590 con 0x7f312c06aee0 2024-03-16T17:48:13.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.000+0000 7f3133617640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c159870 con 0x7f312c145520 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.000+0000 7f3130bb2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f312c06dbf0 0x7f312c1f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3130bb2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f312c06dbf0 0x7f312c1f4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40926/0 (socket says 172.21.15.132:40926) 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3130bb2640 1 -- 172.21.15.132:0/1694677081 learned_addr learned my addr 172.21.15.132:0/1694677081 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f31313b3640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c06aee0 0x7f312c1f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3131bb4640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c145520 0x7f312c1f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3130bb2640 1 -- 172.21.15.132:0/1694677081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c145520 msgr2=0x7f312c1f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3130bb2640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c145520 0x7f312c1f4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3130bb2640 1 -- 172.21.15.132:0/1694677081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c06aee0 msgr2=0x7f312c1f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3130bb2640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c06aee0 0x7f312c1f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3130bb2640 1 -- 172.21.15.132:0/1694677081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31280094d0 con 0x7f312c06dbf0 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3130bb2640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f312c06dbf0 0x7f312c1f4350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f311c00c430 tx=0x7f311c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3121ffb640 1 -- 172.21.15.132:0/1694677081 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c0052d0 con 0x7f312c06dbf0 2024-03-16T17:48:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3121ffb640 1 -- 172.21.15.132:0/1694677081 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311c005430 con 0x7f312c06dbf0 2024-03-16T17:48:13.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3133617640 1 -- 172.21.15.132:0/1694677081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c159b50 con 0x7f312c06dbf0 2024-03-16T17:48:13.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3121ffb640 1 -- 172.21.15.132:0/1694677081 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c003850 con 0x7f312c06dbf0 2024-03-16T17:48:13.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.001+0000 7f3133617640 1 -- 172.21.15.132:0/1694677081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c144c40 con 0x7f312c06dbf0 2024-03-16T17:48:13.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.003+0000 7f3133617640 1 -- 172.21.15.132:0/1694677081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c068450 con 0x7f312c06dbf0 2024-03-16T17:48:13.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.004+0000 7f3121ffb640 1 -- 172.21.15.132:0/1694677081 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f311c0039b0 con 0x7f312c06dbf0 2024-03-16T17:48:13.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.004+0000 7f3121ffb640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f311006b3b0 0x7f311006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.004+0000 7f3121ffb640 1 -- 172.21.15.132:0/1694677081 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f311c0890a0 con 0x7f312c06dbf0 2024-03-16T17:48:13.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.004+0000 7f31313b3640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f311006b3b0 0x7f311006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.004+0000 7f31313b3640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f311006b3b0 0x7f311006d870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3128036000 tx=0x7f3128008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.008+0000 7f3121ffb640 1 -- 172.21.15.132:0/1694677081 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f311c053e40 con 0x7f312c06dbf0 2024-03-16T17:48:13.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.182+0000 7f3133617640 1 -- 172.21.15.132:0/1694677081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f312c073580 con 0x7f312c06dbf0 2024-03-16T17:48:13.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.182+0000 7f3121ffb640 1 -- 172.21.15.132:0/1694677081 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f311c001120 con 0x7f312c06dbf0 2024-03-16T17:48:13.186 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:13.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.184+0000 7f3133617640 1 -- 172.21.15.132:0/1694677081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f311006b3b0 msgr2=0x7f311006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.184+0000 7f3133617640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f311006b3b0 0x7f311006d870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3128036000 tx=0x7f3128008030 comp rx=0 tx=0).stop 2024-03-16T17:48:13.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.184+0000 7f3133617640 1 -- 172.21.15.132:0/1694677081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f312c06dbf0 msgr2=0x7f312c1f4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.184+0000 7f3133617640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f312c06dbf0 0x7f312c1f4350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f311c00c430 tx=0x7f311c00c8f0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.184+0000 7f3133617640 1 -- 172.21.15.132:0/1694677081 shutdown_connections 2024-03-16T17:48:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.184+0000 7f3133617640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f311006b3b0 0x7f311006d870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.184+0000 7f3133617640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f312c145520 0x7f312c1f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.184+0000 7f3133617640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f312c06dbf0 0x7f312c1f4350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.184+0000 7f3133617640 1 --2- 172.21.15.132:0/1694677081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f312c06aee0 0x7f312c1f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.185+0000 7f3133617640 1 -- 172.21.15.132:0/1694677081 >> 172.21.15.132:0/1694677081 conn(0x7f312c06bff0 msgr2=0x7f312c0b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.185+0000 7f3133617640 1 -- 172.21.15.132:0/1694677081 shutdown_connections 2024-03-16T17:48:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.185+0000 7f3133617640 1 -- 172.21.15.132:0/1694677081 wait complete. 2024-03-16T17:48:13.199 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:13.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.303+0000 7fdf0b6cd640 1 Processor -- start 2024-03-16T17:48:13.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.303+0000 7fdf0b6cd640 1 -- start start 2024-03-16T17:48:13.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf0b6cd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf04161760 0x7fdf040b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf0b6cd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdf04161b40 0x7fdf040d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf0b6cd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdf040d49f0 0x7fdf040d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf0b6cd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf040cff20 con 0x7fdf04161b40 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf0b6cd640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf040b5500 con 0x7fdf040d49f0 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf0b6cd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040cf5f0 con 0x7fdf04161760 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf08c68640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdf04161b40 0x7fdf040d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf08c68640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdf04161b40 0x7fdf040d0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40936/0 (socket says 172.21.15.132:40936) 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf08c68640 1 -- 172.21.15.132:0/213605477 learned_addr learned my addr 172.21.15.132:0/213605477 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf09469640 1 --2- 172.21.15.132:0/213605477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf04161760 0x7fdf040b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf09c6a640 1 --2- 172.21.15.132:0/213605477 >> v2:172.21.15.194:3300/0 conn(0x7fdf040d49f0 0x7fdf040d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf08c68640 1 -- 172.21.15.132:0/213605477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf04161760 msgr2=0x7fdf040b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf08c68640 1 --2- 172.21.15.132:0/213605477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf04161760 0x7fdf040b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf08c68640 1 -- 172.21.15.132:0/213605477 >> v2:172.21.15.194:3300/0 conn(0x7fdf040d49f0 msgr2=0x7fdf040d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf08c68640 1 --2- 172.21.15.132:0/213605477 >> v2:172.21.15.194:3300/0 conn(0x7fdf040d49f0 0x7fdf040d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf08c68640 1 -- 172.21.15.132:0/213605477 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf040cf8d0 con 0x7fdf04161b40 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf09c6a640 1 --2- 172.21.15.132:0/213605477 >> v2:172.21.15.194:3300/0 conn(0x7fdf040d49f0 0x7fdf040d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.304+0000 7fdf09469640 1 --2- 172.21.15.132:0/213605477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf04161760 0x7fdf040b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.305+0000 7fdf08c68640 1 --2- 172.21.15.132:0/213605477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161b40 0x7fdf040d0600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf040d1450 tx=0x7fdef402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a663d304add904aa server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.305+0000 7fdefbfff640 1 -- 172.21.15.132:0/213605477 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4031870 con 0x7fdf04161b40 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.305+0000 7fdefbfff640 1 -- 172.21.15.132:0/213605477 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef40319d0 con 0x7fdf04161b40 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.305+0000 7fdefbfff640 1 -- 172.21.15.132:0/213605477 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4031d60 con 0x7fdf04161b40 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.306+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/213605477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161b40 msgr2=0x7fdf040d0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.306+0000 7fdf0b6cd640 1 --2- 172.21.15.132:0/213605477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161b40 0x7fdf040d0600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf040d1450 tx=0x7fdef402b910 comp rx=0 tx=0).stop 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.306+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/213605477 shutdown_connections 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.306+0000 7fdf0b6cd640 1 --2- 172.21.15.132:0/213605477 >> v2:172.21.15.194:3300/0 conn(0x7fdf040d49f0 0x7fdf040d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.306+0000 7fdf0b6cd640 1 --2- 172.21.15.132:0/213605477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161b40 0x7fdf040d0600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.306+0000 7fdf0b6cd640 1 --2- 172.21.15.132:0/213605477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf04161760 0x7fdf040b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.306+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/213605477 >> 172.21.15.132:0/213605477 conn(0x7fdf040d3ed0 msgr2=0x7fdf040d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:13.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.306+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/213605477 shutdown_connections 2024-03-16T17:48:13.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.306+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/213605477 wait complete. 2024-03-16T17:48:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.307+0000 7fdf0b6cd640 1 Processor -- start 2024-03-16T17:48:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.307+0000 7fdf0b6cd640 1 -- start start 2024-03-16T17:48:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf0b6cd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf040d49f0 0x7fdf04158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf0b6cd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161760 0x7fdf040cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf0b6cd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04161b40 0x7fdf04159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf0b6cd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04158120 con 0x7fdf04161760 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf0b6cd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04158390 con 0x7fdf04161b40 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf0b6cd640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04158670 con 0x7fdf040d49f0 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf08c68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161760 0x7fdf040cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf08c68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161760 0x7fdf040cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40950/0 (socket says 172.21.15.132:40950) 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf08c68640 1 -- 172.21.15.132:0/2066441605 learned_addr learned my addr 172.21.15.132:0/2066441605 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf09c6a640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04161b40 0x7fdf04159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf09469640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf040d49f0 0x7fdf04158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf08c68640 1 -- 172.21.15.132:0/2066441605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf040d49f0 msgr2=0x7fdf04158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf08c68640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf040d49f0 0x7fdf04158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf08c68640 1 -- 172.21.15.132:0/2066441605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04161b40 msgr2=0x7fdf04159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf08c68640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04161b40 0x7fdf04159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf08c68640 1 -- 172.21.15.132:0/2066441605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef40094d0 con 0x7fdf04161760 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf09c6a640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04161b40 0x7fdf04159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf09469640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf040d49f0 0x7fdf04158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf08c68640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161760 0x7fdf040cd3e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdef402b950 tx=0x7fdef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdef9ffb640 1 -- 172.21.15.132:0/2066441605 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef403ad30 con 0x7fdf04161760 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdef9ffb640 1 -- 172.21.15.132:0/2066441605 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef40443f0 con 0x7fdf04161760 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdef9ffb640 1 -- 172.21.15.132:0/2066441605 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef40447a0 con 0x7fdf04161760 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.308+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/2066441605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf04158950 con 0x7fdf04161760 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.309+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/2066441605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf04159fc0 con 0x7fdf04161760 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.310+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/2066441605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf04068450 con 0x7fdf04161760 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.310+0000 7fdef9ffb640 1 -- 172.21.15.132:0/2066441605 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fdef404d450 con 0x7fdf04161760 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.310+0000 7fdef9ffb640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdee806b3b0 0x7fdee806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.310+0000 7fdef9ffb640 1 -- 172.21.15.132:0/2066441605 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdef402d040 con 0x7fdf04161760 2024-03-16T17:48:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.310+0000 7fdf09469640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdee806b3b0 0x7fdee806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.311+0000 7fdf09469640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdee806b3b0 0x7fdee806d870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009540 tx=0x7fdefc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.315+0000 7fdef9ffb640 1 -- 172.21.15.132:0/2066441605 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdef40dfe10 con 0x7fdf04161760 2024-03-16T17:48:13.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.493+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/2066441605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf0406bfc0 con 0x7fdf04161760 2024-03-16T17:48:13.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.494+0000 7fdef9ffb640 1 -- 172.21.15.132:0/2066441605 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdef4076f10 con 0x7fdf04161760 2024-03-16T17:48:13.498 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/2066441605 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdee806b3b0 msgr2=0x7fdee806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdee806b3b0 0x7fdee806d870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009540 tx=0x7fdefc00b040 comp rx=0 tx=0).stop 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/2066441605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161760 msgr2=0x7fdf040cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161760 0x7fdf040cd3e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdef402b950 tx=0x7fdef40046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/2066441605 shutdown_connections 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdee806b3b0 0x7fdee806d870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf04161b40 0x7fdf04159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf04161760 0x7fdf040cd3e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 --2- 172.21.15.132:0/2066441605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf040d49f0 0x7fdf04158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/2066441605 >> 172.21.15.132:0/2066441605 conn(0x7fdf040d3ed0 msgr2=0x7fdf0415f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/2066441605 shutdown_connections 2024-03-16T17:48:13.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.496+0000 7fdf0b6cd640 1 -- 172.21.15.132:0/2066441605 wait complete. 2024-03-16T17:48:13.510 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:13.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.611+0000 7f4f68c46640 1 Processor -- start 2024-03-16T17:48:13.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.611+0000 7f4f68c46640 1 -- start start 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.612+0000 7f4f68c46640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4f640b1040 0x7f4f640cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.612+0000 7f4f68c46640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6406bff0 0x7f4f6406c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.612+0000 7f4f68c46640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f640d1980 con 0x7f4f6415f100 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.612+0000 7f4f68c46640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f640d00b0 con 0x7f4f640b1040 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.612+0000 7f4f68c46640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6406c9c0 con 0x7f4f6406bff0 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.612+0000 7f4f61d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4f6415f100 0x7f4f640d1e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48206/0 (socket says 172.21.15.132:48206) 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.612+0000 7f4f61d9b640 1 -- 172.21.15.132:0/2315528677 learned_addr learned my addr 172.21.15.132:0/2315528677 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.612+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105713644 0 0) 0x7f4f640d1980 con 0x7f4f6415f100 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f4c003520 con 0x7f4f6415f100 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6259c640 1 --2- 172.21.15.132:0/2315528677 >> v2:172.21.15.194:3300/0 conn(0x7f4f640b1040 0x7f4f640cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f62d9d640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6406bff0 0x7f4f6406c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2530197202 0 0) 0x7f4f4c003520 con 0x7f4f6415f100 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6406bff0 msgr2=0x7f4f6406c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6406bff0 0x7f4f6406c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 >> v2:172.21.15.194:3300/0 conn(0x7f4f640b1040 msgr2=0x7f4f640cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 --2- 172.21.15.132:0/2315528677 >> v2:172.21.15.194:3300/0 conn(0x7f4f640b1040 0x7f4f640cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640d2520 con 0x7f4f6415f100 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f4f58001670 con 0x7f4f6415f100 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 >> v1:172.21.15.132:6789/0 conn(0x7f4f6415f100 legacy=0x7f4f640d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f4c003970 0x7f4f4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6406bff0 0x7f4f4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f4c004d00 0x7f4f4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640d00b0 con 0x7f4f4c003970 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6406c9c0 con 0x7f4f4c004d00 2024-03-16T17:48:13.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c00b980 con 0x7f4f6406bff0 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6259c640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f4c003970 0x7f4f4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f61d9b640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6406bff0 0x7f4f4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f62d9d640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f4c004d00 0x7f4f4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6259c640 1 -- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6406bff0 msgr2=0x7f4f4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6259c640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6406bff0 0x7f4f4c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6259c640 1 -- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f4c004d00 msgr2=0x7f4f4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6259c640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f4c004d00 0x7f4f4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f6259c640 1 -- 172.21.15.132:0/2315528677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c003520 con 0x7f4f4c003970 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f61d9b640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6406bff0 0x7f4f4c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.613+0000 7f4f62d9d640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f4c004d00 0x7f4f4c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.614+0000 7f4f6259c640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f4c003970 0x7f4f4c003d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00e170 tx=0x7f4f4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7fd649659ce5e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.614+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c02cc20 con 0x7f4f4c003970 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.614+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c00f040 con 0x7f4f4c003970 2024-03-16T17:48:13.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.614+0000 7f4f6159a640 1 -- 172.21.15.132:0/2315528677 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c034440 con 0x7f4f4c003970 2024-03-16T17:48:13.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.615+0000 7f4f68c46640 1 -- 172.21.15.132:0/2315528677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f4c003970 msgr2=0x7f4f4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.615+0000 7f4f68c46640 1 --2- 172.21.15.132:0/2315528677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f4c003970 0x7f4f4c003d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00e170 tx=0x7f4f4c0057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.615+0000 7f4f62d9d640 1 -- 172.21.15.132:0/2315528677 reap_dead start 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.615+0000 7f4f68c46640 1 -- 172.21.15.132:0/2315528677 shutdown_connections 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.615+0000 7f4f68c46640 1 -- 172.21.15.132:0/2315528677 >> 172.21.15.132:0/2315528677 conn(0x7f4f64073220 msgr2=0x7f4f6409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.615+0000 7f4f68c46640 1 -- 172.21.15.132:0/2315528677 shutdown_connections 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.615+0000 7f4f68c46640 1 -- 172.21.15.132:0/2315528677 wait complete. 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.616+0000 7f4f68c46640 1 Processor -- start 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.616+0000 7f4f68c46640 1 -- start start 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f68c46640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f4c003970 0x7f4f6414e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f68c46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6414f0f0 0x7f4f6409cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f68c46640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6414f570 0x7f4f6409d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f68c46640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6409bca0 con 0x7f4f6414f0f0 2024-03-16T17:48:13.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f68c46640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6409bf80 con 0x7f4f4c003970 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f68c46640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6409c260 con 0x7f4f6414f570 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f61d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6414f0f0 0x7f4f6409cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f61d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6414f0f0 0x7f4f6409cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40972/0 (socket says 172.21.15.132:40972) 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f61d9b640 1 -- 172.21.15.132:0/142319608 learned_addr learned my addr 172.21.15.132:0/142319608 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f61d9b640 1 -- 172.21.15.132:0/142319608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6414f570 msgr2=0x7f4f6409d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f61d9b640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6414f570 0x7f4f6409d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f61d9b640 1 -- 172.21.15.132:0/142319608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f4c003970 msgr2=0x7f4f6414e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f61d9b640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f4c003970 0x7f4f6414e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.617+0000 7f4f61d9b640 1 -- 172.21.15.132:0/142319608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6409c540 con 0x7f4f6414f0f0 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.618+0000 7f4f61d9b640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6414f0f0 0x7f4f6409cd40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800e840 tx=0x7f4f5800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.618+0000 7f4f52ffd640 1 -- 172.21.15.132:0/142319608 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800c850 con 0x7f4f6414f0f0 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.618+0000 7f4f52ffd640 1 -- 172.21.15.132:0/142319608 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5800c9b0 con 0x7f4f6414f0f0 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.618+0000 7f4f52ffd640 1 -- 172.21.15.132:0/142319608 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5800cd60 con 0x7f4f6414f0f0 2024-03-16T17:48:13.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.618+0000 7f4f68c46640 1 -- 172.21.15.132:0/142319608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6409c820 con 0x7f4f6414f0f0 2024-03-16T17:48:13.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.618+0000 7f4f68c46640 1 -- 172.21.15.132:0/142319608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6406f4f0 con 0x7f4f6414f0f0 2024-03-16T17:48:13.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.619+0000 7f4f68c46640 1 -- 172.21.15.132:0/142319608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6409ca60 con 0x7f4f6414f0f0 2024-03-16T17:48:13.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.620+0000 7f4f52ffd640 1 -- 172.21.15.132:0/142319608 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4f5801d460 con 0x7f4f6414f0f0 2024-03-16T17:48:13.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.620+0000 7f4f52ffd640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f4406b3e0 0x7f4f4406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.620+0000 7f4f6259c640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f4406b3e0 0x7f4f4406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.620+0000 7f4f52ffd640 1 -- 172.21.15.132:0/142319608 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f58089bf0 con 0x7f4f6414f0f0 2024-03-16T17:48:13.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.621+0000 7f4f6259c640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f4406b3e0 0x7f4f4406d8a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c036000 tx=0x7f4f5c02e070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.625+0000 7f4f52ffd640 1 -- 172.21.15.132:0/142319608 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4f6409ca60 con 0x7f4f6414f0f0 2024-03-16T17:48:13.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.801+0000 7f4f68c46640 1 -- 172.21.15.132:0/142319608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f6409ca60 con 0x7f4f6414f0f0 2024-03-16T17:48:13.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.802+0000 7f4f52ffd640 1 -- 172.21.15.132:0/142319608 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f6409ca60 con 0x7f4f6414f0f0 2024-03-16T17:48:13.806 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 -- 172.21.15.132:0/142319608 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f4406b3e0 msgr2=0x7f4f4406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f4406b3e0 0x7f4f4406d8a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c036000 tx=0x7f4f5c02e070 comp rx=0 tx=0).stop 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 -- 172.21.15.132:0/142319608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6414f0f0 msgr2=0x7f4f6409cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6414f0f0 0x7f4f6409cd40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800e840 tx=0x7f4f5800ed00 comp rx=0 tx=0).stop 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 -- 172.21.15.132:0/142319608 shutdown_connections 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4f4406b3e0 0x7f4f4406d8a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f6414f570 0x7f4f6409d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6414f0f0 0x7f4f6409cd40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 --2- 172.21.15.132:0/142319608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f4c003970 0x7f4f6414e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 -- 172.21.15.132:0/142319608 >> 172.21.15.132:0/142319608 conn(0x7f4f64073220 msgr2=0x7f4f6415d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 -- 172.21.15.132:0/142319608 shutdown_connections 2024-03-16T17:48:13.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.804+0000 7f4f68c46640 1 -- 172.21.15.132:0/142319608 wait complete. 2024-03-16T17:48:13.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:13.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.920+0000 7fafa896c640 1 Processor -- start 2024-03-16T17:48:13.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.920+0000 7fafa896c640 1 -- start start 2024-03-16T17:48:13.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa896c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa40b3560 0x7fafa40cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa896c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa40d0680 con 0x7fafa40d1980 2024-03-16T17:48:13.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa896c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa40d08d0 con 0x7fafa4161540 2024-03-16T17:48:13.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa896c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b4f30 con 0x7fafa40b3560 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa2d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fafa40d1980 0x7fafa40d1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48216/0 (socket says 172.21.15.132:48216) 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa2d9d640 1 -- 172.21.15.132:0/2572058126 learned_addr learned my addr 172.21.15.132:0/2572058126 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7faf9bfff640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa40b3560 0x7fafa40cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094856810 0 0) 0x7fafa40d0680 con 0x7fafa40d1980 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf90003520 con 0x7fafa40d1980 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3899499584 0 0) 0x7faf90003520 con 0x7fafa40d1980 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa40b3560 msgr2=0x7fafa40cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa40b3560 0x7fafa40cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 >> v1:172.21.15.194:6789/0 conn(0x7fafa4161540 legacy=0x7fafa40cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40d0bb0 con 0x7fafa40d1980 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7faf9c0019f0 con 0x7fafa40d1980 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 >> v1:172.21.15.132:6789/0 conn(0x7fafa40d1980 legacy=0x7fafa40d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa40b3560 0x7faf900039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf90003f20 0x7faf900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf90004d00 0x7faf90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b4f30 con 0x7faf90003f20 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.921+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9000ba60 con 0x7faf90004d00 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.922+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9000bc20 con 0x7fafa40b3560 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.922+0000 7faf9bfff640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf90003f20 0x7faf900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.922+0000 7fafa259c640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa40b3560 0x7faf900039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.922+0000 7fafa2d9d640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf90004d00 0x7faf90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.922+0000 7faf9bfff640 1 -- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa40b3560 msgr2=0x7faf900039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.922+0000 7faf9bfff640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa40b3560 0x7faf900039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.922+0000 7faf9bfff640 1 -- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf90004d00 msgr2=0x7faf90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.922+0000 7faf9bfff640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf90004d00 0x7faf90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.922+0000 7faf9bfff640 1 -- 172.21.15.132:0/2572058126 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90003520 con 0x7faf90003f20 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7faf9bfff640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf90003f20 0x7faf900047c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009ac0 tx=0x7faf900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ecfc66f9ab0c96 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c02c6b0 con 0x7faf90003f20 2024-03-16T17:48:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c02c810 con 0x7faf90003f20 2024-03-16T17:48:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7fafa1d9b640 1 -- 172.21.15.132:0/2572058126 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c02cba0 con 0x7faf90003f20 2024-03-16T17:48:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7fafa896c640 1 -- 172.21.15.132:0/2572058126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf90003f20 msgr2=0x7faf900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7fafa896c640 1 --2- 172.21.15.132:0/2572058126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf90003f20 0x7faf900047c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009ac0 tx=0x7faf900057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7fafa2d9d640 1 -- 172.21.15.132:0/2572058126 reap_dead start 2024-03-16T17:48:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7fafa896c640 1 -- 172.21.15.132:0/2572058126 shutdown_connections 2024-03-16T17:48:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7fafa896c640 1 -- 172.21.15.132:0/2572058126 >> 172.21.15.132:0/2572058126 conn(0x7fafa409d120 msgr2=0x7fafa40d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7fafa896c640 1 -- 172.21.15.132:0/2572058126 shutdown_connections 2024-03-16T17:48:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.923+0000 7fafa896c640 1 -- 172.21.15.132:0/2572058126 wait complete. 2024-03-16T17:48:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7fafa896c640 1 Processor -- start 2024-03-16T17:48:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7fafa896c640 1 -- start start 2024-03-16T17:48:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7fafa896c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf90003f20 0x7fafa4154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7fafa896c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafa40b69d0 0x7fafa40ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7fafa896c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa40b6e50 0x7fafa40d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7fafa896c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4155120 con 0x7fafa40b69d0 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7fafa896c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40cbed0 con 0x7fafa40b6e50 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7fafa896c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40cc170 con 0x7faf90003f20 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7faf9bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafa40b69d0 0x7fafa40ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7faf9bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafa40b69d0 0x7fafa40ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40990/0 (socket says 172.21.15.132:40990) 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.925+0000 7faf9bfff640 1 -- 172.21.15.132:0/3723237160 learned_addr learned my addr 172.21.15.132:0/3723237160 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7fafa259c640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf90003f20 0x7fafa4154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7fafa2d9d640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa40b6e50 0x7fafa40d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7faf9bfff640 1 -- 172.21.15.132:0/3723237160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf90003f20 msgr2=0x7fafa4154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7faf9bfff640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf90003f20 0x7fafa4154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7faf9bfff640 1 -- 172.21.15.132:0/3723237160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa40b6e50 msgr2=0x7fafa40d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7faf9bfff640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa40b6e50 0x7fafa40d1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7faf9bfff640 1 -- 172.21.15.132:0/3723237160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40cc450 con 0x7fafa40b69d0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7faf9bfff640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafa40b69d0 0x7fafa40ca320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faf8c000c00 tx=0x7faf8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7faf9affd640 1 -- 172.21.15.132:0/3723237160 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c003810 con 0x7fafa40b69d0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7faf9affd640 1 -- 172.21.15.132:0/3723237160 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c003970 con 0x7fafa40b69d0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7fafa896c640 1 -- 172.21.15.132:0/3723237160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa40cc730 con 0x7fafa40b69d0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7faf9affd640 1 -- 172.21.15.132:0/3723237160 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c003d00 con 0x7fafa40b69d0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.926+0000 7fafa896c640 1 -- 172.21.15.132:0/3723237160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa40cccf0 con 0x7fafa40b69d0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.927+0000 7fafa896c640 1 -- 172.21.15.132:0/3723237160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa40cce80 con 0x7fafa40b69d0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.928+0000 7faf9affd640 1 -- 172.21.15.132:0/3723237160 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7faf8c034440 con 0x7fafa40b69d0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.928+0000 7faf9affd640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf8406b3b0 0x7faf8406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.928+0000 7faf9affd640 1 -- 172.21.15.132:0/3723237160 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf8c0abf60 con 0x7fafa40b69d0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.928+0000 7fafa259c640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf8406b3b0 0x7faf8406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:13.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.928+0000 7fafa259c640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf8406b3b0 0x7faf8406d870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf940035f0 tx=0x7faf94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:13.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:13.932+0000 7faf9affd640 1 -- 172.21.15.132:0/3723237160 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7faf8c076d90 con 0x7fafa40b69d0 2024-03-16T17:48:14.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.128+0000 7fafa896c640 1 -- 172.21.15.132:0/3723237160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafa40d3b20 con 0x7fafa40b69d0 2024-03-16T17:48:14.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.129+0000 7faf9affd640 1 -- 172.21.15.132:0/3723237160 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7faf8c04c090 con 0x7fafa40b69d0 2024-03-16T17:48:14.133 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:14.133 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 -- 172.21.15.132:0/3723237160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf8406b3b0 msgr2=0x7faf8406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf8406b3b0 0x7faf8406d870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf940035f0 tx=0x7faf94009040 comp rx=0 tx=0).stop 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 -- 172.21.15.132:0/3723237160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafa40b69d0 msgr2=0x7fafa40ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafa40b69d0 0x7fafa40ca320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faf8c000c00 tx=0x7faf8c004730 comp rx=0 tx=0).stop 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 -- 172.21.15.132:0/3723237160 shutdown_connections 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf8406b3b0 0x7faf8406d870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa40b6e50 0x7fafa40d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafa40b69d0 0x7fafa40ca320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 --2- 172.21.15.132:0/3723237160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf90003f20 0x7fafa4154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 -- 172.21.15.132:0/3723237160 >> 172.21.15.132:0/3723237160 conn(0x7fafa409d120 msgr2=0x7fafa4162660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 -- 172.21.15.132:0/3723237160 shutdown_connections 2024-03-16T17:48:14.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.131+0000 7fafa896c640 1 -- 172.21.15.132:0/3723237160 wait complete. 2024-03-16T17:48:14.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:14.146 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:14.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.245+0000 7f6e8858c640 1 Processor -- start 2024-03-16T17:48:14.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.245+0000 7f6e8858c640 1 -- start start 2024-03-16T17:48:14.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.246+0000 7f6e8858c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6e801617c0 0x7f6e800d4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.246+0000 7f6e8858c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e800d1010 0x7f6e800d2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.246+0000 7f6e8858c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e800cffe0 con 0x7f6e800b4ef0 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.246+0000 7f6e8858c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e800cf780 con 0x7f6e801617c0 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.246+0000 7f6e8858c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800cfa20 con 0x7f6e800d1010 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.246+0000 7f6e85b27640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6e800b4ef0 0x7f6e800d0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48226/0 (socket says 172.21.15.132:48226) 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.246+0000 7f6e85b27640 1 -- 172.21.15.132:0/1465125412 learned_addr learned my addr 172.21.15.132:0/1465125412 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e86328640 1 --2- 172.21.15.132:0/1465125412 >> v2:172.21.15.194:3300/0 conn(0x7f6e801617c0 0x7f6e800d4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e86b29640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e800d1010 0x7f6e800d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001385930 0 0) 0x7f6e800cffe0 con 0x7f6e800b4ef0 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e6c003520 con 0x7f6e800b4ef0 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564218187 0 0) 0x7f6e6c003520 con 0x7f6e800b4ef0 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e800d1010 msgr2=0x7f6e800d2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e800d1010 0x7f6e800d2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 >> v2:172.21.15.194:3300/0 conn(0x7f6e801617c0 msgr2=0x7f6e800d4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 --2- 172.21.15.132:0/1465125412 >> v2:172.21.15.194:3300/0 conn(0x7f6e801617c0 0x7f6e800d4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e800cfd00 con 0x7f6e800b4ef0 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f6e7c001670 con 0x7f6e800b4ef0 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 >> v1:172.21.15.132:6789/0 conn(0x7f6e800b4ef0 legacy=0x7f6e800d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6c003970 0x7f6e6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e800d1010 0x7f6e6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6c004d00 0x7f6e6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800cf780 con 0x7f6e6c003970 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800cfa20 con 0x7f6e6c004d00 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c00ba30 con 0x7f6e800d1010 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e86328640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6c003970 0x7f6e6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e86b29640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6c004d00 0x7f6e6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85b27640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e800d1010 0x7f6e6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e86328640 1 -- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e800d1010 msgr2=0x7f6e6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e86328640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e800d1010 0x7f6e6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e86328640 1 -- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6c004d00 msgr2=0x7f6e6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e86328640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e6c004d00 0x7f6e6c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e86328640 1 -- 172.21.15.132:0/1465125412 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c003520 con 0x7f6e6c003970 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.247+0000 7f6e85b27640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e800d1010 0x7f6e6c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.248+0000 7f6e86328640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6c003970 0x7f6e6c003d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009ac0 tx=0x7f6e6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdaae63b4776962 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.248+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7002c710 con 0x7f6e6c003970 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.248+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7002c870 con 0x7f6e6c003970 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.248+0000 7f6e85326640 1 -- 172.21.15.132:0/1465125412 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7002cc00 con 0x7f6e6c003970 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.249+0000 7f6e8858c640 1 -- 172.21.15.132:0/1465125412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6c003970 msgr2=0x7f6e6c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.249+0000 7f6e8858c640 1 --2- 172.21.15.132:0/1465125412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e6c003970 0x7f6e6c003d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009ac0 tx=0x7f6e6c0057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.249+0000 7f6e86b29640 1 -- 172.21.15.132:0/1465125412 reap_dead start 2024-03-16T17:48:14.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.249+0000 7f6e8858c640 1 -- 172.21.15.132:0/1465125412 shutdown_connections 2024-03-16T17:48:14.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.249+0000 7f6e8858c640 1 -- 172.21.15.132:0/1465125412 >> 172.21.15.132:0/1465125412 conn(0x7f6e8009d200 msgr2=0x7f6e800d3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:14.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.249+0000 7f6e8858c640 1 -- 172.21.15.132:0/1465125412 shutdown_connections 2024-03-16T17:48:14.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.249+0000 7f6e8858c640 1 -- 172.21.15.132:0/1465125412 wait complete. 2024-03-16T17:48:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.251+0000 7f6e8858c640 1 Processor -- start 2024-03-16T17:48:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.251+0000 7f6e8858c640 1 -- start start 2024-03-16T17:48:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.252+0000 7f6e8858c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e6c003970 0x7f6e80143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.252+0000 7f6e8858c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e80144400 0x7f6e801420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.252+0000 7f6e8858c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e801425e0 0x7f6e800c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.252+0000 7f6e8858c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e80143670 con 0x7f6e801425e0 2024-03-16T17:48:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.252+0000 7f6e8858c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e80142a60 con 0x7f6e80144400 2024-03-16T17:48:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.252+0000 7f6e8858c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e80142d40 con 0x7f6e6c003970 2024-03-16T17:48:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.252+0000 7f6e86b29640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e801425e0 0x7f6e800c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.252+0000 7f6e86b29640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e801425e0 0x7f6e800c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41010/0 (socket says 172.21.15.132:41010) 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.252+0000 7f6e86b29640 1 -- 172.21.15.132:0/1505715789 learned_addr learned my addr 172.21.15.132:0/1505715789 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e86b29640 1 -- 172.21.15.132:0/1505715789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e6c003970 msgr2=0x7f6e80143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e86b29640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e6c003970 0x7f6e80143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e86b29640 1 -- 172.21.15.132:0/1505715789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e80144400 msgr2=0x7f6e801420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e86b29640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e80144400 0x7f6e801420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e86b29640 1 -- 172.21.15.132:0/1505715789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e80143020 con 0x7f6e801425e0 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e86b29640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e801425e0 0x7f6e800c7a40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6e800b6a30 tx=0x7f6e7800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e76ffd640 1 -- 172.21.15.132:0/1505715789 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800e040 con 0x7f6e801425e0 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e76ffd640 1 -- 172.21.15.132:0/1505715789 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7800f040 con 0x7f6e801425e0 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e8858c640 1 -- 172.21.15.132:0/1505715789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e80143300 con 0x7f6e801425e0 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e76ffd640 1 -- 172.21.15.132:0/1505715789 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78015430 con 0x7f6e801425e0 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.253+0000 7f6e8858c640 1 -- 172.21.15.132:0/1505715789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e80144f90 con 0x7f6e801425e0 2024-03-16T17:48:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.254+0000 7f6e8858c640 1 -- 172.21.15.132:0/1505715789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e800a1ee0 con 0x7f6e801425e0 2024-03-16T17:48:14.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.254+0000 7f6e76ffd640 1 -- 172.21.15.132:0/1505715789 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f6e78015590 con 0x7f6e801425e0 2024-03-16T17:48:14.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.255+0000 7f6e76ffd640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e6406b3e0 0x7f6e6406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.255+0000 7f6e76ffd640 1 -- 172.21.15.132:0/1505715789 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e7808a3e0 con 0x7f6e801425e0 2024-03-16T17:48:14.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.255+0000 7f6e86328640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e6406b3e0 0x7f6e6406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.255+0000 7f6e86328640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e6406b3e0 0x7f6e6406d8a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e70036000 tx=0x7f6e7002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:14.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.259+0000 7f6e76ffd640 1 -- 172.21.15.132:0/1505715789 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6e78054fb0 con 0x7f6e801425e0 2024-03-16T17:48:14.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:48:14.416 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:48:14.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.431+0000 7f6e8858c640 1 -- 172.21.15.132:0/1505715789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e801437b0 con 0x7f6e801425e0 2024-03-16T17:48:14.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.431+0000 7f6e76ffd640 1 -- 172.21.15.132:0/1505715789 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e78058670 con 0x7f6e801425e0 2024-03-16T17:48:14.435 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.433+0000 7f6e8858c640 1 -- 172.21.15.132:0/1505715789 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e6406b3e0 msgr2=0x7f6e6406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.433+0000 7f6e8858c640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e6406b3e0 0x7f6e6406d8a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e70036000 tx=0x7f6e7002e000 comp rx=0 tx=0).stop 2024-03-16T17:48:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.433+0000 7f6e8858c640 1 -- 172.21.15.132:0/1505715789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e801425e0 msgr2=0x7f6e800c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.433+0000 7f6e8858c640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e801425e0 0x7f6e800c7a40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6e800b6a30 tx=0x7f6e7800f580 comp rx=0 tx=0).stop 2024-03-16T17:48:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.434+0000 7f6e8858c640 1 -- 172.21.15.132:0/1505715789 shutdown_connections 2024-03-16T17:48:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.434+0000 7f6e8858c640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f6e6406b3e0 0x7f6e6406d8a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.434+0000 7f6e8858c640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e801425e0 0x7f6e800c7a40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.434+0000 7f6e8858c640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e80144400 0x7f6e801420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.434+0000 7f6e8858c640 1 --2- 172.21.15.132:0/1505715789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e6c003970 0x7f6e80143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.434+0000 7f6e8858c640 1 -- 172.21.15.132:0/1505715789 >> 172.21.15.132:0/1505715789 conn(0x7f6e8009d200 msgr2=0x7f6e8006b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.434+0000 7f6e8858c640 1 -- 172.21.15.132:0/1505715789 shutdown_connections 2024-03-16T17:48:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.434+0000 7f6e8858c640 1 -- 172.21.15.132:0/1505715789 wait complete. 2024-03-16T17:48:14.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:14.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.633+0000 7fb4f0207640 1 Processor -- start 2024-03-16T17:48:14.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.633+0000 7fb4f0207640 1 -- start start 2024-03-16T17:48:14.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4f0207640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb4e815b220 0x7fb4e806e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4f0207640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4e815b600 0x7fb4e80b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4f0207640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 0x7fb4e80b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4f0207640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e806eae0 con 0x7fb4e815b600 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4f0207640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e8072970 con 0x7fb4e815b220 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4f0207640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e806cfa0 con 0x7fb4e80b32a0 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4ed7a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4e815b600 0x7fb4e80b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4ed7a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4e815b600 0x7fb4e80b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41022/0 (socket says 172.21.15.132:41022) 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4ed7a2640 1 -- 172.21.15.132:0/2267657797 learned_addr learned my addr 172.21.15.132:0/2267657797 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4edfa3640 1 --2- 172.21.15.132:0/2267657797 >> v2:172.21.15.194:3300/0 conn(0x7fb4e815b220 0x7fb4e806e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4ee7a4640 1 --2- 172.21.15.132:0/2267657797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 0x7fb4e80b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4ed7a2640 1 -- 172.21.15.132:0/2267657797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 msgr2=0x7fb4e80b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4ed7a2640 1 --2- 172.21.15.132:0/2267657797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 0x7fb4e80b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4ed7a2640 1 -- 172.21.15.132:0/2267657797 >> v2:172.21.15.194:3300/0 conn(0x7fb4e815b220 msgr2=0x7fb4e806e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:14.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4ed7a2640 1 --2- 172.21.15.132:0/2267657797 >> v2:172.21.15.194:3300/0 conn(0x7fb4e815b220 0x7fb4e806e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4ed7a2640 1 -- 172.21.15.132:0/2267657797 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8072320 con 0x7fb4e815b600 2024-03-16T17:48:14.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.634+0000 7fb4ee7a4640 1 --2- 172.21.15.132:0/2267657797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 0x7fb4e80b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:14.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.635+0000 7fb4ed7a2640 1 --2- 172.21.15.132:0/2267657797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b600 0x7fb4e80b2d60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80b4ab0 tx=0x7fb4d802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5159708fc87593ab server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:14.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.635+0000 7fb4ecfa1640 1 -- 172.21.15.132:0/2267657797 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80317c0 con 0x7fb4e815b600 2024-03-16T17:48:14.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.635+0000 7fb4ecfa1640 1 -- 172.21.15.132:0/2267657797 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8031920 con 0x7fb4e815b600 2024-03-16T17:48:14.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.635+0000 7fb4ecfa1640 1 -- 172.21.15.132:0/2267657797 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8031cb0 con 0x7fb4e815b600 2024-03-16T17:48:14.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.636+0000 7fb4f0207640 1 -- 172.21.15.132:0/2267657797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b600 msgr2=0x7fb4e80b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.636+0000 7fb4f0207640 1 --2- 172.21.15.132:0/2267657797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b600 0x7fb4e80b2d60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80b4ab0 tx=0x7fb4d802b860 comp rx=0 tx=0).stop 2024-03-16T17:48:14.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.636+0000 7fb4f0207640 1 -- 172.21.15.132:0/2267657797 shutdown_connections 2024-03-16T17:48:14.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.636+0000 7fb4f0207640 1 --2- 172.21.15.132:0/2267657797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 0x7fb4e80b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.636+0000 7fb4f0207640 1 --2- 172.21.15.132:0/2267657797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b600 0x7fb4e80b2d60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.636+0000 7fb4f0207640 1 --2- 172.21.15.132:0/2267657797 >> v2:172.21.15.194:3300/0 conn(0x7fb4e815b220 0x7fb4e806e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.636+0000 7fb4f0207640 1 -- 172.21.15.132:0/2267657797 >> 172.21.15.132:0/2267657797 conn(0x7fb4e806aee0 msgr2=0x7fb4e806b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.636+0000 7fb4f0207640 1 -- 172.21.15.132:0/2267657797 shutdown_connections 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.636+0000 7fb4f0207640 1 -- 172.21.15.132:0/2267657797 wait complete. 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.637+0000 7fb4f0207640 1 Processor -- start 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.637+0000 7fb4f0207640 1 -- start start 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4f0207640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 0x7fb4e813b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4f0207640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b220 0x7fb4e813bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4f0207640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4e815b600 0x7fb4e81e49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4f0207640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e813d2d0 con 0x7fb4e815b220 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4f0207640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e813bb00 con 0x7fb4e815b600 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4f0207640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e813d760 con 0x7fb4e80b32a0 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4ed7a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b220 0x7fb4e813bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4ed7a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b220 0x7fb4e813bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41024/0 (socket says 172.21.15.132:41024) 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4ed7a2640 1 -- 172.21.15.132:0/3810089178 learned_addr learned my addr 172.21.15.132:0/3810089178 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4ee7a4640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4e815b600 0x7fb4e81e49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4edfa3640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 0x7fb4e813b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4ed7a2640 1 -- 172.21.15.132:0/3810089178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 msgr2=0x7fb4e813b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4ed7a2640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 0x7fb4e813b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4ed7a2640 1 -- 172.21.15.132:0/3810089178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4e815b600 msgr2=0x7fb4e81e49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4ed7a2640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4e815b600 0x7fb4e81e49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4ed7a2640 1 -- 172.21.15.132:0/3810089178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d80094d0 con 0x7fb4e815b220 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4ed7a2640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b220 0x7fb4e813bce0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb4d802b8a0 tx=0x7fb4d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4de7fc640 1 -- 172.21.15.132:0/3810089178 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8032860 con 0x7fb4e815b220 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4de7fc640 1 -- 172.21.15.132:0/3810089178 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d80329e0 con 0x7fb4e815b220 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4f0207640 1 -- 172.21.15.132:0/3810089178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e813c6c0 con 0x7fb4e815b220 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4de7fc640 1 -- 172.21.15.132:0/3810089178 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8032d90 con 0x7fb4e815b220 2024-03-16T17:48:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.638+0000 7fb4f0207640 1 -- 172.21.15.132:0/3810089178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e813cc80 con 0x7fb4e815b220 2024-03-16T17:48:14.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.640+0000 7fb4f0207640 1 -- 172.21.15.132:0/3810089178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e80b3020 con 0x7fb4e815b220 2024-03-16T17:48:14.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.640+0000 7fb4de7fc640 1 -- 172.21.15.132:0/3810089178 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb4d804e450 con 0x7fb4e815b220 2024-03-16T17:48:14.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.640+0000 7fb4de7fc640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb4cc06b3e0 0x7fb4cc06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.640+0000 7fb4edfa3640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb4cc06b3e0 0x7fb4cc06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.641+0000 7fb4de7fc640 1 -- 172.21.15.132:0/3810089178 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4d80abbf0 con 0x7fb4e815b220 2024-03-16T17:48:14.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.641+0000 7fb4edfa3640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb4cc06b3e0 0x7fb4cc06d8a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40079a0 tx=0x7fb4e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.645+0000 7fb4de7fc640 1 -- 172.21.15.132:0/3810089178 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb4d8076ab0 con 0x7fb4e815b220 2024-03-16T17:48:14.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.822+0000 7fb4f0207640 1 -- 172.21.15.132:0/3810089178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4e80735f0 con 0x7fb4e815b220 2024-03-16T17:48:14.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.822+0000 7fb4de7fc640 1 -- 172.21.15.132:0/3810089178 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4d807a170 con 0x7fb4e815b220 2024-03-16T17:48:14.826 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:14.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 -- 172.21.15.132:0/3810089178 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb4cc06b3e0 msgr2=0x7fb4cc06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb4cc06b3e0 0x7fb4cc06d8a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40079a0 tx=0x7fb4e4008040 comp rx=0 tx=0).stop 2024-03-16T17:48:14.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 -- 172.21.15.132:0/3810089178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b220 msgr2=0x7fb4e813bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b220 0x7fb4e813bce0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb4d802b8a0 tx=0x7fb4d80046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 -- 172.21.15.132:0/3810089178 shutdown_connections 2024-03-16T17:48:14.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb4cc06b3e0 0x7fb4cc06d8a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4e815b600 0x7fb4e81e49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4e815b220 0x7fb4e813bce0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 --2- 172.21.15.132:0/3810089178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4e80b32a0 0x7fb4e813b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 -- 172.21.15.132:0/3810089178 >> 172.21.15.132:0/3810089178 conn(0x7fb4e806aee0 msgr2=0x7fb4e80cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:14.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 -- 172.21.15.132:0/3810089178 shutdown_connections 2024-03-16T17:48:14.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.824+0000 7fb4f0207640 1 -- 172.21.15.132:0/3810089178 wait complete. 2024-03-16T17:48:14.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:14.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.943+0000 7fa78abb5640 1 Processor -- start 2024-03-16T17:48:14.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.943+0000 7fa78abb5640 1 -- start start 2024-03-16T17:48:14.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.943+0000 7fa78abb5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7840d0d10 0x7fa7840b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.943+0000 7fa78abb5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa784161b40 0x7fa7840c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.943+0000 7fa78abb5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7840cff20 con 0x7fa784161760 2024-03-16T17:48:14.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.943+0000 7fa78abb5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7840b5500 con 0x7fa784161b40 2024-03-16T17:48:14.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.943+0000 7fa78abb5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840cf5f0 con 0x7fa7840d0d10 2024-03-16T17:48:14.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa788951640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa784161760 0x7fa7840d0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48238/0 (socket says 172.21.15.132:48238) 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa788951640 1 -- 172.21.15.132:0/1762624332 learned_addr learned my addr 172.21.15.132:0/1762624332 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa789152640 1 --2- 172.21.15.132:0/1762624332 >> v2:172.21.15.194:3300/0 conn(0x7fa784161b40 0x7fa7840c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa783fff640 1 --2- 172.21.15.132:0/1762624332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7840d0d10 0x7fa7840b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa7837fe640 1 -- 172.21.15.132:0/1762624332 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698413015 0 0) 0x7fa7840cff20 con 0x7fa784161760 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa7837fe640 1 -- 172.21.15.132:0/1762624332 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa774003520 con 0x7fa784161760 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa7837fe640 1 -- 172.21.15.132:0/1762624332 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548096771 0 0) 0x7fa774003520 con 0x7fa784161760 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa789152640 1 -- 172.21.15.132:0/1762624332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7840d0d10 msgr2=0x7fa7840b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa789152640 1 --2- 172.21.15.132:0/1762624332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7840d0d10 0x7fa7840b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa789152640 1 -- 172.21.15.132:0/1762624332 >> v1:172.21.15.132:6789/0 conn(0x7fa784161760 legacy=0x7fa7840d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa789152640 1 -- 172.21.15.132:0/1762624332 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7840cf8d0 con 0x7fa784161b40 2024-03-16T17:48:14.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.944+0000 7fa783fff640 1 --2- 172.21.15.132:0/1762624332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7840d0d10 0x7fa7840b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:14.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.945+0000 7fa789152640 1 --2- 172.21.15.132:0/1762624332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa784161b40 0x7fa7840c7d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009d90 tx=0x7fa77c02bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5fbd17c3700af79 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:14.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.945+0000 7fa7837fe640 1 -- 172.21.15.132:0/1762624332 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778001670 con 0x7fa784161b40 2024-03-16T17:48:14.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.945+0000 7fa7837fe640 1 -- 172.21.15.132:0/1762624332 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c02c8a0 con 0x7fa784161b40 2024-03-16T17:48:14.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.945+0000 7fa7837fe640 1 -- 172.21.15.132:0/1762624332 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c02cc30 con 0x7fa784161b40 2024-03-16T17:48:14.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.946+0000 7fa78abb5640 1 -- 172.21.15.132:0/1762624332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa784161b40 msgr2=0x7fa7840c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.946+0000 7fa78abb5640 1 --2- 172.21.15.132:0/1762624332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa784161b40 0x7fa7840c7d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009d90 tx=0x7fa77c02bd70 comp rx=0 tx=0).stop 2024-03-16T17:48:14.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.946+0000 7fa78abb5640 1 -- 172.21.15.132:0/1762624332 shutdown_connections 2024-03-16T17:48:14.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.946+0000 7fa78abb5640 1 --2- 172.21.15.132:0/1762624332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa784161b40 0x7fa7840c7d00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.946+0000 7fa78abb5640 1 --2- 172.21.15.132:0/1762624332 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7840d0d10 0x7fa7840b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.946+0000 7fa78abb5640 1 -- 172.21.15.132:0/1762624332 >> 172.21.15.132:0/1762624332 conn(0x7fa7840d3ed0 msgr2=0x7fa7840d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:14.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.946+0000 7fa78abb5640 1 -- 172.21.15.132:0/1762624332 shutdown_connections 2024-03-16T17:48:14.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.946+0000 7fa78abb5640 1 -- 172.21.15.132:0/1762624332 wait complete. 2024-03-16T17:48:14.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.947+0000 7fa78abb5640 1 Processor -- start 2024-03-16T17:48:14.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.947+0000 7fa78abb5640 1 -- start start 2024-03-16T17:48:14.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa78abb5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840d0d10 0x7fa7840a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa78abb5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa784161760 0x7fa78409f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa78abb5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa784161b40 0x7fa78409fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa78abb5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78415d240 con 0x7fa7840d0d10 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa78abb5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840cce70 con 0x7fa784161760 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa78abb5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840cd150 con 0x7fa784161b40 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa788951640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840d0d10 0x7fa7840a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa788951640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840d0d10 0x7fa7840a09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41032/0 (socket says 172.21.15.132:41032) 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa788951640 1 -- 172.21.15.132:0/1628880866 learned_addr learned my addr 172.21.15.132:0/1628880866 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa783fff640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa784161760 0x7fa78409f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa789152640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa784161b40 0x7fa78409fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa788951640 1 -- 172.21.15.132:0/1628880866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa784161b40 msgr2=0x7fa78409fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa788951640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa784161b40 0x7fa78409fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa788951640 1 -- 172.21.15.132:0/1628880866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa784161760 msgr2=0x7fa78409f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa788951640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa784161760 0x7fa78409f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.948+0000 7fa788951640 1 -- 172.21.15.132:0/1628880866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa770009400 con 0x7fa7840d0d10 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.949+0000 7fa788951640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840d0d10 0x7fa7840a09b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa77800c750 tx=0x7fa77800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.949+0000 7fa7817fa640 1 -- 172.21.15.132:0/1628880866 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778005ad0 con 0x7fa7840d0d10 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.949+0000 7fa7817fa640 1 -- 172.21.15.132:0/1628880866 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa778005c50 con 0x7fa7840d0d10 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.949+0000 7fa78abb5640 1 -- 172.21.15.132:0/1628880866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c009a70 con 0x7fa7840d0d10 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.949+0000 7fa7817fa640 1 -- 172.21.15.132:0/1628880866 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa778007070 con 0x7fa7840d0d10 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.949+0000 7fa78abb5640 1 -- 172.21.15.132:0/1628880866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7840cd710 con 0x7fa7840d0d10 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.950+0000 7fa7817fa640 1 -- 172.21.15.132:0/1628880866 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fa7780071d0 con 0x7fa7840d0d10 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.950+0000 7fa78abb5640 1 -- 172.21.15.132:0/1628880866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa784068450 con 0x7fa7840d0d10 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.950+0000 7fa7817fa640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa76806b3b0 0x7fa76806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:14.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.951+0000 7fa7817fa640 1 -- 172.21.15.132:0/1628880866 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa778089920 con 0x7fa7840d0d10 2024-03-16T17:48:14.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.951+0000 7fa783fff640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa76806b3b0 0x7fa76806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:14.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.951+0000 7fa783fff640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa76806b3b0 0x7fa76806d870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa7840b9a70 tx=0x7fa770008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:14.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:14.955+0000 7fa7817fa640 1 -- 172.21.15.132:0/1628880866 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa778054610 con 0x7fa7840d0d10 2024-03-16T17:48:15.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.194+0000 7fa78abb5640 1 -- 172.21.15.132:0/1628880866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa78404f330 con 0x7fa7840d0d10 2024-03-16T17:48:15.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.194+0000 7fa7817fa640 1 -- 172.21.15.132:0/1628880866 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa778057cd0 con 0x7fa7840d0d10 2024-03-16T17:48:15.198 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:15.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 -- 172.21.15.132:0/1628880866 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa76806b3b0 msgr2=0x7fa76806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa76806b3b0 0x7fa76806d870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa7840b9a70 tx=0x7fa770008040 comp rx=0 tx=0).stop 2024-03-16T17:48:15.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 -- 172.21.15.132:0/1628880866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840d0d10 msgr2=0x7fa7840a09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840d0d10 0x7fa7840a09b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa77800c750 tx=0x7fa77800cc10 comp rx=0 tx=0).stop 2024-03-16T17:48:15.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 -- 172.21.15.132:0/1628880866 shutdown_connections 2024-03-16T17:48:15.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa76806b3b0 0x7fa76806d870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa784161b40 0x7fa78409fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa784161760 0x7fa78409f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 --2- 172.21.15.132:0/1628880866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7840d0d10 0x7fa7840a09b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 -- 172.21.15.132:0/1628880866 >> 172.21.15.132:0/1628880866 conn(0x7fa7840d3ed0 msgr2=0x7fa78415f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:15.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 -- 172.21.15.132:0/1628880866 shutdown_connections 2024-03-16T17:48:15.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.196+0000 7fa78abb5640 1 -- 172.21.15.132:0/1628880866 wait complete. 2024-03-16T17:48:15.211 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.308+0000 7fb469b47640 1 Processor -- start 2024-03-16T17:48:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.308+0000 7fb469b47640 1 -- start start 2024-03-16T17:48:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.308+0000 7fb469b47640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 0x7fb4640cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.308+0000 7fb469b47640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb4640d1640 0x7fb464157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.308+0000 7fb469b47640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640d0040 con 0x7fb4640d21e0 2024-03-16T17:48:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.308+0000 7fb469b47640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb464158ae0 con 0x7fb4640d1640 2024-03-16T17:48:15.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.308+0000 7fb469b47640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46415f530 con 0x7fb4640d1e00 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.309+0000 7fb462ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb4640d1640 0x7fb464157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.309+0000 7fb4637fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 0x7fb4640cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.309+0000 7fb462ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb4640d1640 0x7fb464157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:33232/0 (socket says 172.21.15.132:33232) 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.309+0000 7fb462ffd640 1 -- 172.21.15.132:0/633557667 learned_addr learned my addr 172.21.15.132:0/633557667 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.309+0000 7fb4637fe640 1 -- 172.21.15.132:0/633557667 >> v2:172.21.15.194:3300/0 conn(0x7fb4640d1640 msgr2=0x7fb464157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.309+0000 7fb4637fe640 1 --2- 172.21.15.132:0/633557667 >> v2:172.21.15.194:3300/0 conn(0x7fb4640d1640 0x7fb464157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.309+0000 7fb4637fe640 1 -- 172.21.15.132:0/633557667 >> v1:172.21.15.194:6789/0 conn(0x7fb4640d21e0 legacy=0x7fb4641583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.309+0000 7fb4637fe640 1 -- 172.21.15.132:0/633557667 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46415e920 con 0x7fb4640d1e00 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.309+0000 7fb462ffd640 1 --2- 172.21.15.132:0/633557667 >> v2:172.21.15.194:3300/0 conn(0x7fb4640d1640 0x7fb464157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.310+0000 7fb4637fe640 1 --2- 172.21.15.132:0/633557667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 0x7fb4640cfb00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4540097a0 tx=0x7fb45402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b64eef58974e4146 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.310+0000 7fb4627fc640 1 -- 172.21.15.132:0/633557667 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454031830 con 0x7fb4640d1e00 2024-03-16T17:48:15.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.310+0000 7fb4627fc640 1 -- 172.21.15.132:0/633557667 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454031990 con 0x7fb4640d1e00 2024-03-16T17:48:15.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.310+0000 7fb4627fc640 1 -- 172.21.15.132:0/633557667 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454031d20 con 0x7fb4640d1e00 2024-03-16T17:48:15.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.311+0000 7fb469b47640 1 -- 172.21.15.132:0/633557667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 msgr2=0x7fb4640cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.311+0000 7fb469b47640 1 --2- 172.21.15.132:0/633557667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 0x7fb4640cfb00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4540097a0 tx=0x7fb45402b8d0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.311+0000 7fb469b47640 1 -- 172.21.15.132:0/633557667 shutdown_connections 2024-03-16T17:48:15.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.311+0000 7fb469b47640 1 --2- 172.21.15.132:0/633557667 >> v2:172.21.15.194:3300/0 conn(0x7fb4640d1640 0x7fb464157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.311+0000 7fb469b47640 1 --2- 172.21.15.132:0/633557667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 0x7fb4640cfb00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.311+0000 7fb469b47640 1 -- 172.21.15.132:0/633557667 >> 172.21.15.132:0/633557667 conn(0x7fb464073220 msgr2=0x7fb46409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:15.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.311+0000 7fb469b47640 1 -- 172.21.15.132:0/633557667 shutdown_connections 2024-03-16T17:48:15.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.311+0000 7fb469b47640 1 -- 172.21.15.132:0/633557667 wait complete. 2024-03-16T17:48:15.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.313+0000 7fb469b47640 1 Processor -- start 2024-03-16T17:48:15.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.313+0000 7fb469b47640 1 -- start start 2024-03-16T17:48:15.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.314+0000 7fb469b47640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4640d1640 0x7fb464154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.314+0000 7fb469b47640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 0x7fb46414ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.314+0000 7fb469b47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4640d21e0 0x7fb4641f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.314+0000 7fb469b47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641f8020 con 0x7fb4640d21e0 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.314+0000 7fb469b47640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641f7a60 con 0x7fb4640d1640 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.314+0000 7fb469b47640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641f7d40 con 0x7fb4640d1e00 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.314+0000 7fb463fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4640d21e0 0x7fb4641f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.314+0000 7fb463fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4640d21e0 0x7fb4641f70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41038/0 (socket says 172.21.15.132:41038) 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.314+0000 7fb463fff640 1 -- 172.21.15.132:0/2796497602 learned_addr learned my addr 172.21.15.132:0/2796497602 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb4637fe640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4640d1640 0x7fb464154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb462ffd640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 0x7fb46414ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb463fff640 1 -- 172.21.15.132:0/2796497602 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 msgr2=0x7fb46414ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb463fff640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 0x7fb46414ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb463fff640 1 -- 172.21.15.132:0/2796497602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4640d1640 msgr2=0x7fb464154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb463fff640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4640d1640 0x7fb464154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb463fff640 1 -- 172.21.15.132:0/2796497602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580094d0 con 0x7fb4640d21e0 2024-03-16T17:48:15.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb462ffd640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 0x7fb46414ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:15.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb4637fe640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4640d1640 0x7fb464154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:15.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb463fff640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4640d21e0 0x7fb4641f70f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00c6b0 tx=0x7fb45c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:15.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb44bfff640 1 -- 172.21.15.132:0/2796497602 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c003b70 con 0x7fb4640d21e0 2024-03-16T17:48:15.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb44bfff640 1 -- 172.21.15.132:0/2796497602 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c003cf0 con 0x7fb4640d21e0 2024-03-16T17:48:15.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb44bfff640 1 -- 172.21.15.132:0/2796497602 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c003ea0 con 0x7fb4640d21e0 2024-03-16T17:48:15.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb469b47640 1 -- 172.21.15.132:0/2796497602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb454009400 con 0x7fb4640d21e0 2024-03-16T17:48:15.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.315+0000 7fb469b47640 1 -- 172.21.15.132:0/2796497602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb464152a20 con 0x7fb4640d21e0 2024-03-16T17:48:15.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.316+0000 7fb469b47640 1 -- 172.21.15.132:0/2796497602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb464074dc0 con 0x7fb4640d21e0 2024-03-16T17:48:15.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.317+0000 7fb44bfff640 1 -- 172.21.15.132:0/2796497602 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb45c005310 con 0x7fb4640d21e0 2024-03-16T17:48:15.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.317+0000 7fb44bfff640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb45006b3b0 0x7fb45006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.318+0000 7fb4637fe640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb45006b3b0 0x7fb45006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.318+0000 7fb44bfff640 1 -- 172.21.15.132:0/2796497602 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb45c089820 con 0x7fb4640d21e0 2024-03-16T17:48:15.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.318+0000 7fb4637fe640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb45006b3b0 0x7fb45006d870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb454036000 tx=0x7fb454008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:15.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.322+0000 7fb44bfff640 1 -- 172.21.15.132:0/2796497602 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb45c054490 con 0x7fb4640d21e0 2024-03-16T17:48:15.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.540+0000 7fb469b47640 1 -- 172.21.15.132:0/2796497602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4640d0040 con 0x7fb4640d21e0 2024-03-16T17:48:15.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.541+0000 7fb44bfff640 1 -- 172.21.15.132:0/2796497602 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fb4640d0040 con 0x7fb4640d21e0 2024-03-16T17:48:15.545 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:15.545 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:15.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 -- 172.21.15.132:0/2796497602 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb45006b3b0 msgr2=0x7fb45006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb45006b3b0 0x7fb45006d870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb454036000 tx=0x7fb454008030 comp rx=0 tx=0).stop 2024-03-16T17:48:15.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 -- 172.21.15.132:0/2796497602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4640d21e0 msgr2=0x7fb4641f70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4640d21e0 0x7fb4641f70f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00c6b0 tx=0x7fb45c00cb70 comp rx=0 tx=0).stop 2024-03-16T17:48:15.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 -- 172.21.15.132:0/2796497602 shutdown_connections 2024-03-16T17:48:15.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb45006b3b0 0x7fb45006d870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4640d21e0 0x7fb4641f70f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4640d1e00 0x7fb46414ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 --2- 172.21.15.132:0/2796497602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4640d1640 0x7fb464154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 -- 172.21.15.132:0/2796497602 >> 172.21.15.132:0/2796497602 conn(0x7fb464073220 msgr2=0x7fb4640b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:15.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 -- 172.21.15.132:0/2796497602 shutdown_connections 2024-03-16T17:48:15.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.544+0000 7fb469b47640 1 -- 172.21.15.132:0/2796497602 wait complete. 2024-03-16T17:48:15.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:15.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:15.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.662+0000 7fec65577640 1 Processor -- start 2024-03-16T17:48:15.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.662+0000 7fec65577640 1 -- start start 2024-03-16T17:48:15.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec65577640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fec60072ec0 0x7fec600adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec65577640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec600b0b20 0x7fec600ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec65577640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec600b5ec0 con 0x7fec6015e2b0 2024-03-16T17:48:15.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec65577640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec600b63d0 con 0x7fec60072ec0 2024-03-16T17:48:15.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec65577640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60066c20 con 0x7fec600b0b20 2024-03-16T17:48:15.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec57fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fec60072ec0 0x7fec600adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec5f7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec600b0b20 0x7fec600ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec57fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fec60072ec0 0x7fec600adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:33256/0 (socket says 172.21.15.132:33256) 2024-03-16T17:48:15.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec57fff640 1 -- 172.21.15.132:0/3308735932 learned_addr learned my addr 172.21.15.132:0/3308735932 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:15.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec57fff640 1 -- 172.21.15.132:0/3308735932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec600b0b20 msgr2=0x7fec600ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:15.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec57fff640 1 --2- 172.21.15.132:0/3308735932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec600b0b20 0x7fec600ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec57fff640 1 -- 172.21.15.132:0/3308735932 >> v1:172.21.15.194:6789/0 conn(0x7fec6015e2b0 legacy=0x7fec600727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec57fff640 1 -- 172.21.15.132:0/3308735932 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec600ad730 con 0x7fec60072ec0 2024-03-16T17:48:15.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec5e7fc640 1 -- 172.21.15.132:0/3308735932 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229419124 0 0) 0x7fec600b5ec0 con 0x7fec6015e2b0 2024-03-16T17:48:15.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.664+0000 7fec5f7fe640 1 --2- 172.21.15.132:0/3308735932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec600b0b20 0x7fec600ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:15.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.665+0000 7fec57fff640 1 --2- 172.21.15.132:0/3308735932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec60072ec0 0x7fec600adba0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fec4800bb10 tx=0x7fec4802e150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=847614ee36da2a36 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:15.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.665+0000 7fec5e7fc640 1 -- 172.21.15.132:0/3308735932 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48036440 con 0x7fec60072ec0 2024-03-16T17:48:15.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.665+0000 7fec5e7fc640 1 -- 172.21.15.132:0/3308735932 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec480365a0 con 0x7fec60072ec0 2024-03-16T17:48:15.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.665+0000 7fec5e7fc640 1 -- 172.21.15.132:0/3308735932 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48036930 con 0x7fec60072ec0 2024-03-16T17:48:15.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.666+0000 7fec65577640 1 -- 172.21.15.132:0/3308735932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec60072ec0 msgr2=0x7fec600adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.666+0000 7fec65577640 1 --2- 172.21.15.132:0/3308735932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec60072ec0 0x7fec600adba0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fec4800bb10 tx=0x7fec4802e150 comp rx=0 tx=0).stop 2024-03-16T17:48:15.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.666+0000 7fec65577640 1 -- 172.21.15.132:0/3308735932 shutdown_connections 2024-03-16T17:48:15.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.666+0000 7fec65577640 1 --2- 172.21.15.132:0/3308735932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec600b0b20 0x7fec600ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.666+0000 7fec65577640 1 --2- 172.21.15.132:0/3308735932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec60072ec0 0x7fec600adba0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.666+0000 7fec65577640 1 -- 172.21.15.132:0/3308735932 >> 172.21.15.132:0/3308735932 conn(0x7fec600b50f0 msgr2=0x7fec600b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:15.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.666+0000 7fec65577640 1 -- 172.21.15.132:0/3308735932 shutdown_connections 2024-03-16T17:48:15.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.666+0000 7fec65577640 1 -- 172.21.15.132:0/3308735932 wait complete. 2024-03-16T17:48:15.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.668+0000 7fec65577640 1 Processor -- start 2024-03-16T17:48:15.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.668+0000 7fec65577640 1 -- start start 2024-03-16T17:48:15.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec65577640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec60072ec0 0x7fec600ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec65577640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec600b0b20 0x7fec6014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec65577640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec6015e2b0 0x7fec6014d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec65577640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6014f650 con 0x7fec600b0b20 2024-03-16T17:48:15.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec65577640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600cdfb0 con 0x7fec60072ec0 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec65577640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec600cd3a0 con 0x7fec6015e2b0 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec57fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec600b0b20 0x7fec6014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec57fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec600b0b20 0x7fec6014f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41050/0 (socket says 172.21.15.132:41050) 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec57fff640 1 -- 172.21.15.132:0/4106635075 learned_addr learned my addr 172.21.15.132:0/4106635075 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec5effd640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec60072ec0 0x7fec600ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.669+0000 7fec5f7fe640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec6015e2b0 0x7fec6014d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec57fff640 1 -- 172.21.15.132:0/4106635075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec6015e2b0 msgr2=0x7fec6014d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec57fff640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec6015e2b0 0x7fec6014d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec57fff640 1 -- 172.21.15.132:0/4106635075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec60072ec0 msgr2=0x7fec600ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec57fff640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec60072ec0 0x7fec600ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec57fff640 1 -- 172.21.15.132:0/4106635075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58009a70 con 0x7fec600b0b20 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec5f7fe640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec6015e2b0 0x7fec6014d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec57fff640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec600b0b20 0x7fec6014f110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec4800b2c0 tx=0x7fec480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:15.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec577fe640 1 -- 172.21.15.132:0/4106635075 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48036440 con 0x7fec600b0b20 2024-03-16T17:48:15.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec577fe640 1 -- 172.21.15.132:0/4106635075 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec48034ba0 con 0x7fec600b0b20 2024-03-16T17:48:15.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec65577640 1 -- 172.21.15.132:0/4106635075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4800b770 con 0x7fec600b0b20 2024-03-16T17:48:15.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec577fe640 1 -- 172.21.15.132:0/4106635075 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48041440 con 0x7fec600b0b20 2024-03-16T17:48:15.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.670+0000 7fec65577640 1 -- 172.21.15.132:0/4106635075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec600cd960 con 0x7fec600b0b20 2024-03-16T17:48:15.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.671+0000 7fec65577640 1 -- 172.21.15.132:0/4106635075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec600b08d0 con 0x7fec600b0b20 2024-03-16T17:48:15.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.672+0000 7fec577fe640 1 -- 172.21.15.132:0/4106635075 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fec4803d040 con 0x7fec600b0b20 2024-03-16T17:48:15.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.672+0000 7fec577fe640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec4006b3b0 0x7fec4006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.672+0000 7fec577fe640 1 -- 172.21.15.132:0/4106635075 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec480ae9e0 con 0x7fec600b0b20 2024-03-16T17:48:15.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.672+0000 7fec5effd640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec4006b3b0 0x7fec4006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.673+0000 7fec5effd640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec4006b3b0 0x7fec4006d870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec50000f60 tx=0x7fec50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:15.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.676+0000 7fec577fe640 1 -- 172.21.15.132:0/4106635075 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fec480795c0 con 0x7fec600b0b20 2024-03-16T17:48:15.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.849+0000 7fec65577640 1 -- 172.21.15.132:0/4106635075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec6009e5f0 con 0x7fec600b0b20 2024-03-16T17:48:15.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.849+0000 7fec577fe640 1 -- 172.21.15.132:0/4106635075 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec4807cc80 con 0x7fec600b0b20 2024-03-16T17:48:15.853 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 -- 172.21.15.132:0/4106635075 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec4006b3b0 msgr2=0x7fec4006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec4006b3b0 0x7fec4006d870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec50000f60 tx=0x7fec50009040 comp rx=0 tx=0).stop 2024-03-16T17:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 -- 172.21.15.132:0/4106635075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec600b0b20 msgr2=0x7fec6014f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec600b0b20 0x7fec6014f110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec4800b2c0 tx=0x7fec480046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 -- 172.21.15.132:0/4106635075 shutdown_connections 2024-03-16T17:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fec4006b3b0 0x7fec4006d870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec6015e2b0 0x7fec6014d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec600b0b20 0x7fec6014f110 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 --2- 172.21.15.132:0/4106635075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec60072ec0 0x7fec600ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 -- 172.21.15.132:0/4106635075 >> 172.21.15.132:0/4106635075 conn(0x7fec600b50f0 msgr2=0x7fec600b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:15.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 -- 172.21.15.132:0/4106635075 shutdown_connections 2024-03-16T17:48:15.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.851+0000 7fec65577640 1 -- 172.21.15.132:0/4106635075 wait complete. 2024-03-16T17:48:15.866 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:15.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.966+0000 7f4a18a46640 1 Processor -- start 2024-03-16T17:48:15.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.966+0000 7f4a18a46640 1 -- start start 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.967+0000 7f4a18a46640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a140d1f80 0x7f4a140cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.967+0000 7f4a18a46640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a140ce2e0 con 0x7f4a1415c4f0 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.967+0000 7f4a18a46640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a140ceb80 con 0x7f4a140cf550 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.967+0000 7f4a18a46640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140d2400 con 0x7f4a140d1f80 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.967+0000 7f4a1259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4a1415c4f0 0x7f4a140b30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48244/0 (socket says 172.21.15.132:48244) 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1259c640 1 -- 172.21.15.132:0/1384501048 learned_addr learned my addr 172.21.15.132:0/1384501048 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a11d9b640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a140d1f80 0x7f4a140cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692426565 0 0) 0x7f4a140ce2e0 con 0x7f4a1415c4f0 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49fc003520 con 0x7f4a1415c4f0 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691530458 0 0) 0x7f4a140ceb80 con 0x7f4a140cf550 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a140ce2e0 con 0x7f4a140cf550 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924775538 0 0) 0x7f49fc003520 con 0x7f4a1415c4f0 2024-03-16T17:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a140d1f80 msgr2=0x7f4a140cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a140d1f80 0x7f4a140cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 >> v1:172.21.15.194:6789/0 conn(0x7f4a140cf550 legacy=0x7f4a1415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140d2610 con 0x7f4a1415c4f0 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f4a0c0019f0 con 0x7f4a1415c4f0 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a11d9b640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a140d1f80 0x7f4a140cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 >> v1:172.21.15.132:6789/0 conn(0x7f4a1415c4f0 legacy=0x7f4a140b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49fc003b30 0x7f49fc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49fc0047c0 0x7f49fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a140d1f80 0x7f49fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140d2400 con 0x7f49fc003b30 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc00b9b0 con 0x7f49fc0047c0 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc00bb70 con 0x7f4a140d1f80 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a1259c640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49fc003b30 0x7f49fc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a12d9d640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a140d1f80 0x7f49fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.968+0000 7f4a11d9b640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49fc0047c0 0x7f49fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a1259c640 1 -- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a140d1f80 msgr2=0x7f49fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a1259c640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a140d1f80 0x7f49fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a1259c640 1 -- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49fc0047c0 msgr2=0x7f49fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a1259c640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49fc0047c0 0x7f49fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a1259c640 1 -- 172.21.15.132:0/1384501048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08009400 con 0x7f49fc003b30 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a12d9d640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a140d1f80 0x7f49fc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a11d9b640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49fc0047c0 0x7f49fc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a1259c640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49fc003b30 0x7f49fc003f30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c002230 tx=0x7f49fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1139692a5b69791b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c034630 con 0x7f49fc003b30 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c02f070 con 0x7f49fc003b30 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.969+0000 7f4a1159a640 1 -- 172.21.15.132:0/1384501048 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0349f0 con 0x7f49fc003b30 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.970+0000 7f4a18a46640 1 -- 172.21.15.132:0/1384501048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49fc003b30 msgr2=0x7f49fc003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.970+0000 7f4a18a46640 1 --2- 172.21.15.132:0/1384501048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49fc003b30 0x7f49fc003f30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c002230 tx=0x7f49fc0057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.970+0000 7f4a12d9d640 1 -- 172.21.15.132:0/1384501048 reap_dead start 2024-03-16T17:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.970+0000 7f4a18a46640 1 -- 172.21.15.132:0/1384501048 shutdown_connections 2024-03-16T17:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.970+0000 7f4a18a46640 1 -- 172.21.15.132:0/1384501048 >> 172.21.15.132:0/1384501048 conn(0x7f4a14073220 msgr2=0x7f4a1409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.970+0000 7f4a18a46640 1 -- 172.21.15.132:0/1384501048 shutdown_connections 2024-03-16T17:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.970+0000 7f4a18a46640 1 -- 172.21.15.132:0/1384501048 wait complete. 2024-03-16T17:48:15.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.971+0000 7f4a18a46640 1 Processor -- start 2024-03-16T17:48:15.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.971+0000 7f4a18a46640 1 -- start start 2024-03-16T17:48:15.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a18a46640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49fc003b30 0x7f4a1414b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a18a46640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a14151780 0x7f4a14153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a18a46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a14150ff0 0x7f4a14153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a18a46640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1414ef60 con 0x7f4a14150ff0 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a18a46640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1414f240 con 0x7f49fc003b30 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a18a46640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1414f520 con 0x7f4a14151780 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a12d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a14150ff0 0x7f4a14153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a12d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a14150ff0 0x7f4a14153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41080/0 (socket says 172.21.15.132:41080) 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a12d9d640 1 -- 172.21.15.132:0/2403724261 learned_addr learned my addr 172.21.15.132:0/2403724261 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a1259c640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49fc003b30 0x7f4a1414b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a11d9b640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a14151780 0x7f4a14153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a12d9d640 1 -- 172.21.15.132:0/2403724261 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a14151780 msgr2=0x7f4a14153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a12d9d640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a14151780 0x7f4a14153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a12d9d640 1 -- 172.21.15.132:0/2403724261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49fc003b30 msgr2=0x7f4a1414b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a12d9d640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49fc003b30 0x7f4a1414b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:15.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.972+0000 7f4a12d9d640 1 -- 172.21.15.132:0/2403724261 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1414f800 con 0x7f4a14150ff0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.973+0000 7f4a12d9d640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a14150ff0 0x7f4a14153e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4a04007ae0 tx=0x7f4a0400e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.973+0000 7f4a02ffd640 1 -- 172.21.15.132:0/2403724261 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a040052e0 con 0x7f4a14150ff0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.973+0000 7f4a02ffd640 1 -- 172.21.15.132:0/2403724261 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a04005460 con 0x7f4a14150ff0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.973+0000 7f4a18a46640 1 -- 172.21.15.132:0/2403724261 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1414ec10 con 0x7f4a14150ff0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.973+0000 7f4a02ffd640 1 -- 172.21.15.132:0/2403724261 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04003830 con 0x7f4a14150ff0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.973+0000 7f4a18a46640 1 -- 172.21.15.132:0/2403724261 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a14151c30 con 0x7f4a14150ff0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.974+0000 7f4a18a46640 1 -- 172.21.15.132:0/2403724261 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1414fd20 con 0x7f4a14150ff0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.974+0000 7f4a02ffd640 1 -- 172.21.15.132:0/2403724261 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4a04003990 con 0x7f4a14150ff0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.975+0000 7f4a02ffd640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f49f406b3b0 0x7f49f406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.975+0000 7f4a1259c640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f49f406b3b0 0x7f49f406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.975+0000 7f4a02ffd640 1 -- 172.21.15.132:0/2403724261 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a04089380 con 0x7f4a14150ff0 2024-03-16T17:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.975+0000 7f4a1259c640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f49f406b3b0 0x7f49f406d870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c034000 tx=0x7f4a0c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:15.979+0000 7f4a02ffd640 1 -- 172.21.15.132:0/2403724261 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4a04053fc0 con 0x7f4a14150ff0 2024-03-16T17:48:16.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.304+0000 7f4a18a46640 1 -- 172.21.15.132:0/2403724261 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a14068270 con 0x7f4a14150ff0 2024-03-16T17:48:16.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.305+0000 7f4a02ffd640 1 -- 172.21.15.132:0/2403724261 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a04007d30 con 0x7f4a14150ff0 2024-03-16T17:48:16.309 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 -- 172.21.15.132:0/2403724261 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f49f406b3b0 msgr2=0x7f49f406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f49f406b3b0 0x7f49f406d870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c034000 tx=0x7f4a0c009030 comp rx=0 tx=0).stop 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 -- 172.21.15.132:0/2403724261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a14150ff0 msgr2=0x7f4a14153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a14150ff0 0x7f4a14153e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4a04007ae0 tx=0x7f4a0400e890 comp rx=0 tx=0).stop 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 -- 172.21.15.132:0/2403724261 shutdown_connections 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f49f406b3b0 0x7f49f406d870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a14150ff0 0x7f4a14153e80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a14151780 0x7f4a14153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 --2- 172.21.15.132:0/2403724261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49fc003b30 0x7f4a1414b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 -- 172.21.15.132:0/2403724261 >> 172.21.15.132:0/2403724261 conn(0x7f4a14073220 msgr2=0x7f4a140b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 -- 172.21.15.132:0/2403724261 shutdown_connections 2024-03-16T17:48:16.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.307+0000 7f4a18a46640 1 -- 172.21.15.132:0/2403724261 wait complete. 2024-03-16T17:48:16.325 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.426+0000 7f7b70076640 1 Processor -- start 2024-03-16T17:48:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.426+0000 7f7b70076640 1 -- start start 2024-03-16T17:48:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.427+0000 7f7b70076640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b68161760 0x7f7b680b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.427+0000 7f7b70076640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b680d0d10 0x7f7b680c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.427+0000 7f7b70076640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b680cff20 con 0x7f7b68161b40 2024-03-16T17:48:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.427+0000 7f7b70076640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b680b5500 con 0x7f7b68161760 2024-03-16T17:48:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.427+0000 7f7b70076640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680cf5f0 con 0x7f7b680d0d10 2024-03-16T17:48:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.428+0000 7f7b6de12640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b68161760 0x7f7b680b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.428+0000 7f7b6e613640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b680d0d10 0x7f7b680c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.428+0000 7f7b6de12640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b68161760 0x7f7b680b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:33280/0 (socket says 172.21.15.132:33280) 2024-03-16T17:48:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.428+0000 7f7b6de12640 1 -- 172.21.15.132:0/1619786955 learned_addr learned my addr 172.21.15.132:0/1619786955 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.428+0000 7f7b6de12640 1 -- 172.21.15.132:0/1619786955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b680d0d10 msgr2=0x7f7b680c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.428+0000 7f7b6de12640 1 --2- 172.21.15.132:0/1619786955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b680d0d10 0x7f7b680c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.428+0000 7f7b6de12640 1 -- 172.21.15.132:0/1619786955 >> v1:172.21.15.194:6789/0 conn(0x7f7b68161b40 legacy=0x7f7b680d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.428+0000 7f7b6ce10640 1 -- 172.21.15.132:0/1619786955 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760458183 0 0) 0x7f7b680cff20 con 0x7f7b68161b40 2024-03-16T17:48:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.428+0000 7f7b6de12640 1 -- 172.21.15.132:0/1619786955 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680cf8d0 con 0x7f7b68161760 2024-03-16T17:48:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.429+0000 7f7b6de12640 1 --2- 172.21.15.132:0/1619786955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b68161760 0x7f7b680b4f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009870 tx=0x7f7b5802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68a997d989bbe4f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.429+0000 7f7b6ce10640 1 -- 172.21.15.132:0/1619786955 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58030840 con 0x7f7b68161760 2024-03-16T17:48:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.429+0000 7f7b6ce10640 1 -- 172.21.15.132:0/1619786955 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b580309a0 con 0x7f7b68161760 2024-03-16T17:48:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.429+0000 7f7b6ce10640 1 -- 172.21.15.132:0/1619786955 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58030d30 con 0x7f7b68161760 2024-03-16T17:48:16.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.429+0000 7f7b70076640 1 -- 172.21.15.132:0/1619786955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b68161760 msgr2=0x7f7b680b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.429+0000 7f7b70076640 1 --2- 172.21.15.132:0/1619786955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b68161760 0x7f7b680b4f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009870 tx=0x7f7b5802b980 comp rx=0 tx=0).stop 2024-03-16T17:48:16.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.429+0000 7f7b70076640 1 -- 172.21.15.132:0/1619786955 shutdown_connections 2024-03-16T17:48:16.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.429+0000 7f7b70076640 1 --2- 172.21.15.132:0/1619786955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b680d0d10 0x7f7b680c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.429+0000 7f7b70076640 1 --2- 172.21.15.132:0/1619786955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b68161760 0x7f7b680b4f20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.429+0000 7f7b70076640 1 -- 172.21.15.132:0/1619786955 >> 172.21.15.132:0/1619786955 conn(0x7f7b680d3ed0 msgr2=0x7f7b680d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.430+0000 7f7b70076640 1 -- 172.21.15.132:0/1619786955 shutdown_connections 2024-03-16T17:48:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.430+0000 7f7b70076640 1 -- 172.21.15.132:0/1619786955 wait complete. 2024-03-16T17:48:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.431+0000 7f7b70076640 1 Processor -- start 2024-03-16T17:48:16.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.431+0000 7f7b70076640 1 -- start start 2024-03-16T17:48:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.431+0000 7f7b70076640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b680d0d10 0x7f7b681534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.431+0000 7f7b70076640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68161760 0x7f7b681582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.431+0000 7f7b70076640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b68161b40 0x7f7b680c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.431+0000 7f7b70076640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b68159cd0 con 0x7f7b68161760 2024-03-16T17:48:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.431+0000 7f7b70076640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6815af60 con 0x7f7b680d0d10 2024-03-16T17:48:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.431+0000 7f7b70076640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b680cb0d0 con 0x7f7b68161b40 2024-03-16T17:48:16.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.431+0000 7f7b6d611640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68161760 0x7f7b681582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b6d611640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68161760 0x7f7b681582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41096/0 (socket says 172.21.15.132:41096) 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b6d611640 1 -- 172.21.15.132:0/3192137494 learned_addr learned my addr 172.21.15.132:0/3192137494 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b6de12640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b680d0d10 0x7f7b681534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b6e613640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b68161b40 0x7f7b680c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b6d611640 1 -- 172.21.15.132:0/3192137494 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b68161b40 msgr2=0x7f7b680c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b6d611640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b68161b40 0x7f7b680c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b6d611640 1 -- 172.21.15.132:0/3192137494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b680d0d10 msgr2=0x7f7b681534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b6d611640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b680d0d10 0x7f7b681534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b6d611640 1 -- 172.21.15.132:0/3192137494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b580094d0 con 0x7f7b68161760 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b6d611640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68161760 0x7f7b681582c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c3c0 tx=0x7f7b5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b667fc640 1 -- 172.21.15.132:0/3192137494 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c0035f0 con 0x7f7b68161760 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b667fc640 1 -- 172.21.15.132:0/3192137494 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c003770 con 0x7f7b68161760 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b667fc640 1 -- 172.21.15.132:0/3192137494 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c003b20 con 0x7f7b68161760 2024-03-16T17:48:16.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b70076640 1 -- 172.21.15.132:0/3192137494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b680cb3b0 con 0x7f7b68161760 2024-03-16T17:48:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.432+0000 7f7b70076640 1 -- 172.21.15.132:0/3192137494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b68154520 con 0x7f7b68161760 2024-03-16T17:48:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.433+0000 7f7b70076640 1 -- 172.21.15.132:0/3192137494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b68068450 con 0x7f7b68161760 2024-03-16T17:48:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.434+0000 7f7b667fc640 1 -- 172.21.15.132:0/3192137494 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f7b5c003c80 con 0x7f7b68161760 2024-03-16T17:48:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.434+0000 7f7b667fc640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7b5406b3e0 0x7f7b5406d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.434+0000 7f7b6de12640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7b5406b3e0 0x7f7b5406d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.434+0000 7f7b667fc640 1 -- 172.21.15.132:0/3192137494 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b5c089030 con 0x7f7b68161760 2024-03-16T17:48:16.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.435+0000 7f7b6de12640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7b5406b3e0 0x7f7b5406d8a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b58036000 tx=0x7f7b58008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:16.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.438+0000 7f7b667fc640 1 -- 172.21.15.132:0/3192137494 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7b5c053dd0 con 0x7f7b68161760 2024-03-16T17:48:16.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.612+0000 7f7b70076640 1 -- 172.21.15.132:0/3192137494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b6815a8c0 con 0x7f7b68161760 2024-03-16T17:48:16.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.613+0000 7f7b667fc640 1 -- 172.21.15.132:0/3192137494 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b5c017020 con 0x7f7b68161760 2024-03-16T17:48:16.617 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 -- 172.21.15.132:0/3192137494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7b5406b3e0 msgr2=0x7f7b5406d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7b5406b3e0 0x7f7b5406d8a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b58036000 tx=0x7f7b58008030 comp rx=0 tx=0).stop 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 -- 172.21.15.132:0/3192137494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68161760 msgr2=0x7f7b681582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68161760 0x7f7b681582c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c3c0 tx=0x7f7b5c00c880 comp rx=0 tx=0).stop 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 -- 172.21.15.132:0/3192137494 shutdown_connections 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7b5406b3e0 0x7f7b5406d8a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b68161b40 0x7f7b680c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68161760 0x7f7b681582c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 --2- 172.21.15.132:0/3192137494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b680d0d10 0x7f7b681534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 -- 172.21.15.132:0/3192137494 >> 172.21.15.132:0/3192137494 conn(0x7f7b680d3ed0 msgr2=0x7f7b6806cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 -- 172.21.15.132:0/3192137494 shutdown_connections 2024-03-16T17:48:16.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.615+0000 7f7b70076640 1 -- 172.21.15.132:0/3192137494 wait complete. 2024-03-16T17:48:16.711 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-16T17:48:16.711 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:16.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.808+0000 7f8394def640 1 Processor -- start 2024-03-16T17:48:16.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.808+0000 7f8394def640 1 -- start start 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.809+0000 7f8394def640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83900d1e00 0x7f83900cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.809+0000 7f8394def640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83900d1640 0x7f8390157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.809+0000 7f8394def640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f83900d21e0 0x7f83901583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.809+0000 7f8394def640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83900d0040 con 0x7f83900d1e00 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.809+0000 7f8394def640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839015f530 con 0x7f83900d21e0 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.809+0000 7f8394def640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839015e920 con 0x7f83900d1640 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.809+0000 7f838e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83900d1e00 0x7f83900cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.809+0000 7f838e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83900d1e00 0x7f83900cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41120/0 (socket says 172.21.15.132:41120) 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.809+0000 7f838e59c640 1 -- 172.21.15.132:0/2963263466 learned_addr learned my addr 172.21.15.132:0/2963263466 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.810+0000 7f8387fff640 1 --2- 172.21.15.132:0/2963263466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83900d1640 0x7f8390157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.810+0000 7f838ed9d640 1 --2- 172.21.15.132:0/2963263466 >> v2:172.21.15.194:3300/0 conn(0x7f83900d21e0 0x7f83901583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.810+0000 7f838e59c640 1 -- 172.21.15.132:0/2963263466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83900d1640 msgr2=0x7f8390157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.810+0000 7f838e59c640 1 --2- 172.21.15.132:0/2963263466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83900d1640 0x7f8390157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.810+0000 7f838e59c640 1 -- 172.21.15.132:0/2963263466 >> v2:172.21.15.194:3300/0 conn(0x7f83900d21e0 msgr2=0x7f83901583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.810+0000 7f838e59c640 1 --2- 172.21.15.132:0/2963263466 >> v2:172.21.15.194:3300/0 conn(0x7f83900d21e0 0x7f83901583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.810+0000 7f838e59c640 1 -- 172.21.15.132:0/2963263466 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839015ec00 con 0x7f83900d1e00 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.810+0000 7f838e59c640 1 --2- 172.21.15.132:0/2963263466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d1e00 0x7f83900cfb00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f839006ec90 tx=0x7f838002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35efe17257b57d39 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f838dd9b640 1 -- 172.21.15.132:0/2963263466 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380031870 con 0x7f83900d1e00 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f838dd9b640 1 -- 172.21.15.132:0/2963263466 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83800319d0 con 0x7f83900d1e00 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f838dd9b640 1 -- 172.21.15.132:0/2963263466 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380031d60 con 0x7f83900d1e00 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f8394def640 1 -- 172.21.15.132:0/2963263466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d1e00 msgr2=0x7f83900cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f8394def640 1 --2- 172.21.15.132:0/2963263466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d1e00 0x7f83900cfb00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f839006ec90 tx=0x7f838002b910 comp rx=0 tx=0).stop 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f8394def640 1 -- 172.21.15.132:0/2963263466 shutdown_connections 2024-03-16T17:48:16.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f8394def640 1 --2- 172.21.15.132:0/2963263466 >> v2:172.21.15.194:3300/0 conn(0x7f83900d21e0 0x7f83901583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f8394def640 1 --2- 172.21.15.132:0/2963263466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83900d1640 0x7f8390157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f8394def640 1 --2- 172.21.15.132:0/2963263466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d1e00 0x7f83900cfb00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f8394def640 1 -- 172.21.15.132:0/2963263466 >> 172.21.15.132:0/2963263466 conn(0x7f8390073220 msgr2=0x7f839009aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:16.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f8394def640 1 -- 172.21.15.132:0/2963263466 shutdown_connections 2024-03-16T17:48:16.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.811+0000 7f8394def640 1 -- 172.21.15.132:0/2963263466 wait complete. 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.812+0000 7f8394def640 1 Processor -- start 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f8394def640 1 -- start start 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f8394def640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83900d1640 0x7f8390148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f8394def640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83900d1e00 0x7f83900cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f8394def640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d21e0 0x7f83900ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f8394def640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839014eac0 con 0x7f83900d21e0 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f8394def640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83901491d0 con 0x7f83900d1640 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f8394def640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8390148ba0 con 0x7f83900d1e00 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f838ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d21e0 0x7f83900ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f838ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d21e0 0x7f83900ce430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41122/0 (socket says 172.21.15.132:41122) 2024-03-16T17:48:16.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f838ed9d640 1 -- 172.21.15.132:0/3669802432 learned_addr learned my addr 172.21.15.132:0/3669802432 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f838e59c640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83900d1640 0x7f8390148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.813+0000 7f8387fff640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83900d1e00 0x7f83900cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f838ed9d640 1 -- 172.21.15.132:0/3669802432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83900d1e00 msgr2=0x7f83900cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f838ed9d640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83900d1e00 0x7f83900cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f838ed9d640 1 -- 172.21.15.132:0/3669802432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83900d1640 msgr2=0x7f8390148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f838ed9d640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83900d1640 0x7f8390148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f838ed9d640 1 -- 172.21.15.132:0/3669802432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83800094d0 con 0x7f83900d21e0 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f838ed9d640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d21e0 0x7f83900ce430 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8388007e90 tx=0x7f838800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f8386ffd640 1 -- 172.21.15.132:0/3669802432 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388014420 con 0x7f83900d21e0 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f8386ffd640 1 -- 172.21.15.132:0/3669802432 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388014580 con 0x7f83900d21e0 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f8394def640 1 -- 172.21.15.132:0/3669802432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839009c780 con 0x7f83900d21e0 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f8386ffd640 1 -- 172.21.15.132:0/3669802432 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388014930 con 0x7f83900d21e0 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.814+0000 7f8394def640 1 -- 172.21.15.132:0/3669802432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8390148e60 con 0x7f83900d21e0 2024-03-16T17:48:16.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.815+0000 7f8394def640 1 -- 172.21.15.132:0/3669802432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8390074dc0 con 0x7f83900d21e0 2024-03-16T17:48:16.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.815+0000 7f8386ffd640 1 -- 172.21.15.132:0/3669802432 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f8388014a90 con 0x7f83900d21e0 2024-03-16T17:48:16.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.816+0000 7f8386ffd640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f837006b3b0 0x7f837006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:16.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.816+0000 7f8386ffd640 1 -- 172.21.15.132:0/3669802432 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f838808a390 con 0x7f83900d21e0 2024-03-16T17:48:16.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.816+0000 7f838e59c640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f837006b3b0 0x7f837006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:16.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.816+0000 7f838e59c640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f837006b3b0 0x7f837006d870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8380036000 tx=0x7f838003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:16.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.820+0000 7f8386ffd640 1 -- 172.21.15.132:0/3669802432 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f83880550a0 con 0x7f83900d21e0 2024-03-16T17:48:17.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.997+0000 7f8394def640 1 -- 172.21.15.132:0/3669802432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83900d01e0 con 0x7f83900d21e0 2024-03-16T17:48:17.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:16.998+0000 7f8386ffd640 1 -- 172.21.15.132:0/3669802432 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f8388058760 con 0x7f83900d21e0 2024-03-16T17:48:17.001 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:17.002 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 -- 172.21.15.132:0/3669802432 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f837006b3b0 msgr2=0x7f837006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f837006b3b0 0x7f837006d870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8380036000 tx=0x7f838003c040 comp rx=0 tx=0).stop 2024-03-16T17:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 -- 172.21.15.132:0/3669802432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d21e0 msgr2=0x7f83900ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d21e0 0x7f83900ce430 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8388007e90 tx=0x7f838800e4b0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 -- 172.21.15.132:0/3669802432 shutdown_connections 2024-03-16T17:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f837006b3b0 0x7f837006d870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83900d21e0 0x7f83900ce430 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83900d1e00 0x7f83900cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 --2- 172.21.15.132:0/3669802432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83900d1640 0x7f8390148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 -- 172.21.15.132:0/3669802432 >> 172.21.15.132:0/3669802432 conn(0x7f8390073220 msgr2=0x7f83900b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:17.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 -- 172.21.15.132:0/3669802432 shutdown_connections 2024-03-16T17:48:17.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.000+0000 7f8394def640 1 -- 172.21.15.132:0/3669802432 wait complete. 2024-03-16T17:48:17.019 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:17.019 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:17.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.119+0000 7f7857c17640 1 Processor -- start 2024-03-16T17:48:17.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.120+0000 7f7857c17640 1 -- start start 2024-03-16T17:48:17.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.120+0000 7f7857c17640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f78501606a0 0x7f78500b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.120+0000 7f7857c17640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015fae0 0x7f785015ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.120+0000 7f7857c17640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7850160470 con 0x7f785015f490 2024-03-16T17:48:17.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.120+0000 7f7857c17640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78500cdb80 con 0x7f78501606a0 2024-03-16T17:48:17.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.120+0000 7f7857c17640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785015f870 con 0x7f785015fae0 2024-03-16T17:48:17.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78559b3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f785015f490 0x7f785006ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32884/0 (socket says 172.21.15.132:32884) 2024-03-16T17:48:17.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78559b3640 1 -- 172.21.15.132:0/3506903301 learned_addr learned my addr 172.21.15.132:0/3506903301 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:17.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78551b2640 1 --2- 172.21.15.132:0/3506903301 >> v2:172.21.15.194:3300/0 conn(0x7f78501606a0 0x7f78500b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111246143 0 0) 0x7f784c001110 con 0x7f785015f490 2024-03-16T17:48:17.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f783c003520 con 0x7f785015f490 2024-03-16T17:48:17.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78561b4640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015fae0 0x7f785015ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3442920173 0 0) 0x7f783c003520 con 0x7f785015f490 2024-03-16T17:48:17.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015fae0 msgr2=0x7f785015ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:17.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015fae0 0x7f785015ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 >> v2:172.21.15.194:3300/0 conn(0x7f78501606a0 msgr2=0x7f78500b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:17.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 --2- 172.21.15.132:0/3506903301 >> v2:172.21.15.194:3300/0 conn(0x7f78501606a0 0x7f78500b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78500cd5c0 con 0x7f785015f490 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f784c001800 con 0x7f785015f490 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 >> v1:172.21.15.132:6789/0 conn(0x7f785015f490 legacy=0x7f785006ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 0x7f783c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f783c0047c0 0x7f783c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015fae0 0x7f783c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78500cdb80 con 0x7f783c003970 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785015f870 con 0x7f783c0047c0 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c00ba00 con 0x7f785015fae0 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78559b3640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 0x7f783c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78551b2640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f783c0047c0 0x7f783c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.121+0000 7f78561b4640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015fae0 0x7f783c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.122+0000 7f78559b3640 1 -- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015fae0 msgr2=0x7f783c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.122+0000 7f78559b3640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015fae0 0x7f783c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.122+0000 7f78559b3640 1 -- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f783c0047c0 msgr2=0x7f783c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:17.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.122+0000 7f78559b3640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f783c0047c0 0x7f783c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.122+0000 7f78559b3640 1 -- 172.21.15.132:0/3506903301 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c003520 con 0x7f783c003970 2024-03-16T17:48:17.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.122+0000 7f78561b4640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015fae0 0x7f783c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:17.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.122+0000 7f78559b3640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 0x7f783c003d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f784c00c210 tx=0x7f783c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56c7c3ad4f08f48 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:17.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.122+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c005ad0 con 0x7f783c003970 2024-03-16T17:48:17.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.122+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c005c30 con 0x7f783c003970 2024-03-16T17:48:17.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.122+0000 7f78549b1640 1 -- 172.21.15.132:0/3506903301 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c02c8d0 con 0x7f783c003970 2024-03-16T17:48:17.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.123+0000 7f7857c17640 1 -- 172.21.15.132:0/3506903301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 msgr2=0x7f783c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.123+0000 7f7857c17640 1 --2- 172.21.15.132:0/3506903301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 0x7f783c003d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f784c00c210 tx=0x7f783c0057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.123+0000 7f78561b4640 1 -- 172.21.15.132:0/3506903301 reap_dead start 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.123+0000 7f7857c17640 1 -- 172.21.15.132:0/3506903301 shutdown_connections 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.123+0000 7f7857c17640 1 -- 172.21.15.132:0/3506903301 >> 172.21.15.132:0/3506903301 conn(0x7f78500b3730 msgr2=0x7f78500b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.123+0000 7f7857c17640 1 -- 172.21.15.132:0/3506903301 shutdown_connections 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.123+0000 7f7857c17640 1 -- 172.21.15.132:0/3506903301 wait complete. 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.124+0000 7f7857c17640 1 Processor -- start 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.124+0000 7f7857c17640 1 -- start start 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f7857c17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 0x7f78500b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f7857c17640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785014fb50 0x7f78500b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f7857c17640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015c020 0x7f785015c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f7857c17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7850150450 con 0x7f783c003970 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f7857c17640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78500c7c80 con 0x7f785014fb50 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f7857c17640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78500c7f20 con 0x7f785015c020 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78559b3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 0x7f78500b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78559b3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 0x7f78500b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41146/0 (socket says 172.21.15.132:41146) 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78559b3640 1 -- 172.21.15.132:0/2941394049 learned_addr learned my addr 172.21.15.132:0/2941394049 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78551b2640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785014fb50 0x7f78500b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78561b4640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015c020 0x7f785015c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78559b3640 1 -- 172.21.15.132:0/2941394049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015c020 msgr2=0x7f785015c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78559b3640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015c020 0x7f785015c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78559b3640 1 -- 172.21.15.132:0/2941394049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785014fb50 msgr2=0x7f78500b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78559b3640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785014fb50 0x7f78500b70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78559b3640 1 -- 172.21.15.132:0/2941394049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78500c67e0 con 0x7f783c003970 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78561b4640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015c020 0x7f785015c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.125+0000 7f78551b2640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785014fb50 0x7f78500b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.126+0000 7f78559b3640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 0x7f78500b6b70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f784c000f60 tx=0x7f784c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.126+0000 7f78467fc640 1 -- 172.21.15.132:0/2941394049 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c039070 con 0x7f783c003970 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.126+0000 7f78467fc640 1 -- 172.21.15.132:0/2941394049 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c02cd00 con 0x7f783c003970 2024-03-16T17:48:17.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.126+0000 7f78467fc640 1 -- 172.21.15.132:0/2941394049 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c0072b0 con 0x7f783c003970 2024-03-16T17:48:17.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.126+0000 7f7857c17640 1 -- 172.21.15.132:0/2941394049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78500c84a0 con 0x7f783c003970 2024-03-16T17:48:17.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.126+0000 7f7857c17640 1 -- 172.21.15.132:0/2941394049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785015d0d0 con 0x7f783c003970 2024-03-16T17:48:17.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.127+0000 7f7857c17640 1 -- 172.21.15.132:0/2941394049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7850068450 con 0x7f783c003970 2024-03-16T17:48:17.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.127+0000 7f78467fc640 1 -- 172.21.15.132:0/2941394049 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f784c032070 con 0x7f783c003970 2024-03-16T17:48:17.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.128+0000 7f78467fc640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f783406b3b0 0x7f783406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.128+0000 7f78467fc640 1 -- 172.21.15.132:0/2941394049 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f784c03c040 con 0x7f783c003970 2024-03-16T17:48:17.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.128+0000 7f78551b2640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f783406b3b0 0x7f783406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.128+0000 7f78551b2640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f783406b3b0 0x7f783406d870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f78500cbab0 tx=0x7f7840008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:17.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.134+0000 7f78467fc640 1 -- 172.21.15.132:0/2941394049 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f784c075a40 con 0x7f783c003970 2024-03-16T17:48:17.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.311+0000 7f7857c17640 1 -- 172.21.15.132:0/2941394049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7850160470 con 0x7f783c003970 2024-03-16T17:48:17.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.312+0000 7f78467fc640 1 -- 172.21.15.132:0/2941394049 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7850160470 con 0x7f783c003970 2024-03-16T17:48:17.316 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 -- 172.21.15.132:0/2941394049 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f783406b3b0 msgr2=0x7f783406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f783406b3b0 0x7f783406d870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f78500cbab0 tx=0x7f7840008040 comp rx=0 tx=0).stop 2024-03-16T17:48:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 -- 172.21.15.132:0/2941394049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 msgr2=0x7f78500b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 0x7f78500b6b70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f784c000f60 tx=0x7f784c000fe0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 -- 172.21.15.132:0/2941394049 shutdown_connections 2024-03-16T17:48:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f783406b3b0 0x7f783406d870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f785015c020 0x7f785015c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f785014fb50 0x7f78500b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 --2- 172.21.15.132:0/2941394049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f783c003970 0x7f78500b6b70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 -- 172.21.15.132:0/2941394049 >> 172.21.15.132:0/2941394049 conn(0x7f78500b3730 msgr2=0x7f78500b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 -- 172.21.15.132:0/2941394049 shutdown_connections 2024-03-16T17:48:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.314+0000 7f7857c17640 1 -- 172.21.15.132:0/2941394049 wait complete. 2024-03-16T17:48:17.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:17.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.432+0000 7fab70fd4640 1 Processor -- start 2024-03-16T17:48:17.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.432+0000 7fab70fd4640 1 -- start start 2024-03-16T17:48:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.433+0000 7fab70fd4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6c15c4f0 0x7fab6c0d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.433+0000 7fab70fd4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab6c15d640 0x7fab6c15dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.433+0000 7fab70fd4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c0ce2e0 con 0x7fab6c0b30d0 2024-03-16T17:48:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.433+0000 7fab70fd4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c0ceb80 con 0x7fab6c15d640 2024-03-16T17:48:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.433+0000 7fab70fd4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c15e010 con 0x7fab6c15c4f0 2024-03-16T17:48:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.433+0000 7fab6ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab6c15d640 0x7fab6c15dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.433+0000 7fab63fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fab6c0b30d0 0x7fab6c0cf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32898/0 (socket says 172.21.15.132:32898) 2024-03-16T17:48:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.433+0000 7fab63fff640 1 -- 172.21.15.132:0/2350066084 learned_addr learned my addr 172.21.15.132:0/2350066084 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:17.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.434+0000 7fab6ad9d640 1 -- 172.21.15.132:0/2350066084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6c15c4f0 msgr2=0x7fab6c0d1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:17.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.434+0000 7fab6a59c640 1 --2- 172.21.15.132:0/2350066084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6c15c4f0 0x7fab6c0d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.434+0000 7fab6ad9d640 1 --2- 172.21.15.132:0/2350066084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6c15c4f0 0x7fab6c0d1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.434+0000 7fab69d9b640 1 -- 172.21.15.132:0/2350066084 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184129067 0 0) 0x7fab6c0ce2e0 con 0x7fab6c0b30d0 2024-03-16T17:48:17.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.434+0000 7fab6ad9d640 1 -- 172.21.15.132:0/2350066084 >> v1:172.21.15.132:6789/0 conn(0x7fab6c0b30d0 legacy=0x7fab6c0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.434+0000 7fab6ad9d640 1 -- 172.21.15.132:0/2350066084 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0cf720 con 0x7fab6c15d640 2024-03-16T17:48:17.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.434+0000 7fab6ad9d640 1 --2- 172.21.15.132:0/2350066084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 0x7fab6c15dad0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab64009d90 tx=0x7fab6402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89109fd7209b9149 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:17.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab69d9b640 1 -- 172.21.15.132:0/2350066084 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6402cc50 con 0x7fab6c15d640 2024-03-16T17:48:17.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab69d9b640 1 -- 172.21.15.132:0/2350066084 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6402cdb0 con 0x7fab6c15d640 2024-03-16T17:48:17.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab69d9b640 1 -- 172.21.15.132:0/2350066084 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64034660 con 0x7fab6c15d640 2024-03-16T17:48:17.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab70fd4640 1 -- 172.21.15.132:0/2350066084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 msgr2=0x7fab6c15dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab70fd4640 1 --2- 172.21.15.132:0/2350066084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 0x7fab6c15dad0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab64009d90 tx=0x7fab6402bea0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab70fd4640 1 -- 172.21.15.132:0/2350066084 shutdown_connections 2024-03-16T17:48:17.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab70fd4640 1 --2- 172.21.15.132:0/2350066084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 0x7fab6c15dad0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab70fd4640 1 --2- 172.21.15.132:0/2350066084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6c15c4f0 0x7fab6c0d1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab70fd4640 1 -- 172.21.15.132:0/2350066084 >> 172.21.15.132:0/2350066084 conn(0x7fab6c073220 msgr2=0x7fab6c09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:17.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab70fd4640 1 -- 172.21.15.132:0/2350066084 shutdown_connections 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.435+0000 7fab70fd4640 1 -- 172.21.15.132:0/2350066084 wait complete. 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.436+0000 7fab70fd4640 1 Processor -- start 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab70fd4640 1 -- start start 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab70fd4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6c0b30d0 0x7fab6c070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab70fd4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c15c4f0 0x7fab6c09e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab70fd4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 0x7fab6c09d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab70fd4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1f7a20 con 0x7fab6c15d640 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab70fd4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c09eb10 con 0x7fab6c15c4f0 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab70fd4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1f70f0 con 0x7fab6c0b30d0 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab6ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 0x7fab6c09d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab6ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 0x7fab6c09d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41164/0 (socket says 172.21.15.132:41164) 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab6ad9d640 1 -- 172.21.15.132:0/2724687487 learned_addr learned my addr 172.21.15.132:0/2724687487 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab6a59c640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6c0b30d0 0x7fab6c070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.437+0000 7fab63fff640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c15c4f0 0x7fab6c09e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab6ad9d640 1 -- 172.21.15.132:0/2724687487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6c0b30d0 msgr2=0x7fab6c070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab6ad9d640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6c0b30d0 0x7fab6c070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab6ad9d640 1 -- 172.21.15.132:0/2724687487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c15c4f0 msgr2=0x7fab6c09e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab6ad9d640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c15c4f0 0x7fab6c09e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab6ad9d640 1 -- 172.21.15.132:0/2724687487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64009a70 con 0x7fab6c15d640 2024-03-16T17:48:17.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab6ad9d640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 0x7fab6c09d060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fab64009d90 tx=0x7fab64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:17.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab62ffd640 1 -- 172.21.15.132:0/2724687487 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6403e610 con 0x7fab6c15d640 2024-03-16T17:48:17.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab62ffd640 1 -- 172.21.15.132:0/2724687487 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6403e790 con 0x7fab6c15d640 2024-03-16T17:48:17.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab62ffd640 1 -- 172.21.15.132:0/2724687487 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6403eb40 con 0x7fab6c15d640 2024-03-16T17:48:17.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab70fd4640 1 -- 172.21.15.132:0/2724687487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c1f73d0 con 0x7fab6c15d640 2024-03-16T17:48:17.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.438+0000 7fab70fd4640 1 -- 172.21.15.132:0/2724687487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c1f7eb0 con 0x7fab6c15d640 2024-03-16T17:48:17.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.439+0000 7fab70fd4640 1 -- 172.21.15.132:0/2724687487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c0ce4f0 con 0x7fab6c15d640 2024-03-16T17:48:17.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.440+0000 7fab62ffd640 1 -- 172.21.15.132:0/2724687487 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fab6403b050 con 0x7fab6c15d640 2024-03-16T17:48:17.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.440+0000 7fab62ffd640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fab4c06b3b0 0x7fab4c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.440+0000 7fab62ffd640 1 -- 172.21.15.132:0/2724687487 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab640ac430 con 0x7fab6c15d640 2024-03-16T17:48:17.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.440+0000 7fab6a59c640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fab4c06b3b0 0x7fab4c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.440+0000 7fab6a59c640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fab4c06b3b0 0x7fab4c06d870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fab6c09fc10 tx=0x7fab5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:17.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.444+0000 7fab62ffd640 1 -- 172.21.15.132:0/2724687487 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fab640771d0 con 0x7fab6c15d640 2024-03-16T17:48:17.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.618+0000 7fab70fd4640 1 -- 172.21.15.132:0/2724687487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab6c09fe70 con 0x7fab6c15d640 2024-03-16T17:48:17.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.618+0000 7fab62ffd640 1 -- 172.21.15.132:0/2724687487 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab6407a890 con 0x7fab6c15d640 2024-03-16T17:48:17.622 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 -- 172.21.15.132:0/2724687487 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fab4c06b3b0 msgr2=0x7fab4c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fab4c06b3b0 0x7fab4c06d870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fab6c09fc10 tx=0x7fab5c008040 comp rx=0 tx=0).stop 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 -- 172.21.15.132:0/2724687487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 msgr2=0x7fab6c09d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 0x7fab6c09d060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fab64009d90 tx=0x7fab64004a40 comp rx=0 tx=0).stop 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 -- 172.21.15.132:0/2724687487 shutdown_connections 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fab4c06b3b0 0x7fab4c06d870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab6c15d640 0x7fab6c09d060 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab6c15c4f0 0x7fab6c09e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 --2- 172.21.15.132:0/2724687487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6c0b30d0 0x7fab6c070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 -- 172.21.15.132:0/2724687487 >> 172.21.15.132:0/2724687487 conn(0x7fab6c073220 msgr2=0x7fab6c15ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:17.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 -- 172.21.15.132:0/2724687487 shutdown_connections 2024-03-16T17:48:17.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.620+0000 7fab70fd4640 1 -- 172.21.15.132:0/2724687487 wait complete. 2024-03-16T17:48:17.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:17.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.735+0000 7faf48c9d640 1 Processor -- start 2024-03-16T17:48:17.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.735+0000 7faf48c9d640 1 -- start start 2024-03-16T17:48:17.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.735+0000 7faf48c9d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faf440cdd80 0x7faf440cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.735+0000 7faf48c9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf440d0f80 0x7faf4406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.735+0000 7faf48c9d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf440cf3d0 con 0x7faf4406ef00 2024-03-16T17:48:17.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.735+0000 7faf48c9d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf440d01c0 con 0x7faf440d0f80 2024-03-16T17:48:17.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.735+0000 7faf48c9d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf440d04a0 con 0x7faf440cdd80 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.736+0000 7faf39d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf440d0f80 0x7faf4406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.736+0000 7faf39d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf440d0f80 0x7faf4406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41178/0 (socket says 172.21.15.132:41178) 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.736+0000 7faf39d9b640 1 -- 172.21.15.132:0/1446974678 learned_addr learned my addr 172.21.15.132:0/1446974678 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.736+0000 7faf4259c640 1 --2- 172.21.15.132:0/1446974678 >> v2:172.21.15.194:3300/0 conn(0x7faf440cdd80 0x7faf440cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.736+0000 7faf39d9b640 1 -- 172.21.15.132:0/1446974678 >> v2:172.21.15.194:3300/0 conn(0x7faf440cdd80 msgr2=0x7faf440cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.736+0000 7faf39d9b640 1 --2- 172.21.15.132:0/1446974678 >> v2:172.21.15.194:3300/0 conn(0x7faf440cdd80 0x7faf440cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.736+0000 7faf39d9b640 1 -- 172.21.15.132:0/1446974678 >> v1:172.21.15.194:6789/0 conn(0x7faf4406ef00 legacy=0x7faf4415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.736+0000 7faf39d9b640 1 -- 172.21.15.132:0/1446974678 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf440d0780 con 0x7faf440d0f80 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf39d9b640 1 --2- 172.21.15.132:0/1446974678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440d0f80 0x7faf4406f700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf44072190 tx=0x7faf2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cb4f474c5947cf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf41d9b640 1 -- 172.21.15.132:0/1446974678 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c031870 con 0x7faf440d0f80 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf41d9b640 1 -- 172.21.15.132:0/1446974678 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0319d0 con 0x7faf440d0f80 2024-03-16T17:48:17.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf41d9b640 1 -- 172.21.15.132:0/1446974678 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c031d60 con 0x7faf440d0f80 2024-03-16T17:48:17.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf48c9d640 1 -- 172.21.15.132:0/1446974678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440d0f80 msgr2=0x7faf4406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf48c9d640 1 --2- 172.21.15.132:0/1446974678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440d0f80 0x7faf4406f700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf44072190 tx=0x7faf2c02b910 comp rx=0 tx=0).stop 2024-03-16T17:48:17.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf48c9d640 1 -- 172.21.15.132:0/1446974678 shutdown_connections 2024-03-16T17:48:17.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf48c9d640 1 --2- 172.21.15.132:0/1446974678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440d0f80 0x7faf4406f700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf48c9d640 1 --2- 172.21.15.132:0/1446974678 >> v2:172.21.15.194:3300/0 conn(0x7faf440cdd80 0x7faf440cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf48c9d640 1 -- 172.21.15.132:0/1446974678 >> 172.21.15.132:0/1446974678 conn(0x7faf440b3730 msgr2=0x7faf440b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:17.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf48c9d640 1 -- 172.21.15.132:0/1446974678 shutdown_connections 2024-03-16T17:48:17.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.737+0000 7faf48c9d640 1 -- 172.21.15.132:0/1446974678 wait complete. 2024-03-16T17:48:17.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.739+0000 7faf48c9d640 1 Processor -- start 2024-03-16T17:48:17.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.739+0000 7faf48c9d640 1 -- start start 2024-03-16T17:48:17.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.739+0000 7faf48c9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4406ef00 0x7faf4414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf48c9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440cdd80 0x7faf440b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf48c9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf440d0f80 0x7faf440c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf48c9d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf440b7920 con 0x7faf440cdd80 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf48c9d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf440b7080 con 0x7faf4406ef00 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf48c9d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf440b7360 con 0x7faf440d0f80 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf39d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440cdd80 0x7faf440b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf39d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440cdd80 0x7faf440b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41180/0 (socket says 172.21.15.132:41180) 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf39d9b640 1 -- 172.21.15.132:0/1098284327 learned_addr learned my addr 172.21.15.132:0/1098284327 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf4259c640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4406ef00 0x7faf4414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf39d9b640 1 -- 172.21.15.132:0/1098284327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf440d0f80 msgr2=0x7faf440c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf42d9d640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf440d0f80 0x7faf440c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf39d9b640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf440d0f80 0x7faf440c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf39d9b640 1 -- 172.21.15.132:0/1098284327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4406ef00 msgr2=0x7faf4414ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf39d9b640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4406ef00 0x7faf4414ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf39d9b640 1 -- 172.21.15.132:0/1098284327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0094d0 con 0x7faf440cdd80 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf4259c640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4406ef00 0x7faf4414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf42d9d640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf440d0f80 0x7faf440c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf39d9b640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440cdd80 0x7faf440b4460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faf2c000c00 tx=0x7faf2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf3b7fe640 1 -- 172.21.15.132:0/1098284327 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c03abe0 con 0x7faf440cdd80 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf3b7fe640 1 -- 172.21.15.132:0/1098284327 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c03ad40 con 0x7faf440cdd80 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf48c9d640 1 -- 172.21.15.132:0/1098284327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf440b7640 con 0x7faf440cdd80 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf3b7fe640 1 -- 172.21.15.132:0/1098284327 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c044610 con 0x7faf440cdd80 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.740+0000 7faf48c9d640 1 -- 172.21.15.132:0/1098284327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4414f440 con 0x7faf440cdd80 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.742+0000 7faf3b7fe640 1 -- 172.21.15.132:0/1098284327 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7faf2c04d450 con 0x7faf440cdd80 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.742+0000 7faf48c9d640 1 -- 172.21.15.132:0/1098284327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf440b74a0 con 0x7faf440cdd80 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.742+0000 7faf3b7fe640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf2406b3b0 0x7faf2406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:17.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.742+0000 7faf3b7fe640 1 -- 172.21.15.132:0/1098284327 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf2c02d040 con 0x7faf440cdd80 2024-03-16T17:48:17.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.742+0000 7faf4259c640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf2406b3b0 0x7faf2406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:17.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.743+0000 7faf4259c640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf2406b3b0 0x7faf2406d870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf34006fd0 tx=0x7faf34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:17.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.746+0000 7faf3b7fe640 1 -- 172.21.15.132:0/1098284327 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7faf440b74a0 con 0x7faf440cdd80 2024-03-16T17:48:17.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.987+0000 7faf48c9d640 1 -- 172.21.15.132:0/1098284327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf441e83d0 con 0x7faf440cdd80 2024-03-16T17:48:17.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.987+0000 7faf3b7fe640 1 -- 172.21.15.132:0/1098284327 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf441e83d0 con 0x7faf440cdd80 2024-03-16T17:48:17.991 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 -- 172.21.15.132:0/1098284327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf2406b3b0 msgr2=0x7faf2406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf2406b3b0 0x7faf2406d870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf34006fd0 tx=0x7faf34008040 comp rx=0 tx=0).stop 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 -- 172.21.15.132:0/1098284327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440cdd80 msgr2=0x7faf440b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440cdd80 0x7faf440b4460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faf2c000c00 tx=0x7faf2c0046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 -- 172.21.15.132:0/1098284327 shutdown_connections 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7faf2406b3b0 0x7faf2406d870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf440d0f80 0x7faf440c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf440cdd80 0x7faf440b4460 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 --2- 172.21.15.132:0/1098284327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4406ef00 0x7faf4414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 -- 172.21.15.132:0/1098284327 >> 172.21.15.132:0/1098284327 conn(0x7faf440b3730 msgr2=0x7faf440b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 -- 172.21.15.132:0/1098284327 shutdown_connections 2024-03-16T17:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:17.989+0000 7faf48c9d640 1 -- 172.21.15.132:0/1098284327 wait complete. 2024-03-16T17:48:18.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-16T17:48:18.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.104+0000 7fb94ddd7640 1 Processor -- start 2024-03-16T17:48:18.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.104+0000 7fb94ddd7640 1 -- start start 2024-03-16T17:48:18.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb94ddd7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948161540 0x7fb9480b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb94ddd7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb9480cf080 0x7fb9480cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb94ddd7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9480d0680 con 0x7fb9480cfa40 2024-03-16T17:48:18.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb94ddd7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9480b4f30 con 0x7fb9480cf080 2024-03-16T17:48:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb94ddd7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480d08d0 con 0x7fb948161540 2024-03-16T17:48:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb947fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb9480cfa40 0x7fb948161d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32906/0 (socket says 172.21.15.132:32906) 2024-03-16T17:48:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb947fff640 1 -- 172.21.15.132:0/3840056171 learned_addr learned my addr 172.21.15.132:0/3840056171 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb9477fe640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948161540 0x7fb9480b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb93effd640 1 --2- 172.21.15.132:0/3840056171 >> v2:172.21.15.194:3300/0 conn(0x7fb9480cf080 0x7fb9480cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553223972 0 0) 0x7fb9480d0680 con 0x7fb9480cfa40 2024-03-16T17:48:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb934003520 con 0x7fb9480cfa40 2024-03-16T17:48:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 589445131 0 0) 0x7fb934003520 con 0x7fb9480cfa40 2024-03-16T17:48:18.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948161540 msgr2=0x7fb9480b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb946ffd640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948161540 0x7fb9480b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 >> v2:172.21.15.194:3300/0 conn(0x7fb9480cf080 msgr2=0x7fb9480cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb946ffd640 1 --2- 172.21.15.132:0/3840056171 >> v2:172.21.15.194:3300/0 conn(0x7fb9480cf080 0x7fb9480cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480d0bb0 con 0x7fb9480cfa40 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7fb9400019f0 con 0x7fb9480cfa40 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.105+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 >> v1:172.21.15.132:6789/0 conn(0x7fb9480cfa40 legacy=0x7fb948161d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb946ffd640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948161540 0x7fb934003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb946ffd640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb934003ef0 0x7fb9340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb946ffd640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb934004d00 0x7fb934005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480b4f30 con 0x7fb934004d00 2024-03-16T17:48:18.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480d08d0 con 0x7fb934003ef0 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93400b9d0 con 0x7fb948161540 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb947fff640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb934004d00 0x7fb934005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb9477fe640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948161540 0x7fb934003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb93effd640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb934003ef0 0x7fb9340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb947fff640 1 -- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948161540 msgr2=0x7fb934003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb947fff640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb948161540 0x7fb934003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb947fff640 1 -- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb934003ef0 msgr2=0x7fb9340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb947fff640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb934003ef0 0x7fb9340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.106+0000 7fb947fff640 1 -- 172.21.15.132:0/3840056171 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb934003520 con 0x7fb934004d00 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb947fff640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb934004d00 0x7fb934005180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb94000a900 tx=0x7fb9340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c183095d7daee483 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940034630 con 0x7fb934004d00 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94002f070 con 0x7fb934004d00 2024-03-16T17:48:18.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb946ffd640 1 -- 172.21.15.132:0/3840056171 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9400349d0 con 0x7fb934004d00 2024-03-16T17:48:18.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb94ddd7640 1 -- 172.21.15.132:0/3840056171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb934004d00 msgr2=0x7fb934005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb94ddd7640 1 --2- 172.21.15.132:0/3840056171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb934004d00 0x7fb934005180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb94000a900 tx=0x7fb9340057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb947fff640 1 -- 172.21.15.132:0/3840056171 reap_dead start 2024-03-16T17:48:18.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb94ddd7640 1 -- 172.21.15.132:0/3840056171 shutdown_connections 2024-03-16T17:48:18.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb94ddd7640 1 -- 172.21.15.132:0/3840056171 >> 172.21.15.132:0/3840056171 conn(0x7fb94809d120 msgr2=0x7fb9480d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:18.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb94ddd7640 1 -- 172.21.15.132:0/3840056171 shutdown_connections 2024-03-16T17:48:18.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.107+0000 7fb94ddd7640 1 -- 172.21.15.132:0/3840056171 wait complete. 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.109+0000 7fb94ddd7640 1 Processor -- start 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.109+0000 7fb94ddd7640 1 -- start start 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.109+0000 7fb94ddd7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb94815cde0 0x7fb9480b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.109+0000 7fb94ddd7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb94815d1c0 0x7fb9480b95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.109+0000 7fb94ddd7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb94809f4e0 0x7fb94809f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.109+0000 7fb94ddd7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480b87a0 con 0x7fb94809f4e0 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.109+0000 7fb94ddd7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480b7b90 con 0x7fb94815d1c0 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.109+0000 7fb94ddd7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480b7e70 con 0x7fb94815cde0 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb947fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb94809f4e0 0x7fb94809f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb947fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb94809f4e0 0x7fb94809f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41204/0 (socket says 172.21.15.132:41204) 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb947fff640 1 -- 172.21.15.132:0/575991085 learned_addr learned my addr 172.21.15.132:0/575991085 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:18.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb9477fe640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb94815cde0 0x7fb9480b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb93effd640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb94815d1c0 0x7fb9480b95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb947fff640 1 -- 172.21.15.132:0/575991085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb94815cde0 msgr2=0x7fb9480b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb947fff640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb94815cde0 0x7fb9480b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb947fff640 1 -- 172.21.15.132:0/575991085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb94815d1c0 msgr2=0x7fb9480b95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb947fff640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb94815d1c0 0x7fb9480b95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb947fff640 1 -- 172.21.15.132:0/575991085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480b8150 con 0x7fb94809f4e0 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb93effd640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb94815d1c0 0x7fb9480b95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb947fff640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb94809f4e0 0x7fb94809f990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb940000f80 tx=0x7fb940001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb944ff9640 1 -- 172.21.15.132:0/575991085 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940034840 con 0x7fb94809f4e0 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb944ff9640 1 -- 172.21.15.132:0/575991085 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9400349c0 con 0x7fb94809f4e0 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb94ddd7640 1 -- 172.21.15.132:0/575991085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9480b8430 con 0x7fb94809f4e0 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb944ff9640 1 -- 172.21.15.132:0/575991085 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940034d70 con 0x7fb94809f4e0 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.110+0000 7fb94ddd7640 1 -- 172.21.15.132:0/575991085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94809fed0 con 0x7fb94809f4e0 2024-03-16T17:48:18.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.111+0000 7fb94ddd7640 1 -- 172.21.15.132:0/575991085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9480b8910 con 0x7fb94809f4e0 2024-03-16T17:48:18.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.112+0000 7fb944ff9640 1 -- 172.21.15.132:0/575991085 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb940031030 con 0x7fb94809f4e0 2024-03-16T17:48:18.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.112+0000 7fb944ff9640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb92806b3b0 0x7fb92806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.112+0000 7fb944ff9640 1 -- 172.21.15.132:0/575991085 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9400ac160 con 0x7fb94809f4e0 2024-03-16T17:48:18.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.112+0000 7fb9477fe640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb92806b3b0 0x7fb92806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.113+0000 7fb9477fe640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb92806b3b0 0x7fb92806d870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb9480b6b30 tx=0x7fb930009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:18.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.119+0000 7fb944ff9640 1 -- 172.21.15.132:0/575991085 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb940076f10 con 0x7fb94809f4e0 2024-03-16T17:48:18.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.398+0000 7fb94ddd7640 1 -- 172.21.15.132:0/575991085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fb9480b88e0 con 0x7fb94809f4e0 2024-03-16T17:48:18.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.573+0000 7fb944ff9640 1 -- 172.21.15.132:0/575991085 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v52) v1 ==== 147+0+0 (secure 0 0 0) 0x7fb940002000 con 0x7fb94809f4e0 2024-03-16T17:48:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 -- 172.21.15.132:0/575991085 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb92806b3b0 msgr2=0x7fb92806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb92806b3b0 0x7fb92806d870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb9480b6b30 tx=0x7fb930009190 comp rx=0 tx=0).stop 2024-03-16T17:48:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 -- 172.21.15.132:0/575991085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb94809f4e0 msgr2=0x7fb94809f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb94809f4e0 0x7fb94809f990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb940000f80 tx=0x7fb940001360 comp rx=0 tx=0).stop 2024-03-16T17:48:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 -- 172.21.15.132:0/575991085 shutdown_connections 2024-03-16T17:48:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb92806b3b0 0x7fb92806d870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb94809f4e0 0x7fb94809f990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb94815d1c0 0x7fb9480b95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 --2- 172.21.15.132:0/575991085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb94815cde0 0x7fb9480b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 -- 172.21.15.132:0/575991085 >> 172.21.15.132:0/575991085 conn(0x7fb94809d120 msgr2=0x7fb94806c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:18.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 -- 172.21.15.132:0/575991085 shutdown_connections 2024-03-16T17:48:18.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.575+0000 7fb94ddd7640 1 -- 172.21.15.132:0/575991085 wait complete. 2024-03-16T17:48:18.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-16T17:48:18.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.691+0000 7f21723c7640 1 Processor -- start 2024-03-16T17:48:18.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.691+0000 7f21723c7640 1 -- start start 2024-03-16T17:48:18.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f21723c7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f216c06efa0 0x7f216c0d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f21723c7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0d07e0 con 0x7f216c161540 2024-03-16T17:48:18.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f21723c7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0d2610 con 0x7f216c0d21e0 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f21723c7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c0d0a30 con 0x7f216c06efa0 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f216c161540 0x7f216c06f980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32910/0 (socket says 172.21.15.132:32910) 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216bfff640 1 -- 172.21.15.132:0/3945281098 learned_addr learned my addr 172.21.15.132:0/3945281098 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216b7fe640 1 --2- 172.21.15.132:0/3945281098 >> v2:172.21.15.194:3300/0 conn(0x7f216c06efa0 0x7f216c0d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856471739 0 0) 0x7f216c0d07e0 con 0x7f216c161540 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2154003520 con 0x7f216c161540 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2738586591 0 0) 0x7f2154003520 con 0x7f216c161540 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 >> v2:172.21.15.194:3300/0 conn(0x7f216c06efa0 msgr2=0x7f216c0d1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 --2- 172.21.15.132:0/3945281098 >> v2:172.21.15.194:3300/0 conn(0x7f216c06efa0 0x7f216c0d1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 >> v1:172.21.15.194:6789/0 conn(0x7f216c0d21e0 legacy=0x7f216c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0d0d10 con 0x7f216c161540 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f215c001670 con 0x7f216c161540 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 >> v1:172.21.15.132:6789/0 conn(0x7f216c161540 legacy=0x7f216c06f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2154003970 0x7f2154003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21540047c0 0x7f2154004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2154005180 0x7f215400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0d0a30 con 0x7f21540047c0 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215400c020 con 0x7f2154003970 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215400c1e0 con 0x7f2154005180 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.692+0000 7f216b7fe640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21540047c0 0x7f2154004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.693+0000 7f216bfff640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2154003970 0x7f2154003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.693+0000 7f2170964640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2154005180 0x7f215400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.693+0000 7f216b7fe640 1 -- 172.21.15.132:0/3945281098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2154005180 msgr2=0x7f215400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.693+0000 7f216b7fe640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2154005180 0x7f215400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.693+0000 7f216b7fe640 1 -- 172.21.15.132:0/3945281098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2154003970 msgr2=0x7f2154003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.693+0000 7f216b7fe640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2154003970 0x7f2154003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.693+0000 7f216b7fe640 1 -- 172.21.15.132:0/3945281098 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2154003520 con 0x7f21540047c0 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.693+0000 7f2170964640 1 -- 172.21.15.132:0/3945281098 reap_dead start 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.693+0000 7f216b7fe640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21540047c0 0x7f2154004c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2160009ac0 tx=0x7f21540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc23c46d4ff7954 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:18.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.694+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216002c6b0 con 0x7f21540047c0 2024-03-16T17:48:18.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.694+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216002c810 con 0x7f21540047c0 2024-03-16T17:48:18.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.694+0000 7f216affd640 1 -- 172.21.15.132:0/3945281098 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216002cba0 con 0x7f21540047c0 2024-03-16T17:48:18.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.694+0000 7f21723c7640 1 -- 172.21.15.132:0/3945281098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21540047c0 msgr2=0x7f2154004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.694+0000 7f21723c7640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21540047c0 0x7f2154004c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2160009ac0 tx=0x7f21540057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.694+0000 7f21723c7640 1 -- 172.21.15.132:0/3945281098 shutdown_connections 2024-03-16T17:48:18.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.694+0000 7f21723c7640 1 --2- 172.21.15.132:0/3945281098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21540047c0 0x7f2154004c40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.694+0000 7f21723c7640 1 -- 172.21.15.132:0/3945281098 >> 172.21.15.132:0/3945281098 conn(0x7f216c09aa70 msgr2=0x7f216c09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:18.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.694+0000 7f21723c7640 1 -- 172.21.15.132:0/3945281098 shutdown_connections 2024-03-16T17:48:18.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.694+0000 7f21723c7640 1 -- 172.21.15.132:0/3945281098 wait complete. 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.695+0000 7f21723c7640 1 Processor -- start 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.696+0000 7f21723c7640 1 -- start start 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.696+0000 7f21723c7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21540047c0 0x7f216c15b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.696+0000 7f21723c7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c0c9eb0 0x7f216c0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.696+0000 7f21723c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0b16e0 0x7f216c0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.696+0000 7f21723c7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b20a0 con 0x7f216c0b16e0 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.696+0000 7f21723c7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c57f0 con 0x7f216c0c9eb0 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.696+0000 7f21723c7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0ca930 con 0x7f21540047c0 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.696+0000 7f2170964640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0b16e0 0x7f216c0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.696+0000 7f2170964640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0b16e0 0x7f216c0b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41222/0 (socket says 172.21.15.132:41222) 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.696+0000 7f2170964640 1 -- 172.21.15.132:0/342355900 learned_addr learned my addr 172.21.15.132:0/342355900 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f216b7fe640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c0c9eb0 0x7f216c0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f216bfff640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21540047c0 0x7f216c15b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f2170964640 1 -- 172.21.15.132:0/342355900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21540047c0 msgr2=0x7f216c15b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f2170964640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21540047c0 0x7f216c15b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f2170964640 1 -- 172.21.15.132:0/342355900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c0c9eb0 msgr2=0x7f216c0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f2170964640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c0c9eb0 0x7f216c0ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f2170964640 1 -- 172.21.15.132:0/342355900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0cac10 con 0x7f216c0b16e0 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f216b7fe640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c0c9eb0 0x7f216c0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f216bfff640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21540047c0 0x7f216c15b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f2170964640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0b16e0 0x7f216c0b1b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2164007fd0 tx=0x7f216400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f2168ff9640 1 -- 172.21.15.132:0/342355900 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400eed0 con 0x7f216c0b16e0 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f2168ff9640 1 -- 172.21.15.132:0/342355900 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164003970 con 0x7f216c0b16e0 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f21723c7640 1 -- 172.21.15.132:0/342355900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c0caef0 con 0x7f216c0b16e0 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f2168ff9640 1 -- 172.21.15.132:0/342355900 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164003d40 con 0x7f216c0b16e0 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.697+0000 7f21723c7640 1 -- 172.21.15.132:0/342355900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c06cc10 con 0x7f216c0b16e0 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.698+0000 7f21723c7640 1 -- 172.21.15.132:0/342355900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c0c59b0 con 0x7f216c0b16e0 2024-03-16T17:48:18.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.698+0000 7f2168ff9640 1 -- 172.21.15.132:0/342355900 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f21640050d0 con 0x7f216c0b16e0 2024-03-16T17:48:18.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.699+0000 7f2168ff9640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f215806b3e0 0x7f215806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:18.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.699+0000 7f2168ff9640 1 -- 172.21.15.132:0/342355900 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2164089900 con 0x7f216c0b16e0 2024-03-16T17:48:18.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.699+0000 7f216bfff640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f215806b3e0 0x7f215806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:18.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.699+0000 7f216bfff640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f215806b3e0 0x7f215806d8a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f215c007d40 tx=0x7f215c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:18.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.703+0000 7f2168ff9640 1 -- 172.21.15.132:0/342355900 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2164054560 con 0x7f216c0b16e0 2024-03-16T17:48:18.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.994+0000 7f21723c7640 1 -- 172.21.15.132:0/342355900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f216c09ff60 con 0x7f216c0b16e0 2024-03-16T17:48:19.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:18.999+0000 7f2168ff9640 1 -- 172.21.15.132:0/342355900 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2164057c20 con 0x7f216c0b16e0 2024-03-16T17:48:19.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.001+0000 7f21723c7640 1 -- 172.21.15.132:0/342355900 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f215806b3e0 msgr2=0x7f215806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.001+0000 7f21723c7640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f215806b3e0 0x7f215806d8a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f215c007d40 tx=0x7f215c009040 comp rx=0 tx=0).stop 2024-03-16T17:48:19.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.001+0000 7f21723c7640 1 -- 172.21.15.132:0/342355900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0b16e0 msgr2=0x7f216c0b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.001+0000 7f21723c7640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0b16e0 0x7f216c0b1b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2164007fd0 tx=0x7f216400eb90 comp rx=0 tx=0).stop 2024-03-16T17:48:19.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.001+0000 7f21723c7640 1 -- 172.21.15.132:0/342355900 shutdown_connections 2024-03-16T17:48:19.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.001+0000 7f21723c7640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f215806b3e0 0x7f215806d8a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.001+0000 7f21723c7640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f216c0b16e0 0x7f216c0b1b60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.001+0000 7f21723c7640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c0c9eb0 0x7f216c0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.001+0000 7f21723c7640 1 --2- 172.21.15.132:0/342355900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21540047c0 0x7f216c15b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.001+0000 7f21723c7640 1 -- 172.21.15.132:0/342355900 >> 172.21.15.132:0/342355900 conn(0x7f216c09aa70 msgr2=0x7f216c0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:19.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.002+0000 7f21723c7640 1 -- 172.21.15.132:0/342355900 shutdown_connections 2024-03-16T17:48:19.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.002+0000 7f21723c7640 1 -- 172.21.15.132:0/342355900 wait complete. 2024-03-16T17:48:19.016 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-16T17:48:19.016 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T17:48:19.070 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-16T17:48:19.114 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-16T17:48:19.114 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:48:19.114 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:19.130 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:48:19.130 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:19.185 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:48:19.186 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:19.242 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:19.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.378+0000 7f430065c640 1 Processor -- start 2024-03-16T17:48:19.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.378+0000 7f430065c640 1 -- start start 2024-03-16T17:48:19.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f430065c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42f80b3dd0 0x7f42f80b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f430065c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f8072030 con 0x7f42f80b35c0 2024-03-16T17:48:19.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f430065c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f806d2c0 con 0x7f42f80cda00 2024-03-16T17:48:19.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f430065c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f80717d0 con 0x7f42f80b3dd0 2024-03-16T17:48:19.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f42fe3f8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42f80b3dd0 0x7f42f80b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f42fe3f8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42f80b3dd0 0x7f42f80b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41238/0 (socket says 172.21.15.132:41238) 2024-03-16T17:48:19.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f42fdbf7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f42f80b35c0 0x7f42f80724c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32912/0 (socket says 172.21.15.132:32912) 2024-03-16T17:48:19.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f42fe3f8640 1 -- 172.21.15.132:0/20155689 learned_addr learned my addr 172.21.15.132:0/20155689 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:19.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f42fe3f8640 1 -- 172.21.15.132:0/20155689 >> v1:172.21.15.194:6789/0 conn(0x7f42f80cda00 legacy=0x7f42f80cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f42fe3f8640 1 -- 172.21.15.132:0/20155689 >> v1:172.21.15.132:6789/0 conn(0x7f42f80b35c0 legacy=0x7f42f80724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f42fe3f8640 1 -- 172.21.15.132:0/20155689 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8072bd0 con 0x7f42f80b3dd0 2024-03-16T17:48:19.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.379+0000 7f42fd3f6640 1 -- 172.21.15.132:0/20155689 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509795001 0 0) 0x7f42f8072030 con 0x7f42f80b35c0 2024-03-16T17:48:19.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.380+0000 7f42fe3f8640 1 --2- 172.21.15.132:0/20155689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80b3dd0 0x7f42f80b41b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f42f8071910 tx=0x7f42e802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e4e24c9df8e586 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:19.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.380+0000 7f42fd3f6640 1 -- 172.21.15.132:0/20155689 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8030840 con 0x7f42f80b3dd0 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.380+0000 7f42fd3f6640 1 -- 172.21.15.132:0/20155689 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e80309a0 con 0x7f42f80b3dd0 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.380+0000 7f42fd3f6640 1 -- 172.21.15.132:0/20155689 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8030d30 con 0x7f42f80b3dd0 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.381+0000 7f430065c640 1 -- 172.21.15.132:0/20155689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80b3dd0 msgr2=0x7f42f80b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.381+0000 7f430065c640 1 --2- 172.21.15.132:0/20155689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80b3dd0 0x7f42f80b41b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f42f8071910 tx=0x7f42e802b980 comp rx=0 tx=0).stop 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.381+0000 7f430065c640 1 -- 172.21.15.132:0/20155689 shutdown_connections 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.381+0000 7f430065c640 1 --2- 172.21.15.132:0/20155689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80b3dd0 0x7f42f80b41b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.381+0000 7f430065c640 1 -- 172.21.15.132:0/20155689 >> 172.21.15.132:0/20155689 conn(0x7f42f806aee0 msgr2=0x7f42f806b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.381+0000 7f430065c640 1 -- 172.21.15.132:0/20155689 shutdown_connections 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.381+0000 7f430065c640 1 -- 172.21.15.132:0/20155689 wait complete. 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.382+0000 7f430065c640 1 Processor -- start 2024-03-16T17:48:19.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.382+0000 7f430065c640 1 -- start start 2024-03-16T17:48:19.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.383+0000 7f430065c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42f80b35c0 0x7f42f81e0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.383+0000 7f430065c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42f80b3dd0 0x7f42f81376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.383+0000 7f430065c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80cda00 0x7f42f81e2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.383+0000 7f430065c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80cb8c0 con 0x7f42f80cda00 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.383+0000 7f430065c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80c84a0 con 0x7f42f80b3dd0 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.383+0000 7f430065c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f8137c10 con 0x7f42f80b35c0 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.383+0000 7f42febf9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80cda00 0x7f42f81e2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.383+0000 7f42febf9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80cda00 0x7f42f81e2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41252/0 (socket says 172.21.15.132:41252) 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42febf9640 1 -- 172.21.15.132:0/797308806 learned_addr learned my addr 172.21.15.132:0/797308806 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42fdbf7640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42f80b3dd0 0x7f42f81376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42fe3f8640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42f80b35c0 0x7f42f81e0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42febf9640 1 -- 172.21.15.132:0/797308806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42f80b35c0 msgr2=0x7f42f81e0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42febf9640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42f80b35c0 0x7f42f81e0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42febf9640 1 -- 172.21.15.132:0/797308806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42f80b3dd0 msgr2=0x7f42f81376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42febf9640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42f80b3dd0 0x7f42f81376d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42febf9640 1 -- 172.21.15.132:0/797308806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e80094d0 con 0x7f42f80cda00 2024-03-16T17:48:19.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42fe3f8640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42f80b35c0 0x7f42f81e0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:19.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42febf9640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80cda00 0x7f42f81e2c00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c7a0 tx=0x7f42f000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:19.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42eeffd640 1 -- 172.21.15.132:0/797308806 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0003b70 con 0x7f42f80cda00 2024-03-16T17:48:19.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42eeffd640 1 -- 172.21.15.132:0/797308806 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0003cf0 con 0x7f42f80cda00 2024-03-16T17:48:19.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f42eeffd640 1 -- 172.21.15.132:0/797308806 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0003ea0 con 0x7f42f80cda00 2024-03-16T17:48:19.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f430065c640 1 -- 172.21.15.132:0/797308806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f80cb5e0 con 0x7f42f80cda00 2024-03-16T17:48:19.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.384+0000 7f430065c640 1 -- 172.21.15.132:0/797308806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f80c8130 con 0x7f42f80cda00 2024-03-16T17:48:19.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.385+0000 7f430065c640 1 -- 172.21.15.132:0/797308806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f80c8630 con 0x7f42f80cda00 2024-03-16T17:48:19.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.386+0000 7f42eeffd640 1 -- 172.21.15.132:0/797308806 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f42f000aa90 con 0x7f42f80cda00 2024-03-16T17:48:19.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.386+0000 7f42eeffd640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f42dc06b3b0 0x7f42dc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.386+0000 7f42eeffd640 1 -- 172.21.15.132:0/797308806 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42f00899b0 con 0x7f42f80cda00 2024-03-16T17:48:19.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.386+0000 7f42fe3f8640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f42dc06b3b0 0x7f42dc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.387+0000 7f42fe3f8640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f42dc06b3b0 0x7f42dc06d870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f42e8036000 tx=0x7f42e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:19.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.390+0000 7f42eeffd640 1 -- 172.21.15.132:0/797308806 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f42f0054610 con 0x7f42f80cda00 2024-03-16T17:48:19.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.570+0000 7f430065c640 1 -- 172.21.15.132:0/797308806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42f8072910 con 0x7f42f80cda00 2024-03-16T17:48:19.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.571+0000 7f42eeffd640 1 -- 172.21.15.132:0/797308806 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f42f0057cd0 con 0x7f42f80cda00 2024-03-16T17:48:19.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:19.575 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:19.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.572+0000 7f430065c640 1 -- 172.21.15.132:0/797308806 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f42dc06b3b0 msgr2=0x7f42dc06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f42dc06b3b0 0x7f42dc06d870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f42e8036000 tx=0x7f42e8008030 comp rx=0 tx=0).stop 2024-03-16T17:48:19.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 -- 172.21.15.132:0/797308806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80cda00 msgr2=0x7f42f81e2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80cda00 0x7f42f81e2c00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c7a0 tx=0x7f42f000cc60 comp rx=0 tx=0).stop 2024-03-16T17:48:19.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 -- 172.21.15.132:0/797308806 shutdown_connections 2024-03-16T17:48:19.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f42dc06b3b0 0x7f42dc06d870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42f80cda00 0x7f42f81e2c00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42f80b3dd0 0x7f42f81376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 --2- 172.21.15.132:0/797308806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42f80b35c0 0x7f42f81e0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 -- 172.21.15.132:0/797308806 >> 172.21.15.132:0/797308806 conn(0x7f42f806aee0 msgr2=0x7f42f806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:19.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 -- 172.21.15.132:0/797308806 shutdown_connections 2024-03-16T17:48:19.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.573+0000 7f430065c640 1 -- 172.21.15.132:0/797308806 wait complete. 2024-03-16T17:48:19.588 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:19.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.690+0000 7f7fe69d7640 1 Processor -- start 2024-03-16T17:48:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.690+0000 7f7fe69d7640 1 -- start start 2024-03-16T17:48:19.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.690+0000 7f7fe69d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe00d0d10 0x7f7fe00b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fe69d7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe00cff20 con 0x7f7fe0161b40 2024-03-16T17:48:19.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fe69d7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe00b5500 con 0x7f7fe0161760 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fe69d7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00cf5f0 con 0x7f7fe00d0d10 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fe4f74640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7fe0161b40 0x7f7fe00c7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32922/0 (socket says 172.21.15.132:32922) 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fe4f74640 1 -- 172.21.15.132:0/690952002 learned_addr learned my addr 172.21.15.132:0/690952002 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdf7fe640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe00d0d10 0x7f7fe00b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380361938 0 0) 0x7f7fe00cff20 con 0x7f7fe0161b40 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc8003520 con 0x7f7fe0161b40 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3245079920 0 0) 0x7f7fc8003520 con 0x7f7fe0161b40 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe00d0d10 msgr2=0x7f7fe00b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe00d0d10 0x7f7fe00b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 >> v1:172.21.15.194:6789/0 conn(0x7f7fe0161760 legacy=0x7f7fe00d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe00cf8d0 con 0x7f7fe0161b40 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f7fd80019f0 con 0x7f7fe0161b40 2024-03-16T17:48:19.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 >> v1:172.21.15.132:6789/0 conn(0x7f7fe0161b40 legacy=0x7f7fe00c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc80039a0 0x7f7fc8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe00d0d10 0x7f7fc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc8004d00 0x7f7fc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00cf5f0 con 0x7f7fc80039a0 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc800b980 con 0x7f7fc8004d00 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc800bb40 con 0x7f7fe00d0d10 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.691+0000 7f7fdffff640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc80039a0 0x7f7fc8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.692+0000 7f7fdf7fe640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe00d0d10 0x7f7fc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.692+0000 7f7fe4f74640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc8004d00 0x7f7fc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.692+0000 7f7fdffff640 1 -- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe00d0d10 msgr2=0x7f7fc80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.692+0000 7f7fdffff640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe00d0d10 0x7f7fc80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.692+0000 7f7fdffff640 1 -- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc8004d00 msgr2=0x7f7fc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.692+0000 7f7fdffff640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc8004d00 0x7f7fc8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.692+0000 7f7fdffff640 1 -- 172.21.15.132:0/690952002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8003520 con 0x7f7fc80039a0 2024-03-16T17:48:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.692+0000 7f7fe4f74640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc8004d00 0x7f7fc8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.692+0000 7f7fdf7fe640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe00d0d10 0x7f7fc80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.693+0000 7f7fdffff640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc80039a0 0x7f7fc8003d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4001860 tx=0x7f7fc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ea8b1e64fd8df2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.693+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4033640 con 0x7f7fc80039a0 2024-03-16T17:48:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.693+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd40337c0 con 0x7f7fc80039a0 2024-03-16T17:48:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.693+0000 7f7fdeffd640 1 -- 172.21.15.132:0/690952002 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4033b70 con 0x7f7fc80039a0 2024-03-16T17:48:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.694+0000 7f7fe69d7640 1 -- 172.21.15.132:0/690952002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc80039a0 msgr2=0x7f7fc8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.694+0000 7f7fe69d7640 1 --2- 172.21.15.132:0/690952002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc80039a0 0x7f7fc8003d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4001860 tx=0x7f7fc80057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.694+0000 7f7fe4f74640 1 -- 172.21.15.132:0/690952002 reap_dead start 2024-03-16T17:48:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.694+0000 7f7fe69d7640 1 -- 172.21.15.132:0/690952002 shutdown_connections 2024-03-16T17:48:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.694+0000 7f7fe69d7640 1 -- 172.21.15.132:0/690952002 >> 172.21.15.132:0/690952002 conn(0x7f7fe00d3ed0 msgr2=0x7f7fe00d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.694+0000 7f7fe69d7640 1 -- 172.21.15.132:0/690952002 shutdown_connections 2024-03-16T17:48:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.694+0000 7f7fe69d7640 1 -- 172.21.15.132:0/690952002 wait complete. 2024-03-16T17:48:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.695+0000 7f7fe69d7640 1 Processor -- start 2024-03-16T17:48:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.695+0000 7f7fe69d7640 1 -- start start 2024-03-16T17:48:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fe69d7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc80039a0 0x7f7fe0159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fe69d7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe0159c10 0x7f7fe0157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fe69d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe015a160 0x7f7fe015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fe69d7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe015b020 con 0x7f7fe0159c10 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fe69d7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00b1a10 con 0x7f7fc80039a0 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fe69d7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe015ab20 con 0x7f7fe015a160 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe0159c10 0x7f7fe0157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe0159c10 0x7f7fe0157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41270/0 (socket says 172.21.15.132:41270) 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdf7fe640 1 -- 172.21.15.132:0/3803725279 learned_addr learned my addr 172.21.15.132:0/3803725279 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdffff640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc80039a0 0x7f7fe0159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fe4f74640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe015a160 0x7f7fe015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdf7fe640 1 -- 172.21.15.132:0/3803725279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe015a160 msgr2=0x7f7fe015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdf7fe640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe015a160 0x7f7fe015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdf7fe640 1 -- 172.21.15.132:0/3803725279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc80039a0 msgr2=0x7f7fe0159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdf7fe640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc80039a0 0x7f7fe0159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdf7fe640 1 -- 172.21.15.132:0/3803725279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe01588b0 con 0x7f7fe0159c10 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdffff640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc80039a0 0x7f7fe0159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdf7fe640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe0159c10 0x7f7fe0157750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00116d0 tx=0x7f7fd0011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.696+0000 7f7fdcff9640 1 -- 172.21.15.132:0/3803725279 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000f9c0 con 0x7f7fe0159c10 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.697+0000 7f7fdcff9640 1 -- 172.21.15.132:0/3803725279 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd000fb20 con 0x7f7fe0159c10 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.697+0000 7f7fe69d7640 1 -- 172.21.15.132:0/3803725279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe00cafa0 con 0x7f7fe0159c10 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.697+0000 7f7fdcff9640 1 -- 172.21.15.132:0/3803725279 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000fed0 con 0x7f7fe0159c10 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.697+0000 7f7fe69d7640 1 -- 172.21.15.132:0/3803725279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe0158de0 con 0x7f7fe0159c10 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.698+0000 7f7fe69d7640 1 -- 172.21.15.132:0/3803725279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe0068450 con 0x7f7fe0159c10 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.698+0000 7f7fdcff9640 1 -- 172.21.15.132:0/3803725279 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f7fd0015460 con 0x7f7fe0159c10 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.698+0000 7f7fdcff9640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7fcc06b3b0 0x7f7fcc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.698+0000 7f7fdcff9640 1 -- 172.21.15.132:0/3803725279 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fd008a440 con 0x7f7fe0159c10 2024-03-16T17:48:19.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.699+0000 7f7fdffff640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7fcc06b3b0 0x7f7fcc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:19.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.699+0000 7f7fdffff640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7fcc06b3b0 0x7f7fcc06d870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4035000 tx=0x7f7fd4009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:19.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.703+0000 7f7fdcff9640 1 -- 172.21.15.132:0/3803725279 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7fd00550b0 con 0x7f7fe0159c10 2024-03-16T17:48:19.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.875+0000 7f7fe69d7640 1 -- 172.21.15.132:0/3803725279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fe00a1d50 con 0x7f7fe0159c10 2024-03-16T17:48:19.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.875+0000 7f7fdcff9640 1 -- 172.21.15.132:0/3803725279 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fd0058770 con 0x7f7fe0159c10 2024-03-16T17:48:19.879 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:19.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 -- 172.21.15.132:0/3803725279 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7fcc06b3b0 msgr2=0x7f7fcc06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7fcc06b3b0 0x7f7fcc06d870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4035000 tx=0x7f7fd4009030 comp rx=0 tx=0).stop 2024-03-16T17:48:19.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 -- 172.21.15.132:0/3803725279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe0159c10 msgr2=0x7f7fe0157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:19.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe0159c10 0x7f7fe0157750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00116d0 tx=0x7f7fd0011b90 comp rx=0 tx=0).stop 2024-03-16T17:48:19.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 -- 172.21.15.132:0/3803725279 shutdown_connections 2024-03-16T17:48:19.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7fcc06b3b0 0x7f7fcc06d870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fe015a160 0x7f7fe015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fe0159c10 0x7f7fe0157750 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 --2- 172.21.15.132:0/3803725279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fc80039a0 0x7f7fe0159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:19.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 -- 172.21.15.132:0/3803725279 >> 172.21.15.132:0/3803725279 conn(0x7f7fe00d3ed0 msgr2=0x7f7fe006cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:19.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 -- 172.21.15.132:0/3803725279 shutdown_connections 2024-03-16T17:48:19.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.877+0000 7f7fe69d7640 1 -- 172.21.15.132:0/3803725279 wait complete. 2024-03-16T17:48:19.892 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:19.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.992+0000 7f8eaf609640 1 Processor -- start 2024-03-16T17:48:19.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.992+0000 7f8eaf609640 1 -- start start 2024-03-16T17:48:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.993+0000 7f8eaf609640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ea8161760 0x7f8ea80b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.993+0000 7f8eaf609640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8ea8161b40 0x7f8ea80d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.993+0000 7f8eaf609640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea80cff20 con 0x7f8ea80d49f0 2024-03-16T17:48:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.993+0000 7f8eaf609640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea80b5500 con 0x7f8ea8161b40 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.993+0000 7f8eaf609640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80cf5f0 con 0x7f8ea8161760 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8eadba6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8ea80d49f0 0x7f8ea80d1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32924/0 (socket says 172.21.15.132:32924) 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8eadba6640 1 -- 172.21.15.132:0/2218039917 learned_addr learned my addr 172.21.15.132:0/2218039917 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8eacba4640 1 --2- 172.21.15.132:0/2218039917 >> v2:172.21.15.194:3300/0 conn(0x7f8ea8161b40 0x7f8ea80d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8ead3a5640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ea8161760 0x7f8ea80b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412087298 0 0) 0x7f8ea80cff20 con 0x7f8ea80d49f0 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e94003520 con 0x7f8ea80d49f0 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1007398443 0 0) 0x7f8e94003520 con 0x7f8ea80d49f0 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ea8161760 msgr2=0x7f8ea80b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ea8161760 0x7f8ea80b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 >> v2:172.21.15.194:3300/0 conn(0x7f8ea8161b40 msgr2=0x7f8ea80d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:20.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 --2- 172.21.15.132:0/2218039917 >> v2:172.21.15.194:3300/0 conn(0x7f8ea8161b40 0x7f8ea80d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea80cf8d0 con 0x7f8ea80d49f0 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f8ea00019f0 con 0x7f8ea80d49f0 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8eacba4640 1 --2- 172.21.15.132:0/2218039917 >> v2:172.21.15.194:3300/0 conn(0x7f8ea8161b40 0x7f8ea80d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 >> v1:172.21.15.132:6789/0 conn(0x7f8ea80d49f0 legacy=0x7f8ea80d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ea8161760 0x7f8e94003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e94003ef0 0x7f8e940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e94004d00 0x7f8e94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80b5500 con 0x7f8e94003ef0 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80cf5f0 con 0x7f8e94004d00 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9400b980 con 0x7f8ea8161760 2024-03-16T17:48:20.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8eacba4640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e94003ef0 0x7f8e940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8eadba6640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e94004d00 0x7f8e94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.994+0000 7f8ead3a5640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ea8161760 0x7f8e94003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.995+0000 7f8eacba4640 1 -- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ea8161760 msgr2=0x7f8e94003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.995+0000 7f8eacba4640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ea8161760 0x7f8e94003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.995+0000 7f8eacba4640 1 -- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e94004d00 msgr2=0x7f8e94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.995+0000 7f8eacba4640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e94004d00 0x7f8e94005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.995+0000 7f8eacba4640 1 -- 172.21.15.132:0/2218039917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e94003520 con 0x7f8e94003ef0 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.995+0000 7f8ead3a5640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ea8161760 0x7f8e94003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.996+0000 7f8eacba4640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e94003ef0 0x7f8e940047c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009c90 tx=0x7f8e940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebf8c2f881d94ab server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.996+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9802c980 con 0x7f8e94003ef0 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.996+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9802cae0 con 0x7f8e94003ef0 2024-03-16T17:48:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.996+0000 7f8e9ffff640 1 -- 172.21.15.132:0/2218039917 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98034440 con 0x7f8e94003ef0 2024-03-16T17:48:20.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.996+0000 7f8eaf609640 1 -- 172.21.15.132:0/2218039917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e94003ef0 msgr2=0x7f8e940047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.996+0000 7f8eaf609640 1 --2- 172.21.15.132:0/2218039917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e94003ef0 0x7f8e940047c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009c90 tx=0x7f8e940057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.996+0000 7f8eadba6640 1 -- 172.21.15.132:0/2218039917 reap_dead start 2024-03-16T17:48:20.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.996+0000 7f8eaf609640 1 -- 172.21.15.132:0/2218039917 shutdown_connections 2024-03-16T17:48:20.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.996+0000 7f8eaf609640 1 -- 172.21.15.132:0/2218039917 >> 172.21.15.132:0/2218039917 conn(0x7f8ea80d3ed0 msgr2=0x7f8ea80d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:20.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.997+0000 7f8eaf609640 1 -- 172.21.15.132:0/2218039917 shutdown_connections 2024-03-16T17:48:20.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.997+0000 7f8eaf609640 1 -- 172.21.15.132:0/2218039917 wait complete. 2024-03-16T17:48:20.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eaf609640 1 Processor -- start 2024-03-16T17:48:20.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eaf609640 1 -- start start 2024-03-16T17:48:20.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eaf609640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e94003ef0 0x7f8ea80cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eaf609640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea81e89d0 0x7f8ea81f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eaf609640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea815fc20 0x7f8ea81600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eaf609640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80cc430 con 0x7f8ea81e89d0 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eaf609640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81605e0 con 0x7f8ea815fc20 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eaf609640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea80cb4e0 con 0x7f8e94003ef0 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eacba4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea81e89d0 0x7f8ea81f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eacba4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea81e89d0 0x7f8ea81f6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41280/0 (socket says 172.21.15.132:41280) 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.998+0000 7f8eacba4640 1 -- 172.21.15.132:0/970029968 learned_addr learned my addr 172.21.15.132:0/970029968 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8ead3a5640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e94003ef0 0x7f8ea80cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8eacba4640 1 -- 172.21.15.132:0/970029968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e94003ef0 msgr2=0x7f8ea80cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8eadba6640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea815fc20 0x7f8ea81600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8eacba4640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e94003ef0 0x7f8ea80cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8eacba4640 1 -- 172.21.15.132:0/970029968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea815fc20 msgr2=0x7f8ea81600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8eacba4640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea815fc20 0x7f8ea81600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8eacba4640 1 -- 172.21.15.132:0/970029968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea81f7250 con 0x7f8ea81e89d0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8eacba4640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea81e89d0 0x7f8ea81f6d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009db0 tx=0x7f8e98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8e9dffb640 1 -- 172.21.15.132:0/970029968 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98034c80 con 0x7f8ea81e89d0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8e9dffb640 1 -- 172.21.15.132:0/970029968 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98034e20 con 0x7f8ea81e89d0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8eaf609640 1 -- 172.21.15.132:0/970029968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea80cb7b0 con 0x7f8ea81e89d0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8e9dffb640 1 -- 172.21.15.132:0/970029968 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98040690 con 0x7f8ea81e89d0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:19.999+0000 7f8eaf609640 1 -- 172.21.15.132:0/970029968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea80cbd70 con 0x7f8ea81e89d0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.001+0000 7f8eaf609640 1 -- 172.21.15.132:0/970029968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea8068450 con 0x7f8ea81e89d0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.001+0000 7f8e9dffb640 1 -- 172.21.15.132:0/970029968 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f8e980407f0 con 0x7f8ea81e89d0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.001+0000 7f8e9dffb640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8e8c06b3b0 0x7f8e8c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.001+0000 7f8e9dffb640 1 -- 172.21.15.132:0/970029968 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e980abee0 con 0x7f8ea81e89d0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.001+0000 7f8ead3a5640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8e8c06b3b0 0x7f8e8c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.002+0000 7f8ead3a5640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8e8c06b3b0 0x7f8e8c06d870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098d0 tx=0x7f8ea4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:20.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.006+0000 7f8e9dffb640 1 -- 172.21.15.132:0/970029968 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8e98076c60 con 0x7f8ea81e89d0 2024-03-16T17:48:20.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.212+0000 7f8eaf609640 1 -- 172.21.15.132:0/970029968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ea80a1d50 con 0x7f8ea81e89d0 2024-03-16T17:48:20.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.213+0000 7f8e9dffb640 1 -- 172.21.15.132:0/970029968 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e9807a320 con 0x7f8ea81e89d0 2024-03-16T17:48:20.216 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 -- 172.21.15.132:0/970029968 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8e8c06b3b0 msgr2=0x7f8e8c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8e8c06b3b0 0x7f8e8c06d870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098d0 tx=0x7f8ea4008040 comp rx=0 tx=0).stop 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 -- 172.21.15.132:0/970029968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea81e89d0 msgr2=0x7f8ea81f6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea81e89d0 0x7f8ea81f6d10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009db0 tx=0x7f8e98004730 comp rx=0 tx=0).stop 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 -- 172.21.15.132:0/970029968 shutdown_connections 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8e8c06b3b0 0x7f8e8c06d870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ea815fc20 0x7f8ea81600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ea81e89d0 0x7f8ea81f6d10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 --2- 172.21.15.132:0/970029968 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e94003ef0 0x7f8ea80cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 -- 172.21.15.132:0/970029968 >> 172.21.15.132:0/970029968 conn(0x7f8ea80d3ed0 msgr2=0x7f8ea80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 -- 172.21.15.132:0/970029968 shutdown_connections 2024-03-16T17:48:20.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.215+0000 7f8eaf609640 1 -- 172.21.15.132:0/970029968 wait complete. 2024-03-16T17:48:20.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:20.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.331+0000 7fed7453e640 1 Processor -- start 2024-03-16T17:48:20.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.331+0000 7fed7453e640 1 -- start start 2024-03-16T17:48:20.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed7453e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fed6c15eeb0 0x7fed6c06e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed7453e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed6c15f340 0x7fed6c0b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed7453e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c1449a0 con 0x7fed6c1445c0 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed7453e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c06cc00 con 0x7fed6c15f340 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed7453e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c072220 con 0x7fed6c15eeb0 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed72adb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed6c15f340 0x7fed6c0b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed722da640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fed6c1445c0 0x7fed6c15e7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32932/0 (socket says 172.21.15.132:32932) 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed722da640 1 -- 172.21.15.132:0/1332382569 learned_addr learned my addr 172.21.15.132:0/1332382569 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed71ad9640 1 --2- 172.21.15.132:0/1332382569 >> v2:172.21.15.194:3300/0 conn(0x7fed6c15eeb0 0x7fed6c06e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed72adb640 1 -- 172.21.15.132:0/1332382569 >> v2:172.21.15.194:3300/0 conn(0x7fed6c15eeb0 msgr2=0x7fed6c06e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed72adb640 1 --2- 172.21.15.132:0/1332382569 >> v2:172.21.15.194:3300/0 conn(0x7fed6c15eeb0 0x7fed6c06e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed72adb640 1 -- 172.21.15.132:0/1332382569 >> v1:172.21.15.132:6789/0 conn(0x7fed6c1445c0 legacy=0x7fed6c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed712d8640 1 -- 172.21.15.132:0/1332382569 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987189273 0 0) 0x7fed6c1449a0 con 0x7fed6c1445c0 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed72adb640 1 -- 172.21.15.132:0/1332382569 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c06ce50 con 0x7fed6c15f340 2024-03-16T17:48:20.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.333+0000 7fed71ad9640 1 --2- 172.21.15.132:0/1332382569 >> v2:172.21.15.194:3300/0 conn(0x7fed6c15eeb0 0x7fed6c06e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.335+0000 7fed72adb640 1 --2- 172.21.15.132:0/1332382569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 0x7fed6c0b2c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fed6c073050 tx=0x7fed6402e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624941dde5e30f96 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.335+0000 7fed712d8640 1 -- 172.21.15.132:0/1332382569 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6402ea60 con 0x7fed6c15f340 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.335+0000 7fed712d8640 1 -- 172.21.15.132:0/1332382569 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6402ebc0 con 0x7fed6c15f340 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.335+0000 7fed712d8640 1 -- 172.21.15.132:0/1332382569 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64009540 con 0x7fed6c15f340 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.336+0000 7fed7453e640 1 -- 172.21.15.132:0/1332382569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 msgr2=0x7fed6c0b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.336+0000 7fed7453e640 1 --2- 172.21.15.132:0/1332382569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 0x7fed6c0b2c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fed6c073050 tx=0x7fed6402e0c0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.336+0000 7fed7453e640 1 -- 172.21.15.132:0/1332382569 shutdown_connections 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.336+0000 7fed7453e640 1 --2- 172.21.15.132:0/1332382569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 0x7fed6c0b2c40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.336+0000 7fed7453e640 1 --2- 172.21.15.132:0/1332382569 >> v2:172.21.15.194:3300/0 conn(0x7fed6c15eeb0 0x7fed6c06e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.336+0000 7fed7453e640 1 -- 172.21.15.132:0/1332382569 >> 172.21.15.132:0/1332382569 conn(0x7fed6c06aee0 msgr2=0x7fed6c06b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.336+0000 7fed7453e640 1 -- 172.21.15.132:0/1332382569 shutdown_connections 2024-03-16T17:48:20.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.336+0000 7fed7453e640 1 -- 172.21.15.132:0/1332382569 wait complete. 2024-03-16T17:48:20.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.338+0000 7fed7453e640 1 Processor -- start 2024-03-16T17:48:20.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.338+0000 7fed7453e640 1 -- start start 2024-03-16T17:48:20.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed7453e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed6c1445c0 0x7fed6c13cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed7453e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed6c15eeb0 0x7fed6c0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed7453e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 0x7fed6c0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed7453e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0a9a10 con 0x7fed6c15f340 2024-03-16T17:48:20.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed7453e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c15d4c0 con 0x7fed6c1445c0 2024-03-16T17:48:20.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed7453e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c15e9a0 con 0x7fed6c15eeb0 2024-03-16T17:48:20.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed72adb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 0x7fed6c0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed72adb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 0x7fed6c0cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41300/0 (socket says 172.21.15.132:41300) 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed72adb640 1 -- 172.21.15.132:0/3346347490 learned_addr learned my addr 172.21.15.132:0/3346347490 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed722da640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed6c1445c0 0x7fed6c13cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed71ad9640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed6c15eeb0 0x7fed6c0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed72adb640 1 -- 172.21.15.132:0/3346347490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed6c15eeb0 msgr2=0x7fed6c0a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed72adb640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed6c15eeb0 0x7fed6c0a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed72adb640 1 -- 172.21.15.132:0/3346347490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed6c1445c0 msgr2=0x7fed6c13cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed72adb640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed6c1445c0 0x7fed6c13cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed72adb640 1 -- 172.21.15.132:0/3346347490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6400bc80 con 0x7fed6c15f340 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.339+0000 7fed71ad9640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed6c15eeb0 0x7fed6c0a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.340+0000 7fed72adb640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 0x7fed6c0cda00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fed64038040 tx=0x7fed64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.340+0000 7fed62ffd640 1 -- 172.21.15.132:0/3346347490 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64040660 con 0x7fed6c15f340 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.340+0000 7fed62ffd640 1 -- 172.21.15.132:0/3346347490 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed640407e0 con 0x7fed6c15f340 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.340+0000 7fed7453e640 1 -- 172.21.15.132:0/3346347490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c15ce70 con 0x7fed6c15f340 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.340+0000 7fed62ffd640 1 -- 172.21.15.132:0/3346347490 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64040b90 con 0x7fed6c15f340 2024-03-16T17:48:20.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.340+0000 7fed7453e640 1 -- 172.21.15.132:0/3346347490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c15e670 con 0x7fed6c15f340 2024-03-16T17:48:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.341+0000 7fed7453e640 1 -- 172.21.15.132:0/3346347490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c15d670 con 0x7fed6c15f340 2024-03-16T17:48:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.341+0000 7fed62ffd640 1 -- 172.21.15.132:0/3346347490 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fed64040cf0 con 0x7fed6c15f340 2024-03-16T17:48:20.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.342+0000 7fed62ffd640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed5006b3b0 0x7fed5006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.342+0000 7fed62ffd640 1 -- 172.21.15.132:0/3346347490 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed640af010 con 0x7fed6c15f340 2024-03-16T17:48:20.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.342+0000 7fed722da640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed5006b3b0 0x7fed5006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.342+0000 7fed722da640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed5006b3b0 0x7fed5006d870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed68000f60 tx=0x7fed68007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:20.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.350+0000 7fed62ffd640 1 -- 172.21.15.132:0/3346347490 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fed6c15d670 con 0x7fed6c15f340 2024-03-16T17:48:20.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.547+0000 7fed7453e640 1 -- 172.21.15.132:0/3346347490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed6c15d630 con 0x7fed6c15f340 2024-03-16T17:48:20.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.547+0000 7fed62ffd640 1 -- 172.21.15.132:0/3346347490 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed64079d00 con 0x7fed6c15f340 2024-03-16T17:48:20.551 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 -- 172.21.15.132:0/3346347490 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed5006b3b0 msgr2=0x7fed5006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed5006b3b0 0x7fed5006d870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fed68000f60 tx=0x7fed68007b50 comp rx=0 tx=0).stop 2024-03-16T17:48:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 -- 172.21.15.132:0/3346347490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 msgr2=0x7fed6c0cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 0x7fed6c0cda00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fed64038040 tx=0x7fed64004a40 comp rx=0 tx=0).stop 2024-03-16T17:48:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 -- 172.21.15.132:0/3346347490 shutdown_connections 2024-03-16T17:48:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed5006b3b0 0x7fed5006d870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed6c15f340 0x7fed6c0cda00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed6c15eeb0 0x7fed6c0a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 --2- 172.21.15.132:0/3346347490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed6c1445c0 0x7fed6c13cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 -- 172.21.15.132:0/3346347490 >> 172.21.15.132:0/3346347490 conn(0x7fed6c06aee0 msgr2=0x7fed6c13f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 -- 172.21.15.132:0/3346347490 shutdown_connections 2024-03-16T17:48:20.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.549+0000 7fed7453e640 1 -- 172.21.15.132:0/3346347490 wait complete. 2024-03-16T17:48:20.564 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T17:48:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.665+0000 7f410fd81640 1 Processor -- start 2024-03-16T17:48:20.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.665+0000 7f410fd81640 1 -- start start 2024-03-16T17:48:20.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410fd81640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f41081444e0 0x7f410815e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410fd81640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41080b3bc0 0x7f410806f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410fd81640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410806f740 0x7f41080b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410fd81640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410806ed70 con 0x7f41080b3bc0 2024-03-16T17:48:20.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410fd81640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41081448c0 con 0x7f41081444e0 2024-03-16T17:48:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410fd81640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410815f690 con 0x7f410806f740 2024-03-16T17:48:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410d31c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41080b3bc0 0x7f410806f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410d31c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41080b3bc0 0x7f410806f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41302/0 (socket says 172.21.15.132:41302) 2024-03-16T17:48:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410d31c640 1 -- 172.21.15.132:0/1730232714 learned_addr learned my addr 172.21.15.132:0/1730232714 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410d31c640 1 -- 172.21.15.132:0/1730232714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410806f740 msgr2=0x7f41080b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410d31c640 1 --2- 172.21.15.132:0/1730232714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410806f740 0x7f41080b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410d31c640 1 -- 172.21.15.132:0/1730232714 >> v2:172.21.15.194:3300/0 conn(0x7f41081444e0 msgr2=0x7f410815e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:20.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410d31c640 1 --2- 172.21.15.132:0/1730232714 >> v2:172.21.15.194:3300/0 conn(0x7f41081444e0 0x7f410815e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.666+0000 7f410d31c640 1 -- 172.21.15.132:0/1730232714 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410815f0d0 con 0x7f41080b3bc0 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.667+0000 7f410d31c640 1 --2- 172.21.15.132:0/1730232714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41080b3bc0 0x7f410806f200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4108072b10 tx=0x7f40f802b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ac53baa8a8fa44 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.667+0000 7f410cb1b640 1 -- 172.21.15.132:0/1730232714 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8031890 con 0x7f41080b3bc0 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.667+0000 7f410cb1b640 1 -- 172.21.15.132:0/1730232714 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f80319f0 con 0x7f41080b3bc0 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.667+0000 7f410cb1b640 1 -- 172.21.15.132:0/1730232714 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8031d80 con 0x7f41080b3bc0 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.668+0000 7f410fd81640 1 -- 172.21.15.132:0/1730232714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41080b3bc0 msgr2=0x7f410806f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.668+0000 7f410fd81640 1 --2- 172.21.15.132:0/1730232714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41080b3bc0 0x7f410806f200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4108072b10 tx=0x7f40f802b930 comp rx=0 tx=0).stop 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.668+0000 7f410fd81640 1 -- 172.21.15.132:0/1730232714 shutdown_connections 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.668+0000 7f410fd81640 1 --2- 172.21.15.132:0/1730232714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f410806f740 0x7f41080b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.668+0000 7f410fd81640 1 --2- 172.21.15.132:0/1730232714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41080b3bc0 0x7f410806f200 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.668+0000 7f410fd81640 1 --2- 172.21.15.132:0/1730232714 >> v2:172.21.15.194:3300/0 conn(0x7f41081444e0 0x7f410815e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.668+0000 7f410fd81640 1 -- 172.21.15.132:0/1730232714 >> 172.21.15.132:0/1730232714 conn(0x7f410806bff0 msgr2=0x7f410806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.668+0000 7f410fd81640 1 -- 172.21.15.132:0/1730232714 shutdown_connections 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.668+0000 7f410fd81640 1 -- 172.21.15.132:0/1730232714 wait complete. 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.669+0000 7f410fd81640 1 Processor -- start 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.669+0000 7f410fd81640 1 -- start start 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410fd81640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f410806f740 0x7f410815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410fd81640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41080b3bc0 0x7f41081f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410fd81640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41081444e0 0x7f41080b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410fd81640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410815b450 con 0x7f41081444e0 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410fd81640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080b15e0 con 0x7f410806f740 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410fd81640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41081f4400 con 0x7f41080b3bc0 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410e31e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41081444e0 0x7f41080b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410e31e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41081444e0 0x7f41080b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41314/0 (socket says 172.21.15.132:41314) 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410e31e640 1 -- 172.21.15.132:0/1146560591 learned_addr learned my addr 172.21.15.132:0/1146560591 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410d31c640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41080b3bc0 0x7f41081f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410db1d640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f410806f740 0x7f410815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410e31e640 1 -- 172.21.15.132:0/1146560591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41080b3bc0 msgr2=0x7f41081f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410e31e640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41080b3bc0 0x7f41081f3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410e31e640 1 -- 172.21.15.132:0/1146560591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f410806f740 msgr2=0x7f410815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410e31e640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f410806f740 0x7f410815d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410e31e640 1 -- 172.21.15.132:0/1146560591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f80094d0 con 0x7f41081444e0 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.670+0000 7f410e31e640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41081444e0 0x7f41080b10a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f410000ba10 tx=0x7f410000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.671+0000 7f40fe7fc640 1 -- 172.21.15.132:0/1146560591 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410000cb20 con 0x7f41081444e0 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.671+0000 7f40fe7fc640 1 -- 172.21.15.132:0/1146560591 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410000cca0 con 0x7f41081444e0 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.671+0000 7f410fd81640 1 -- 172.21.15.132:0/1146560591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41081f46e0 con 0x7f41081444e0 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.671+0000 7f40fe7fc640 1 -- 172.21.15.132:0/1146560591 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100014680 con 0x7f41081444e0 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.671+0000 7f410fd81640 1 -- 172.21.15.132:0/1146560591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41081f4ca0 con 0x7f41081444e0 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.672+0000 7f410fd81640 1 -- 172.21.15.132:0/1146560591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410815b590 con 0x7f41081444e0 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.672+0000 7f40fe7fc640 1 -- 172.21.15.132:0/1146560591 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f410001d3b0 con 0x7f41081444e0 2024-03-16T17:48:20.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.672+0000 7f40fe7fc640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f40ec06b3b0 0x7f40ec06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:20.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.673+0000 7f40fe7fc640 1 -- 172.21.15.132:0/1146560591 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4100089a60 con 0x7f41081444e0 2024-03-16T17:48:20.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.673+0000 7f410db1d640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f40ec06b3b0 0x7f40ec06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:20.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.673+0000 7f410db1d640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f40ec06b3b0 0x7f40ec06d870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f410400a770 tx=0x7f4104008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:20.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.677+0000 7f40fe7fc640 1 -- 172.21.15.132:0/1146560591 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4100054750 con 0x7f41081444e0 2024-03-16T17:48:20.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.870+0000 7f410fd81640 1 -- 172.21.15.132:0/1146560591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41080735b0 con 0x7f41081444e0 2024-03-16T17:48:20.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.870+0000 7f40fe7fc640 1 -- 172.21.15.132:0/1146560591 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4100019020 con 0x7f41081444e0 2024-03-16T17:48:20.874 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-03-16T17:48:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.872+0000 7f410fd81640 1 -- 172.21.15.132:0/1146560591 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f40ec06b3b0 msgr2=0x7f40ec06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.872+0000 7f410fd81640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f40ec06b3b0 0x7f40ec06d870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f410400a770 tx=0x7f4104008040 comp rx=0 tx=0).stop 2024-03-16T17:48:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.872+0000 7f410fd81640 1 -- 172.21.15.132:0/1146560591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41081444e0 msgr2=0x7f41080b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.872+0000 7f410fd81640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41081444e0 0x7f41080b10a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f410000ba10 tx=0x7f410000bed0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.872+0000 7f410fd81640 1 -- 172.21.15.132:0/1146560591 shutdown_connections 2024-03-16T17:48:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.872+0000 7f410fd81640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f40ec06b3b0 0x7f40ec06d870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.872+0000 7f410fd81640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41081444e0 0x7f41080b10a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.872+0000 7f410fd81640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41080b3bc0 0x7f41081f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.873+0000 7f410fd81640 1 --2- 172.21.15.132:0/1146560591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f410806f740 0x7f410815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:20.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.873+0000 7f410fd81640 1 -- 172.21.15.132:0/1146560591 >> 172.21.15.132:0/1146560591 conn(0x7f410806bff0 msgr2=0x7f41080b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:20.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.873+0000 7f410fd81640 1 -- 172.21.15.132:0/1146560591 shutdown_connections 2024-03-16T17:48:20.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:20.873+0000 7f410fd81640 1 -- 172.21.15.132:0/1146560591 wait complete. 2024-03-16T17:48:20.888 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-16T17:48:20.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:20.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-16T17:48:20.917 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2024-03-16T17:48:20.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:20.918 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-16T17:48:20.980 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:48:20.980 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:20.999 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:48:20.999 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:21.057 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:48:21.057 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:21.115 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.216+0000 7ff3c83b6640 1 Processor -- start 2024-03-16T17:48:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.216+0000 7ff3c83b6640 1 -- start start 2024-03-16T17:48:21.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.217+0000 7ff3c83b6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff3c0143a80 0x7ff3c006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.217+0000 7ff3c83b6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 0x7ff3c006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.217+0000 7ff3c83b6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff3c006e6e0 0x7ff3c015e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.217+0000 7ff3c83b6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c00b42b0 con 0x7ff3c006e6e0 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.217+0000 7ff3c83b6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c006f650 con 0x7ff3c0143a80 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.217+0000 7ff3c83b6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c006f8d0 con 0x7ff3c0144170 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.217+0000 7ff3c6953640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff3c006e6e0 0x7ff3c015e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.217+0000 7ff3c6953640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff3c006e6e0 0x7ff3c015e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41318/0 (socket says 172.21.15.132:41318) 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.217+0000 7ff3c6953640 1 -- 172.21.15.132:0/3260618463 learned_addr learned my addr 172.21.15.132:0/3260618463 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c6152640 1 --2- 172.21.15.132:0/3260618463 >> v2:172.21.15.194:3300/0 conn(0x7ff3c0143a80 0x7ff3c006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c5951640 1 --2- 172.21.15.132:0/3260618463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 0x7ff3c006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c6953640 1 -- 172.21.15.132:0/3260618463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 msgr2=0x7ff3c006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c6953640 1 --2- 172.21.15.132:0/3260618463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 0x7ff3c006e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c6953640 1 -- 172.21.15.132:0/3260618463 >> v2:172.21.15.194:3300/0 conn(0x7ff3c0143a80 msgr2=0x7ff3c006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c6953640 1 --2- 172.21.15.132:0/3260618463 >> v2:172.21.15.194:3300/0 conn(0x7ff3c0143a80 0x7ff3c006dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c6953640 1 -- 172.21.15.132:0/3260618463 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c006fbb0 con 0x7ff3c006e6e0 2024-03-16T17:48:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c6152640 1 --2- 172.21.15.132:0/3260618463 >> v2:172.21.15.194:3300/0 conn(0x7ff3c0143a80 0x7ff3c006dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:21.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c5951640 1 --2- 172.21.15.132:0/3260618463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 0x7ff3c006e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c6953640 1 --2- 172.21.15.132:0/3260618463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 0x7ff3c015e8c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00b37c0 tx=0x7ff3b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce2fdbec178e527 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.218+0000 7ff3c5150640 1 -- 172.21.15.132:0/3260618463 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b802ca70 con 0x7ff3c006e6e0 2024-03-16T17:48:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c5150640 1 -- 172.21.15.132:0/3260618463 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b802cbd0 con 0x7ff3c006e6e0 2024-03-16T17:48:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c5150640 1 -- 172.21.15.132:0/3260618463 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80343f0 con 0x7ff3c006e6e0 2024-03-16T17:48:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c83b6640 1 -- 172.21.15.132:0/3260618463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 msgr2=0x7ff3c015e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c83b6640 1 --2- 172.21.15.132:0/3260618463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 0x7ff3c015e8c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00b37c0 tx=0x7ff3b802bed0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c83b6640 1 -- 172.21.15.132:0/3260618463 shutdown_connections 2024-03-16T17:48:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c83b6640 1 --2- 172.21.15.132:0/3260618463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 0x7ff3c015e8c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c83b6640 1 --2- 172.21.15.132:0/3260618463 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 0x7ff3c006e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c83b6640 1 --2- 172.21.15.132:0/3260618463 >> v2:172.21.15.194:3300/0 conn(0x7ff3c0143a80 0x7ff3c006dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c83b6640 1 -- 172.21.15.132:0/3260618463 >> 172.21.15.132:0/3260618463 conn(0x7ff3c00d0ae0 msgr2=0x7ff3c00d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:21.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c83b6640 1 -- 172.21.15.132:0/3260618463 shutdown_connections 2024-03-16T17:48:21.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.219+0000 7ff3c83b6640 1 -- 172.21.15.132:0/3260618463 wait complete. 2024-03-16T17:48:21.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.221+0000 7ff3c83b6640 1 Processor -- start 2024-03-16T17:48:21.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.221+0000 7ff3c83b6640 1 -- start start 2024-03-16T17:48:21.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.222+0000 7ff3c83b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 0x7ff3c013a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.222+0000 7ff3c83b6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c0143a80 0x7ff3c015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.222+0000 7ff3c83b6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 0x7ff3c00cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.222+0000 7ff3c83b6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c015d150 con 0x7ff3c006e6e0 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.222+0000 7ff3c83b6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c015b300 con 0x7ff3c0143a80 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.222+0000 7ff3c83b6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c015b5e0 con 0x7ff3c0144170 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c6152640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 0x7ff3c013a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c6152640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 0x7ff3c013a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41320/0 (socket says 172.21.15.132:41320) 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c6152640 1 -- 172.21.15.132:0/2043925 learned_addr learned my addr 172.21.15.132:0/2043925 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c5951640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c0143a80 0x7ff3c015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c6953640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 0x7ff3c00cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c6152640 1 -- 172.21.15.132:0/2043925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 msgr2=0x7ff3c00cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c6152640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 0x7ff3c00cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c6152640 1 -- 172.21.15.132:0/2043925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c0143a80 msgr2=0x7ff3c015c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c6152640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c0143a80 0x7ff3c015c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c6152640 1 -- 172.21.15.132:0/2043925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8009b30 con 0x7ff3c006e6e0 2024-03-16T17:48:21.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c5951640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c0143a80 0x7ff3c015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:21.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c6152640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 0x7ff3c013a8c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00c7c0 tx=0x7ff3bc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:21.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3b6ffd640 1 -- 172.21.15.132:0/2043925 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc007a30 con 0x7ff3c006e6e0 2024-03-16T17:48:21.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3b6ffd640 1 -- 172.21.15.132:0/2043925 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc007b90 con 0x7ff3c006e6e0 2024-03-16T17:48:21.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c83b6640 1 -- 172.21.15.132:0/2043925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c015b8c0 con 0x7ff3c006e6e0 2024-03-16T17:48:21.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3b6ffd640 1 -- 172.21.15.132:0/2043925 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00ce70 con 0x7ff3c006e6e0 2024-03-16T17:48:21.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.223+0000 7ff3c83b6640 1 -- 172.21.15.132:0/2043925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c013ae00 con 0x7ff3c006e6e0 2024-03-16T17:48:21.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.225+0000 7ff3b6ffd640 1 -- 172.21.15.132:0/2043925 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7ff3bc0113f0 con 0x7ff3c006e6e0 2024-03-16T17:48:21.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.225+0000 7ff3c83b6640 1 -- 172.21.15.132:0/2043925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c015bde0 con 0x7ff3c006e6e0 2024-03-16T17:48:21.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.225+0000 7ff3b6ffd640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff3a406b3b0 0x7ff3a406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.225+0000 7ff3b6ffd640 1 -- 172.21.15.132:0/2043925 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3bc089d20 con 0x7ff3c006e6e0 2024-03-16T17:48:21.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.225+0000 7ff3c5951640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff3a406b3b0 0x7ff3a406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.226+0000 7ff3c5951640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff3a406b3b0 0x7ff3a406d870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0137e40 tx=0x7ff3b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:21.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.229+0000 7ff3b6ffd640 1 -- 172.21.15.132:0/2043925 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff3bc054980 con 0x7ff3c006e6e0 2024-03-16T17:48:21.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.408+0000 7ff3c83b6640 1 -- 172.21.15.132:0/2043925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3c004f2c0 con 0x7ff3c006e6e0 2024-03-16T17:48:21.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.409+0000 7ff3b6ffd640 1 -- 172.21.15.132:0/2043925 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7ff3bc01f090 con 0x7ff3c006e6e0 2024-03-16T17:48:21.413 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:21.414 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 -- 172.21.15.132:0/2043925 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff3a406b3b0 msgr2=0x7ff3a406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff3a406b3b0 0x7ff3a406d870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0137e40 tx=0x7ff3b0008040 comp rx=0 tx=0).stop 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 -- 172.21.15.132:0/2043925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 msgr2=0x7ff3c013a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 0x7ff3c013a8c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00c7c0 tx=0x7ff3bc00cc80 comp rx=0 tx=0).stop 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 -- 172.21.15.132:0/2043925 shutdown_connections 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff3a406b3b0 0x7ff3a406d870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3c0144170 0x7ff3c00cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3c0143a80 0x7ff3c015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 --2- 172.21.15.132:0/2043925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3c006e6e0 0x7ff3c013a8c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 -- 172.21.15.132:0/2043925 >> 172.21.15.132:0/2043925 conn(0x7ff3c00d0ae0 msgr2=0x7ff3c00b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:21.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 -- 172.21.15.132:0/2043925 shutdown_connections 2024-03-16T17:48:21.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.412+0000 7ff3c83b6640 1 -- 172.21.15.132:0/2043925 wait complete. 2024-03-16T17:48:21.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:21.427 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:21.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.535+0000 7f8c6925c640 1 Processor -- start 2024-03-16T17:48:21.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.535+0000 7f8c6925c640 1 -- start start 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.536+0000 7f8c6925c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c64161760 0x7f8c640b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.536+0000 7f8c6925c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8c64161b40 0x7f8c640d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.536+0000 7f8c6925c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c640d49f0 0x7f8c640d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.536+0000 7f8c6925c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c640cff20 con 0x7f8c640d49f0 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.536+0000 7f8c6925c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c640b5500 con 0x7f8c64161b40 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.536+0000 7f8c6925c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640cf5f0 con 0x7f8c64161760 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.537+0000 7f8c6359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c640d49f0 0x7f8c640d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.537+0000 7f8c6359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c640d49f0 0x7f8c640d0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41336/0 (socket says 172.21.15.132:41336) 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.537+0000 7f8c6359e640 1 -- 172.21.15.132:0/205600313 learned_addr learned my addr 172.21.15.132:0/205600313 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.537+0000 7f8c5bfff640 1 --2- 172.21.15.132:0/205600313 >> v2:172.21.15.194:3300/0 conn(0x7f8c64161b40 0x7f8c640d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.537+0000 7f8c62d9d640 1 --2- 172.21.15.132:0/205600313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c64161760 0x7f8c640b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.537+0000 7f8c6359e640 1 -- 172.21.15.132:0/205600313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c64161760 msgr2=0x7f8c640b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:21.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.537+0000 7f8c6359e640 1 --2- 172.21.15.132:0/205600313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c64161760 0x7f8c640b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.537+0000 7f8c6359e640 1 -- 172.21.15.132:0/205600313 >> v2:172.21.15.194:3300/0 conn(0x7f8c64161b40 msgr2=0x7f8c640d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:21.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.537+0000 7f8c6359e640 1 --2- 172.21.15.132:0/205600313 >> v2:172.21.15.194:3300/0 conn(0x7f8c64161b40 0x7f8c640d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.537+0000 7f8c6359e640 1 -- 172.21.15.132:0/205600313 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c640cf8d0 con 0x7f8c640d49f0 2024-03-16T17:48:21.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.538+0000 7f8c6359e640 1 --2- 172.21.15.132:0/205600313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 0x7f8c640d0b40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8c6408c570 tx=0x7f8c5c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4420ef100bdb971b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:21.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.538+0000 7f8c6259c640 1 -- 172.21.15.132:0/205600313 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c02ca70 con 0x7f8c640d49f0 2024-03-16T17:48:21.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.538+0000 7f8c6259c640 1 -- 172.21.15.132:0/205600313 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c02cbd0 con 0x7f8c640d49f0 2024-03-16T17:48:21.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.538+0000 7f8c6259c640 1 -- 172.21.15.132:0/205600313 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0343f0 con 0x7f8c640d49f0 2024-03-16T17:48:21.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.538+0000 7f8c6925c640 1 -- 172.21.15.132:0/205600313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 msgr2=0x7f8c640d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.539+0000 7f8c6925c640 1 --2- 172.21.15.132:0/205600313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 0x7f8c640d0b40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8c6408c570 tx=0x7f8c5c02bed0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.539+0000 7f8c6925c640 1 -- 172.21.15.132:0/205600313 shutdown_connections 2024-03-16T17:48:21.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.539+0000 7f8c6925c640 1 --2- 172.21.15.132:0/205600313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 0x7f8c640d0b40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.539+0000 7f8c6925c640 1 --2- 172.21.15.132:0/205600313 >> v2:172.21.15.194:3300/0 conn(0x7f8c64161b40 0x7f8c640d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.539+0000 7f8c6925c640 1 --2- 172.21.15.132:0/205600313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c64161760 0x7f8c640b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.539+0000 7f8c6925c640 1 -- 172.21.15.132:0/205600313 >> 172.21.15.132:0/205600313 conn(0x7f8c640d3ed0 msgr2=0x7f8c640d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:21.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.539+0000 7f8c6925c640 1 -- 172.21.15.132:0/205600313 shutdown_connections 2024-03-16T17:48:21.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.539+0000 7f8c6925c640 1 -- 172.21.15.132:0/205600313 wait complete. 2024-03-16T17:48:21.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.540+0000 7f8c6925c640 1 Processor -- start 2024-03-16T17:48:21.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.540+0000 7f8c6925c640 1 -- start start 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c6925c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 0x7f8c640cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c6925c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c64161760 0x7f8c641f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c6925c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c64161b40 0x7f8c641f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c6925c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c641f40b0 con 0x7f8c640d49f0 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c6925c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640ccfc0 con 0x7f8c64161b40 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c6925c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640b85a0 con 0x7f8c64161760 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c62d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 0x7f8c640cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c62d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 0x7f8c640cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41350/0 (socket says 172.21.15.132:41350) 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c62d9d640 1 -- 172.21.15.132:0/507995934 learned_addr learned my addr 172.21.15.132:0/507995934 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c5bfff640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c64161760 0x7f8c641f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c6359e640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c64161b40 0x7f8c641f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c62d9d640 1 -- 172.21.15.132:0/507995934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c64161760 msgr2=0x7f8c641f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c62d9d640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c64161760 0x7f8c641f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c62d9d640 1 -- 172.21.15.132:0/507995934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c64161b40 msgr2=0x7f8c641f68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c62d9d640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c64161b40 0x7f8c641f68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c62d9d640 1 -- 172.21.15.132:0/507995934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009b30 con 0x7f8c640d49f0 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.541+0000 7f8c62d9d640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 0x7f8c640cafa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400d830 tx=0x7f8c5400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.542+0000 7f8c5b7fe640 1 -- 172.21.15.132:0/507995934 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c540096a0 con 0x7f8c640d49f0 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.542+0000 7f8c5b7fe640 1 -- 172.21.15.132:0/507995934 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c54009800 con 0x7f8c640d49f0 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.542+0000 7f8c6925c640 1 -- 172.21.15.132:0/507995934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c640cb6b0 con 0x7f8c640d49f0 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.542+0000 7f8c5b7fe640 1 -- 172.21.15.132:0/507995934 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54009b90 con 0x7f8c640d49f0 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.542+0000 7f8c6925c640 1 -- 172.21.15.132:0/507995934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c640cbc70 con 0x7f8c640d49f0 2024-03-16T17:48:21.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.543+0000 7f8c6925c640 1 -- 172.21.15.132:0/507995934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c64068450 con 0x7f8c640d49f0 2024-03-16T17:48:21.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.544+0000 7f8c5b7fe640 1 -- 172.21.15.132:0/507995934 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f8c54014410 con 0x7f8c640d49f0 2024-03-16T17:48:21.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.544+0000 7f8c5b7fe640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8c4406b3b0 0x7f8c4406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.544+0000 7f8c5b7fe640 1 -- 172.21.15.132:0/507995934 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c5408a410 con 0x7f8c640d49f0 2024-03-16T17:48:21.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.544+0000 7f8c5bfff640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8c4406b3b0 0x7f8c4406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.545+0000 7f8c5bfff640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8c4406b3b0 0x7f8c4406d870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8c640cc820 tx=0x7f8c4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:21.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.553+0000 7f8c5b7fe640 1 -- 172.21.15.132:0/507995934 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8c54055120 con 0x7f8c640d49f0 2024-03-16T17:48:21.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.730+0000 7f8c6925c640 1 -- 172.21.15.132:0/507995934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8c640a1d50 con 0x7f8c640d49f0 2024-03-16T17:48:21.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.730+0000 7f8c5b7fe640 1 -- 172.21.15.132:0/507995934 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8c5400b440 con 0x7f8c640d49f0 2024-03-16T17:48:21.734 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:21.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.732+0000 7f8c6925c640 1 -- 172.21.15.132:0/507995934 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8c4406b3b0 msgr2=0x7f8c4406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.732+0000 7f8c6925c640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8c4406b3b0 0x7f8c4406d870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8c640cc820 tx=0x7f8c4c008040 comp rx=0 tx=0).stop 2024-03-16T17:48:21.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.732+0000 7f8c6925c640 1 -- 172.21.15.132:0/507995934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 msgr2=0x7f8c640cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.732+0000 7f8c6925c640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 0x7f8c640cafa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400d830 tx=0x7f8c5400dcf0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.732+0000 7f8c6925c640 1 -- 172.21.15.132:0/507995934 shutdown_connections 2024-03-16T17:48:21.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.732+0000 7f8c6925c640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f8c4406b3b0 0x7f8c4406d870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.732+0000 7f8c6925c640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c64161b40 0x7f8c641f68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.732+0000 7f8c6925c640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c64161760 0x7f8c641f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.732+0000 7f8c6925c640 1 --2- 172.21.15.132:0/507995934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c640d49f0 0x7f8c640cafa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.732+0000 7f8c6925c640 1 -- 172.21.15.132:0/507995934 >> 172.21.15.132:0/507995934 conn(0x7f8c640d3ed0 msgr2=0x7f8c6415d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:21.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.733+0000 7f8c6925c640 1 -- 172.21.15.132:0/507995934 shutdown_connections 2024-03-16T17:48:21.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.733+0000 7f8c6925c640 1 -- 172.21.15.132:0/507995934 wait complete. 2024-03-16T17:48:21.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:21.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.848+0000 7f00abb6c640 1 Processor -- start 2024-03-16T17:48:21.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.848+0000 7f00abb6c640 1 -- start start 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.848+0000 7f00abb6c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00a40b1040 0x7f00a40cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00abb6c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00a415f100 0x7f00a40d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00abb6c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a40d1980 con 0x7f00a40d2350 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00abb6c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a40d00b0 con 0x7f00a415f100 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00abb6c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a40b2f90 con 0x7f00a40b1040 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00a9107640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00a415f100 0x7f00a40d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00a9107640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00a415f100 0x7f00a40d1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41366/0 (socket says 172.21.15.132:41366) 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00a9107640 1 -- 172.21.15.132:0/2481363368 learned_addr learned my addr 172.21.15.132:0/2481363368 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00a9107640 1 -- 172.21.15.132:0/2481363368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00a40b1040 msgr2=0x7f00a40cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00a9107640 1 --2- 172.21.15.132:0/2481363368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00a40b1040 0x7f00a40cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00a9107640 1 -- 172.21.15.132:0/2481363368 >> v1:172.21.15.132:6789/0 conn(0x7f00a40d2350 legacy=0x7f00a406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.849+0000 7f00a9107640 1 -- 172.21.15.132:0/2481363368 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a40b3270 con 0x7f00a415f100 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.850+0000 7f00a9107640 1 --2- 172.21.15.132:0/2481363368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 0x7f00a40d1e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0094009870 tx=0x7f009402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8edc58ed0d355997 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.850+0000 7f00a8906640 1 -- 172.21.15.132:0/2481363368 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094030840 con 0x7f00a415f100 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.850+0000 7f00a8906640 1 -- 172.21.15.132:0/2481363368 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00940309a0 con 0x7f00a415f100 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.850+0000 7f00a8906640 1 -- 172.21.15.132:0/2481363368 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094030d30 con 0x7f00a415f100 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.850+0000 7f00abb6c640 1 -- 172.21.15.132:0/2481363368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 msgr2=0x7f00a40d1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.850+0000 7f00abb6c640 1 --2- 172.21.15.132:0/2481363368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 0x7f00a40d1e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0094009870 tx=0x7f009402b980 comp rx=0 tx=0).stop 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.851+0000 7f00abb6c640 1 -- 172.21.15.132:0/2481363368 shutdown_connections 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.851+0000 7f00abb6c640 1 --2- 172.21.15.132:0/2481363368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 0x7f00a40d1e10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.851+0000 7f00abb6c640 1 --2- 172.21.15.132:0/2481363368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00a40b1040 0x7f00a40cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.851+0000 7f00abb6c640 1 -- 172.21.15.132:0/2481363368 >> 172.21.15.132:0/2481363368 conn(0x7f00a4073220 msgr2=0x7f00a409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.851+0000 7f00abb6c640 1 -- 172.21.15.132:0/2481363368 shutdown_connections 2024-03-16T17:48:21.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.851+0000 7f00abb6c640 1 -- 172.21.15.132:0/2481363368 wait complete. 2024-03-16T17:48:21.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.852+0000 7f00abb6c640 1 Processor -- start 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.852+0000 7f00abb6c640 1 -- start start 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.852+0000 7f00abb6c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a40b1040 0x7f00a415d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.852+0000 7f00abb6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 0x7f00a40b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.852+0000 7f00abb6c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00a40b56a0 0x7f00a4147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.852+0000 7f00abb6c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a41f5de0 con 0x7f00a415f100 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.852+0000 7f00abb6c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a41555d0 con 0x7f00a40b1040 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.852+0000 7f00abb6c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a41f51a0 con 0x7f00a40b56a0 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 0x7f00a40b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9107640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 0x7f00a40b5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41372/0 (socket says 172.21.15.132:41372) 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9107640 1 -- 172.21.15.132:0/1919371143 learned_addr learned my addr 172.21.15.132:0/1919371143 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00aa109640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00a40b56a0 0x7f00a4147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9908640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a40b1040 0x7f00a415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9107640 1 -- 172.21.15.132:0/1919371143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00a40b56a0 msgr2=0x7f00a4147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9107640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00a40b56a0 0x7f00a4147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9107640 1 -- 172.21.15.132:0/1919371143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a40b1040 msgr2=0x7f00a415d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9107640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a40b1040 0x7f00a415d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9107640 1 -- 172.21.15.132:0/1919371143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940094d0 con 0x7f00a415f100 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9908640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a40b1040 0x7f00a415d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00a9107640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 0x7f00a40b5160 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0094009870 tx=0x7f0094004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f009a7fc640 1 -- 172.21.15.132:0/1919371143 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00940307f0 con 0x7f00a415f100 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f009a7fc640 1 -- 172.21.15.132:0/1919371143 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0094039d90 con 0x7f00a415f100 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00abb6c640 1 -- 172.21.15.132:0/1919371143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a41f5440 con 0x7f00a415f100 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f009a7fc640 1 -- 172.21.15.132:0/1919371143 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094043630 con 0x7f00a415f100 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.853+0000 7f00abb6c640 1 -- 172.21.15.132:0/1919371143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a41f5a00 con 0x7f00a415f100 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.854+0000 7f00abb6c640 1 -- 172.21.15.132:0/1919371143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a41f5f20 con 0x7f00a415f100 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.855+0000 7f009a7fc640 1 -- 172.21.15.132:0/1919371143 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f009404c3b0 con 0x7f00a415f100 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.855+0000 7f009a7fc640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f008806b3b0 0x7f008806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.855+0000 7f009a7fc640 1 -- 172.21.15.132:0/1919371143 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00940ac230 con 0x7f00a415f100 2024-03-16T17:48:21.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.855+0000 7f00a9908640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f008806b3b0 0x7f008806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:21.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.856+0000 7f00a9908640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f008806b3b0 0x7f008806d870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f009c007eb0 tx=0x7f009c0073c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:21.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:21.859+0000 7f009a7fc640 1 -- 172.21.15.132:0/1919371143 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f00a41f5f20 con 0x7f00a415f100 2024-03-16T17:48:22.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.035+0000 7f00abb6c640 1 -- 172.21.15.132:0/1919371143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00a41f5f20 con 0x7f00a415f100 2024-03-16T17:48:22.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.035+0000 7f009a7fc640 1 -- 172.21.15.132:0/1919371143 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00a41f5f20 con 0x7f00a415f100 2024-03-16T17:48:22.039 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 -- 172.21.15.132:0/1919371143 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f008806b3b0 msgr2=0x7f008806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f008806b3b0 0x7f008806d870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f009c007eb0 tx=0x7f009c0073c0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 -- 172.21.15.132:0/1919371143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 msgr2=0x7f00a40b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 0x7f00a40b5160 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0094009870 tx=0x7f0094004730 comp rx=0 tx=0).stop 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 -- 172.21.15.132:0/1919371143 shutdown_connections 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f008806b3b0 0x7f008806d870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00a40b56a0 0x7f00a4147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00a415f100 0x7f00a40b5160 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 --2- 172.21.15.132:0/1919371143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00a40b1040 0x7f00a415d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 -- 172.21.15.132:0/1919371143 >> 172.21.15.132:0/1919371143 conn(0x7f00a4073220 msgr2=0x7f00a406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:22.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 -- 172.21.15.132:0/1919371143 shutdown_connections 2024-03-16T17:48:22.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.037+0000 7f00abb6c640 1 -- 172.21.15.132:0/1919371143 wait complete. 2024-03-16T17:48:22.051 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:22.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.152+0000 7f121f635640 1 Processor -- start 2024-03-16T17:48:22.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.152+0000 7f121f635640 1 -- start start 2024-03-16T17:48:22.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.153+0000 7f121f635640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12180d2af0 0x7f12180b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.153+0000 7f121f635640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12180d0eb0 0x7f12180b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.154+0000 7f121f635640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1218161d30 con 0x7f1218161950 2024-03-16T17:48:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.154+0000 7f121f635640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12180d1f50 con 0x7f12180d2af0 2024-03-16T17:48:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.154+0000 7f121f635640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12180d49c0 con 0x7f12180d0eb0 2024-03-16T17:48:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.154+0000 7f121d3d1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1218161950 0x7f12180d23e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32946/0 (socket says 172.21.15.132:32946) 2024-03-16T17:48:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.154+0000 7f121d3d1640 1 -- 172.21.15.132:0/1658128008 learned_addr learned my addr 172.21.15.132:0/1658128008 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.154+0000 7f121cbd0640 1 --2- 172.21.15.132:0/1658128008 >> v2:172.21.15.132:3300/0 conn(0x7f12180d2af0 0x7f12180b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.154+0000 7f121cbd0640 1 -- 172.21.15.132:0/1658128008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12180d0eb0 msgr2=0x7f12180b7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.154+0000 7f121cbd0640 1 --2- 172.21.15.132:0/1658128008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12180d0eb0 0x7f12180b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.154+0000 7f121cbd0640 1 -- 172.21.15.132:0/1658128008 >> v1:172.21.15.132:6789/0 conn(0x7f1218161950 legacy=0x7f12180d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.154+0000 7f121cbd0640 1 -- 172.21.15.132:0/1658128008 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12180b6cf0 con 0x7f12180d2af0 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.155+0000 7f121cbd0640 1 --2- 172.21.15.132:0/1658128008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 0x7f12180b74f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f12140097a0 tx=0x7f121402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ed4e96b9d211f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.155+0000 7f120bfff640 1 -- 172.21.15.132:0/1658128008 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214031830 con 0x7f12180d2af0 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.155+0000 7f120bfff640 1 -- 172.21.15.132:0/1658128008 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1214031990 con 0x7f12180d2af0 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.155+0000 7f120bfff640 1 -- 172.21.15.132:0/1658128008 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214031d20 con 0x7f12180d2af0 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.155+0000 7f121f635640 1 -- 172.21.15.132:0/1658128008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 msgr2=0x7f12180b74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.155+0000 7f121f635640 1 --2- 172.21.15.132:0/1658128008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 0x7f12180b74f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f12140097a0 tx=0x7f121402b8d0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.155+0000 7f121f635640 1 -- 172.21.15.132:0/1658128008 shutdown_connections 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.155+0000 7f121f635640 1 --2- 172.21.15.132:0/1658128008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12180d0eb0 0x7f12180b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.156+0000 7f121f635640 1 --2- 172.21.15.132:0/1658128008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 0x7f12180b74f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.156+0000 7f121f635640 1 -- 172.21.15.132:0/1658128008 >> 172.21.15.132:0/1658128008 conn(0x7f12180d3e00 msgr2=0x7f12180d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:22.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.156+0000 7f121f635640 1 -- 172.21.15.132:0/1658128008 shutdown_connections 2024-03-16T17:48:22.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.156+0000 7f121f635640 1 -- 172.21.15.132:0/1658128008 wait complete. 2024-03-16T17:48:22.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.157+0000 7f121f635640 1 Processor -- start 2024-03-16T17:48:22.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.157+0000 7f121f635640 1 -- start start 2024-03-16T17:48:22.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.158+0000 7f121f635640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12180d0eb0 0x7f12180c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.158+0000 7f121f635640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 0x7f1218152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.158+0000 7f121f635640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1218161950 0x7f121806cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.158+0000 7f121f635640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12180c9a30 con 0x7f12180d2af0 2024-03-16T17:48:22.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.158+0000 7f121f635640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12180c8450 con 0x7f1218161950 2024-03-16T17:48:22.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.158+0000 7f121f635640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12180c8730 con 0x7f12180d0eb0 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.158+0000 7f121cbd0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 0x7f1218152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.158+0000 7f121cbd0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 0x7f1218152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41392/0 (socket says 172.21.15.132:41392) 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.158+0000 7f121cbd0640 1 -- 172.21.15.132:0/4182056948 learned_addr learned my addr 172.21.15.132:0/4182056948 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121dbd2640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1218161950 0x7f121806cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121cbd0640 1 -- 172.21.15.132:0/4182056948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12180d0eb0 msgr2=0x7f12180c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121d3d1640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12180d0eb0 0x7f12180c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121cbd0640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12180d0eb0 0x7f12180c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121cbd0640 1 -- 172.21.15.132:0/4182056948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1218161950 msgr2=0x7f121806cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121cbd0640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1218161950 0x7f121806cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121cbd0640 1 -- 172.21.15.132:0/4182056948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1214009400 con 0x7f12180d2af0 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121dbd2640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1218161950 0x7f121806cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121d3d1640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12180d0eb0 0x7f12180c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121cbd0640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 0x7f1218152050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f12140098c0 tx=0x7f12140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:22.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f1209ffb640 1 -- 172.21.15.132:0/4182056948 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121403ba70 con 0x7f12180d2af0 2024-03-16T17:48:22.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f1209ffb640 1 -- 172.21.15.132:0/4182056948 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121403bbf0 con 0x7f12180d2af0 2024-03-16T17:48:22.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f1209ffb640 1 -- 172.21.15.132:0/4182056948 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12140453f0 con 0x7f12180d2af0 2024-03-16T17:48:22.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121f635640 1 -- 172.21.15.132:0/4182056948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12180c8a10 con 0x7f12180d2af0 2024-03-16T17:48:22.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.159+0000 7f121f635640 1 -- 172.21.15.132:0/4182056948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12180c8fd0 con 0x7f12180d2af0 2024-03-16T17:48:22.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.160+0000 7f121f635640 1 -- 172.21.15.132:0/4182056948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12180a1d70 con 0x7f12180d2af0 2024-03-16T17:48:22.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.161+0000 7f1209ffb640 1 -- 172.21.15.132:0/4182056948 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f121404e450 con 0x7f12180d2af0 2024-03-16T17:48:22.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.161+0000 7f1209ffb640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f11fc06b3b0 0x7f11fc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.161+0000 7f1209ffb640 1 -- 172.21.15.132:0/4182056948 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12140abea0 con 0x7f12180d2af0 2024-03-16T17:48:22.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.161+0000 7f121d3d1640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f11fc06b3b0 0x7f11fc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:22.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.162+0000 7f121d3d1640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f11fc06b3b0 0x7f11fc06d870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f120c000f60 tx=0x7f120c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:22.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.169+0000 7f1209ffb640 1 -- 172.21.15.132:0/4182056948 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1214076b00 con 0x7f12180d2af0 2024-03-16T17:48:22.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.348+0000 7f121f635640 1 -- 172.21.15.132:0/4182056948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12180683c0 con 0x7f12180d2af0 2024-03-16T17:48:22.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.349+0000 7f1209ffb640 1 -- 172.21.15.132:0/4182056948 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1214035020 con 0x7f12180d2af0 2024-03-16T17:48:22.353 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 -- 172.21.15.132:0/4182056948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f11fc06b3b0 msgr2=0x7f11fc06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f11fc06b3b0 0x7f11fc06d870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f120c000f60 tx=0x7f120c009040 comp rx=0 tx=0).stop 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 -- 172.21.15.132:0/4182056948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 msgr2=0x7f1218152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 0x7f1218152050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f12140098c0 tx=0x7f12140046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 -- 172.21.15.132:0/4182056948 shutdown_connections 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f11fc06b3b0 0x7f11fc06d870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1218161950 0x7f121806cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12180d2af0 0x7f1218152050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 --2- 172.21.15.132:0/4182056948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12180d0eb0 0x7f12180c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 -- 172.21.15.132:0/4182056948 >> 172.21.15.132:0/4182056948 conn(0x7f12180d3e00 msgr2=0x7f1218160c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 -- 172.21.15.132:0/4182056948 shutdown_connections 2024-03-16T17:48:22.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.351+0000 7f121f635640 1 -- 172.21.15.132:0/4182056948 wait complete. 2024-03-16T17:48:22.366 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T17:48:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.464+0000 7f9966883640 1 Processor -- start 2024-03-16T17:48:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.464+0000 7f9966883640 1 -- start start 2024-03-16T17:48:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.464+0000 7f9966883640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9960072760 0x7f996015e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.464+0000 7f9966883640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99600b5cb0 con 0x7f99600b3b50 2024-03-16T17:48:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.464+0000 7f9966883640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99600b53c0 con 0x7f996006aee0 2024-03-16T17:48:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.464+0000 7f9966883640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9960073020 con 0x7f9960072760 2024-03-16T17:48:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.465+0000 7f9964e20640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9960072760 0x7f996015e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.465+0000 7f9964e20640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9960072760 0x7f996015e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41404/0 (socket says 172.21.15.132:41404) 2024-03-16T17:48:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.465+0000 7f9964e20640 1 -- 172.21.15.132:0/1324335408 learned_addr learned my addr 172.21.15.132:0/1324335408 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.465+0000 7f9964e20640 1 -- 172.21.15.132:0/1324335408 >> v1:172.21.15.194:6789/0 conn(0x7f996006aee0 legacy=0x7f996006b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.465+0000 7f9964e20640 1 -- 172.21.15.132:0/1324335408 >> v1:172.21.15.132:6789/0 conn(0x7f99600b3b50 legacy=0x7f996015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.465+0000 7f9964e20640 1 -- 172.21.15.132:0/1324335408 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960072d40 con 0x7f9960072760 2024-03-16T17:48:22.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.466+0000 7f9964e20640 1 --2- 172.21.15.132:0/1324335408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9960072760 0x7f996015e990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9958009e50 tx=0x7f995802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb61d5f53ad0c3e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:22.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.466+0000 7f995effd640 1 -- 172.21.15.132:0/1324335408 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995802ca80 con 0x7f9960072760 2024-03-16T17:48:22.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.466+0000 7f995effd640 1 -- 172.21.15.132:0/1324335408 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995802cbe0 con 0x7f9960072760 2024-03-16T17:48:22.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.466+0000 7f995effd640 1 -- 172.21.15.132:0/1324335408 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99580343f0 con 0x7f9960072760 2024-03-16T17:48:22.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.466+0000 7f9966883640 1 -- 172.21.15.132:0/1324335408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9960072760 msgr2=0x7f996015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.466+0000 7f9966883640 1 --2- 172.21.15.132:0/1324335408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9960072760 0x7f996015e990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9958009e50 tx=0x7f995802bee0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.466+0000 7f9966883640 1 -- 172.21.15.132:0/1324335408 shutdown_connections 2024-03-16T17:48:22.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.466+0000 7f9966883640 1 --2- 172.21.15.132:0/1324335408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9960072760 0x7f996015e990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.466+0000 7f9966883640 1 -- 172.21.15.132:0/1324335408 >> 172.21.15.132:0/1324335408 conn(0x7f99600b2850 msgr2=0x7f99600b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:22.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.467+0000 7f9966883640 1 -- 172.21.15.132:0/1324335408 shutdown_connections 2024-03-16T17:48:22.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.467+0000 7f9966883640 1 -- 172.21.15.132:0/1324335408 wait complete. 2024-03-16T17:48:22.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.468+0000 7f9966883640 1 Processor -- start 2024-03-16T17:48:22.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.469+0000 7f9966883640 1 -- start start 2024-03-16T17:48:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f9966883640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f996006aee0 0x7f99601f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f9966883640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9960072760 0x7f9960145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f9966883640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99600b3b50 0x7f9960142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f9966883640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9960143440 con 0x7f996006aee0 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f9966883640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99601463d0 con 0x7f99600b3b50 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f9966883640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99601f4200 con 0x7f9960072760 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f996006aee0 0x7f99601f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f996006aee0 0x7f99601f3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41406/0 (socket says 172.21.15.132:41406) 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995ffff640 1 -- 172.21.15.132:0/214914940 learned_addr learned my addr 172.21.15.132:0/214914940 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f9964e20640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99600b3b50 0x7f9960142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995f7fe640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9960072760 0x7f9960145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995ffff640 1 -- 172.21.15.132:0/214914940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9960072760 msgr2=0x7f9960145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995ffff640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9960072760 0x7f9960145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995ffff640 1 -- 172.21.15.132:0/214914940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99600b3b50 msgr2=0x7f9960142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995ffff640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99600b3b50 0x7f9960142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995ffff640 1 -- 172.21.15.132:0/214914940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958009b30 con 0x7f996006aee0 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995ffff640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f996006aee0 0x7f99601f3bc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f995000b3f0 tx=0x7f995000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.470+0000 7f995cff9640 1 -- 172.21.15.132:0/214914940 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950011830 con 0x7f996006aee0 2024-03-16T17:48:22.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.471+0000 7f995cff9640 1 -- 172.21.15.132:0/214914940 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950011990 con 0x7f996006aee0 2024-03-16T17:48:22.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.471+0000 7f9966883640 1 -- 172.21.15.132:0/214914940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99601f44e0 con 0x7f996006aee0 2024-03-16T17:48:22.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.471+0000 7f995cff9640 1 -- 172.21.15.132:0/214914940 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950011d40 con 0x7f996006aee0 2024-03-16T17:48:22.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.471+0000 7f9966883640 1 -- 172.21.15.132:0/214914940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99601f4aa0 con 0x7f996006aee0 2024-03-16T17:48:22.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.472+0000 7f9966883640 1 -- 172.21.15.132:0/214914940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99600735f0 con 0x7f996006aee0 2024-03-16T17:48:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.472+0000 7f995cff9640 1 -- 172.21.15.132:0/214914940 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f995001a400 con 0x7f996006aee0 2024-03-16T17:48:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.473+0000 7f995cff9640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f994c06b3b0 0x7f994c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.473+0000 7f995cff9640 1 -- 172.21.15.132:0/214914940 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9950089bd0 con 0x7f996006aee0 2024-03-16T17:48:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.473+0000 7f995f7fe640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f994c06b3b0 0x7f994c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.473+0000 7f995f7fe640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f994c06b3b0 0x7f994c06d870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f996015add0 tx=0x7f9954009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:22.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.477+0000 7f995cff9640 1 -- 172.21.15.132:0/214914940 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9950054970 con 0x7f996006aee0 2024-03-16T17:48:22.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.685+0000 7f9966883640 1 -- 172.21.15.132:0/214914940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9960071f30 con 0x7f996006aee0 2024-03-16T17:48:22.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.685+0000 7f995cff9640 1 -- 172.21.15.132:0/214914940 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9950015080 con 0x7f996006aee0 2024-03-16T17:48:22.689 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-03-16T17:48:22.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 -- 172.21.15.132:0/214914940 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f994c06b3b0 msgr2=0x7f994c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f994c06b3b0 0x7f994c06d870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f996015add0 tx=0x7f9954009040 comp rx=0 tx=0).stop 2024-03-16T17:48:22.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 -- 172.21.15.132:0/214914940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f996006aee0 msgr2=0x7f99601f3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:22.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f996006aee0 0x7f99601f3bc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f995000b3f0 tx=0x7f995000b8b0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 -- 172.21.15.132:0/214914940 shutdown_connections 2024-03-16T17:48:22.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f994c06b3b0 0x7f994c06d870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99600b3b50 0x7f9960142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9960072760 0x7f9960145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 --2- 172.21.15.132:0/214914940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f996006aee0 0x7f99601f3bc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:22.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 -- 172.21.15.132:0/214914940 >> 172.21.15.132:0/214914940 conn(0x7f99600b2850 msgr2=0x7f99600cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:22.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 -- 172.21.15.132:0/214914940 shutdown_connections 2024-03-16T17:48:22.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:22.687+0000 7f9966883640 1 -- 172.21.15.132:0/214914940 wait complete. 2024-03-16T17:48:22.702 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-16T17:48:22.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:22.703 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-16T17:48:22.737 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-03-16T17:48:22.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:22.737 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-16T17:48:22.814 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:48:22.814 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:22.829 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:48:22.829 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:22.885 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:48:22.885 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:22.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:23.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.077+0000 7f83c608f640 1 Processor -- start 2024-03-16T17:48:23.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.077+0000 7f83c608f640 1 -- start start 2024-03-16T17:48:23.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83c608f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c0161540 0x7f83c00b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83c608f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f83c00cf080 0x7f83c00cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83c608f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83c00cfa40 0x7f83c0161d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83c608f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c00b4f30 con 0x7f83c00cfa40 2024-03-16T17:48:23.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83c608f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c00d0680 con 0x7f83c00cf080 2024-03-16T17:48:23.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83c608f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00d08d0 con 0x7f83c0161540 2024-03-16T17:48:23.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83bffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83c00cfa40 0x7f83c0161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83bffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f83c00cfa40 0x7f83c0161d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41408/0 (socket says 172.21.15.132:41408) 2024-03-16T17:48:23.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83bffff640 1 -- 172.21.15.132:0/3886986246 learned_addr learned my addr 172.21.15.132:0/3886986246 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:23.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83beffd640 1 --2- 172.21.15.132:0/3886986246 >> v2:172.21.15.194:3300/0 conn(0x7f83c00cf080 0x7f83c00cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83bf7fe640 1 --2- 172.21.15.132:0/3886986246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c0161540 0x7f83c00b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83bffff640 1 -- 172.21.15.132:0/3886986246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c0161540 msgr2=0x7f83c00b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:23.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83bffff640 1 --2- 172.21.15.132:0/3886986246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c0161540 0x7f83c00b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83bffff640 1 -- 172.21.15.132:0/3886986246 >> v2:172.21.15.194:3300/0 conn(0x7f83c00cf080 msgr2=0x7f83c00cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83bffff640 1 --2- 172.21.15.132:0/3886986246 >> v2:172.21.15.194:3300/0 conn(0x7f83c00cf080 0x7f83c00cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.078+0000 7f83bffff640 1 -- 172.21.15.132:0/3886986246 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00d0bb0 con 0x7f83c00cfa40 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.079+0000 7f83bffff640 1 --2- 172.21.15.132:0/3886986246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cfa40 0x7f83c0161d30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f83c00b6910 tx=0x7f83b802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5cdf748f32eb8c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.079+0000 7f83be7fc640 1 -- 172.21.15.132:0/3886986246 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b802c9e0 con 0x7f83c00cfa40 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.079+0000 7f83be7fc640 1 -- 172.21.15.132:0/3886986246 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b802cb40 con 0x7f83c00cfa40 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.079+0000 7f83be7fc640 1 -- 172.21.15.132:0/3886986246 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b80343f0 con 0x7f83c00cfa40 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.079+0000 7f83c608f640 1 -- 172.21.15.132:0/3886986246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cfa40 msgr2=0x7f83c0161d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.079+0000 7f83c608f640 1 --2- 172.21.15.132:0/3886986246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cfa40 0x7f83c0161d30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f83c00b6910 tx=0x7f83b802be40 comp rx=0 tx=0).stop 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.080+0000 7f83c608f640 1 -- 172.21.15.132:0/3886986246 shutdown_connections 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.080+0000 7f83c608f640 1 --2- 172.21.15.132:0/3886986246 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cfa40 0x7f83c0161d30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.080+0000 7f83c608f640 1 --2- 172.21.15.132:0/3886986246 >> v2:172.21.15.194:3300/0 conn(0x7f83c00cf080 0x7f83c00cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.080+0000 7f83c608f640 1 --2- 172.21.15.132:0/3886986246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c0161540 0x7f83c00b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.080+0000 7f83c608f640 1 -- 172.21.15.132:0/3886986246 >> 172.21.15.132:0/3886986246 conn(0x7f83c009d120 msgr2=0x7f83c00d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:23.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.080+0000 7f83c608f640 1 -- 172.21.15.132:0/3886986246 shutdown_connections 2024-03-16T17:48:23.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.080+0000 7f83c608f640 1 -- 172.21.15.132:0/3886986246 wait complete. 2024-03-16T17:48:23.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.081+0000 7f83c608f640 1 Processor -- start 2024-03-16T17:48:23.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.081+0000 7f83c608f640 1 -- start start 2024-03-16T17:48:23.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83c608f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cf080 0x7f83c014f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83c608f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c00cfa40 0x7f83c01f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83c608f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c0161540 0x7f83c015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83c608f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01f4c60 con 0x7f83c00cf080 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83c608f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01f46a0 con 0x7f83c00cfa40 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83c608f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01f4980 con 0x7f83c0161540 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83bf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cf080 0x7f83c014f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83bf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cf080 0x7f83c014f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41420/0 (socket says 172.21.15.132:41420) 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83bf7fe640 1 -- 172.21.15.132:0/3622391590 learned_addr learned my addr 172.21.15.132:0/3622391590 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83bffff640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c0161540 0x7f83c015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83beffd640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c00cfa40 0x7f83c01f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83bf7fe640 1 -- 172.21.15.132:0/3622391590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c0161540 msgr2=0x7f83c015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83bf7fe640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c0161540 0x7f83c015adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83bf7fe640 1 -- 172.21.15.132:0/3622391590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c00cfa40 msgr2=0x7f83c01f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83bf7fe640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c00cfa40 0x7f83c01f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83bf7fe640 1 -- 172.21.15.132:0/3622391590 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8009b30 con 0x7f83c00cf080 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83bf7fe640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cf080 0x7f83c014f370 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f83b000d800 tx=0x7f83b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83a7fff640 1 -- 172.21.15.132:0/3622391590 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000b6c0 con 0x7f83c00cf080 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83a7fff640 1 -- 172.21.15.132:0/3622391590 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b000b820 con 0x7f83c00cf080 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83a7fff640 1 -- 172.21.15.132:0/3622391590 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b000bbb0 con 0x7f83c00cf080 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83c608f640 1 -- 172.21.15.132:0/3622391590 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c00b2040 con 0x7f83c00cf080 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.082+0000 7f83c608f640 1 -- 172.21.15.132:0/3622391590 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c01f4e10 con 0x7f83c00cf080 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.083+0000 7f83c608f640 1 -- 172.21.15.132:0/3622391590 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c00b1ea0 con 0x7f83c00cf080 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.084+0000 7f83a7fff640 1 -- 172.21.15.132:0/3622391590 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f83b000bd10 con 0x7f83c00cf080 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.084+0000 7f83a7fff640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f83ac06b3b0 0x7f83ac06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.084+0000 7f83a7fff640 1 -- 172.21.15.132:0/3622391590 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83b008a1a0 con 0x7f83c00cf080 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.084+0000 7f83beffd640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f83ac06b3b0 0x7f83ac06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.085+0000 7f83beffd640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f83ac06b3b0 0x7f83ac06d870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f83b4006fd0 tx=0x7f83b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:23.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.089+0000 7f83a7fff640 1 -- 172.21.15.132:0/3622391590 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f83c00b1ea0 con 0x7f83c00cf080 2024-03-16T17:48:23.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.264+0000 7f83c608f640 1 -- 172.21.15.132:0/3622391590 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83c00b1ea0 con 0x7f83c00cf080 2024-03-16T17:48:23.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.265+0000 7f83a7fff640 1 -- 172.21.15.132:0/3622391590 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f83c00b1ea0 con 0x7f83c00cf080 2024-03-16T17:48:23.269 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:23.269 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:23.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.267+0000 7f83c608f640 1 -- 172.21.15.132:0/3622391590 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f83ac06b3b0 msgr2=0x7f83ac06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.267+0000 7f83c608f640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f83ac06b3b0 0x7f83ac06d870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f83b4006fd0 tx=0x7f83b4008040 comp rx=0 tx=0).stop 2024-03-16T17:48:23.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.267+0000 7f83c608f640 1 -- 172.21.15.132:0/3622391590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cf080 msgr2=0x7f83c014f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.267+0000 7f83c608f640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cf080 0x7f83c014f370 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f83b000d800 tx=0x7f83b000dcc0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.268+0000 7f83c608f640 1 -- 172.21.15.132:0/3622391590 shutdown_connections 2024-03-16T17:48:23.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.268+0000 7f83c608f640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f83ac06b3b0 0x7f83ac06d870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.268+0000 7f83c608f640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83c0161540 0x7f83c015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.268+0000 7f83c608f640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83c00cfa40 0x7f83c01f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.268+0000 7f83c608f640 1 --2- 172.21.15.132:0/3622391590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83c00cf080 0x7f83c014f370 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.268+0000 7f83c608f640 1 -- 172.21.15.132:0/3622391590 >> 172.21.15.132:0/3622391590 conn(0x7f83c009d120 msgr2=0x7f83c01607e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:23.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.268+0000 7f83c608f640 1 -- 172.21.15.132:0/3622391590 shutdown_connections 2024-03-16T17:48:23.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.268+0000 7f83c608f640 1 -- 172.21.15.132:0/3622391590 wait complete. 2024-03-16T17:48:23.282 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:23.283 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.384+0000 7f3568da2640 1 Processor -- start 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.384+0000 7f3568da2640 1 -- start start 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3568da2640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f356415bd90 0x7f35640b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3568da2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35640b0290 0x7f35640b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3568da2640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35640b0dd0 con 0x7f35640b08d0 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3568da2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35640b1a50 con 0x7f35640b0290 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3568da2640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35640b10b0 con 0x7f356415bd90 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3562ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35640b0290 0x7f35640b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3562ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35640b0290 0x7f35640b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41424/0 (socket says 172.21.15.132:41424) 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3562ffd640 1 -- 172.21.15.132:0/3430552709 learned_addr learned my addr 172.21.15.132:0/3430552709 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:23.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f35637fe640 1 --2- 172.21.15.132:0/3430552709 >> v2:172.21.15.194:3300/0 conn(0x7f356415bd90 0x7f35640b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3562ffd640 1 -- 172.21.15.132:0/3430552709 >> v2:172.21.15.194:3300/0 conn(0x7f356415bd90 msgr2=0x7f35640b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:23.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3562ffd640 1 --2- 172.21.15.132:0/3430552709 >> v2:172.21.15.194:3300/0 conn(0x7f356415bd90 0x7f35640b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3562ffd640 1 -- 172.21.15.132:0/3430552709 >> v1:172.21.15.194:6789/0 conn(0x7f35640b08d0 legacy=0x7f356415c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.385+0000 7f3562ffd640 1 -- 172.21.15.132:0/3430552709 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35640b1390 con 0x7f35640b0290 2024-03-16T17:48:23.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.386+0000 7f3562ffd640 1 --2- 172.21.15.132:0/3430552709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 0x7f35640b23b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f35640686d0 tx=0x7f355802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7405e8168fb65b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:23.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.386+0000 7f35627fc640 1 -- 172.21.15.132:0/3430552709 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558031870 con 0x7f35640b0290 2024-03-16T17:48:23.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.386+0000 7f35627fc640 1 -- 172.21.15.132:0/3430552709 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35580319d0 con 0x7f35640b0290 2024-03-16T17:48:23.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.386+0000 7f35627fc640 1 -- 172.21.15.132:0/3430552709 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558031d60 con 0x7f35640b0290 2024-03-16T17:48:23.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.387+0000 7f3568da2640 1 -- 172.21.15.132:0/3430552709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 msgr2=0x7f35640b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.387+0000 7f3568da2640 1 --2- 172.21.15.132:0/3430552709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 0x7f35640b23b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f35640686d0 tx=0x7f355802b910 comp rx=0 tx=0).stop 2024-03-16T17:48:23.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.387+0000 7f3568da2640 1 -- 172.21.15.132:0/3430552709 shutdown_connections 2024-03-16T17:48:23.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.387+0000 7f3568da2640 1 --2- 172.21.15.132:0/3430552709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 0x7f35640b23b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.387+0000 7f3568da2640 1 --2- 172.21.15.132:0/3430552709 >> v2:172.21.15.194:3300/0 conn(0x7f356415bd90 0x7f35640b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.387+0000 7f3568da2640 1 -- 172.21.15.132:0/3430552709 >> 172.21.15.132:0/3430552709 conn(0x7f3564073170 msgr2=0x7f356409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:23.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.387+0000 7f3568da2640 1 -- 172.21.15.132:0/3430552709 shutdown_connections 2024-03-16T17:48:23.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.387+0000 7f3568da2640 1 -- 172.21.15.132:0/3430552709 wait complete. 2024-03-16T17:48:23.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.388+0000 7f3568da2640 1 Processor -- start 2024-03-16T17:48:23.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.388+0000 7f3568da2640 1 -- start start 2024-03-16T17:48:23.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.389+0000 7f3568da2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 0x7f356415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.389+0000 7f3568da2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35640b08d0 0x7f3564156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.389+0000 7f3568da2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f356415bd90 0x7f356409d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f3568da2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3564157030 con 0x7f35640b0290 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f3568da2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356415cdf0 con 0x7f35640b08d0 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f3568da2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356409e1f0 con 0x7f356415bd90 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f35637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 0x7f356415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f35637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 0x7f356415d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41428/0 (socket says 172.21.15.132:41428) 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f35637fe640 1 -- 172.21.15.132:0/4083019056 learned_addr learned my addr 172.21.15.132:0/4083019056 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f3562ffd640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35640b08d0 0x7f3564156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f3563fff640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f356415bd90 0x7f356409d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f35637fe640 1 -- 172.21.15.132:0/4083019056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f356415bd90 msgr2=0x7f356409d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f35637fe640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f356415bd90 0x7f356409d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f35637fe640 1 -- 172.21.15.132:0/4083019056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35640b08d0 msgr2=0x7f3564156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f35637fe640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35640b08d0 0x7f3564156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f35637fe640 1 -- 172.21.15.132:0/4083019056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35580094d0 con 0x7f35640b0290 2024-03-16T17:48:23.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f3562ffd640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35640b08d0 0x7f3564156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:23.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f35637fe640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 0x7f356415d8b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f355400d5f0 tx=0x7f355400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:23.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f354bfff640 1 -- 172.21.15.132:0/4083019056 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540125f0 con 0x7f35640b0290 2024-03-16T17:48:23.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f354bfff640 1 -- 172.21.15.132:0/4083019056 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3554012750 con 0x7f35640b0290 2024-03-16T17:48:23.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f3568da2640 1 -- 172.21.15.132:0/4083019056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356409e4d0 con 0x7f35640b0290 2024-03-16T17:48:23.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f354bfff640 1 -- 172.21.15.132:0/4083019056 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554012b00 con 0x7f35640b0290 2024-03-16T17:48:23.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.390+0000 7f3568da2640 1 -- 172.21.15.132:0/4083019056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356415d390 con 0x7f35640b0290 2024-03-16T17:48:23.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.391+0000 7f3568da2640 1 -- 172.21.15.132:0/4083019056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356409e6c0 con 0x7f35640b0290 2024-03-16T17:48:23.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.392+0000 7f354bfff640 1 -- 172.21.15.132:0/4083019056 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f3554012c60 con 0x7f35640b0290 2024-03-16T17:48:23.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.392+0000 7f354bfff640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f355006b3b0 0x7f355006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.392+0000 7f3562ffd640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f355006b3b0 0x7f355006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.392+0000 7f354bfff640 1 -- 172.21.15.132:0/4083019056 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f355408a090 con 0x7f35640b0290 2024-03-16T17:48:23.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.393+0000 7f3562ffd640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f355006b3b0 0x7f355006d870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3558036000 tx=0x7f355803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:23.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.397+0000 7f354bfff640 1 -- 172.21.15.132:0/4083019056 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3554054d80 con 0x7f35640b0290 2024-03-16T17:48:23.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.575+0000 7f3568da2640 1 -- 172.21.15.132:0/4083019056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f356404f250 con 0x7f35640b0290 2024-03-16T17:48:23.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.575+0000 7f354bfff640 1 -- 172.21.15.132:0/4083019056 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3554058440 con 0x7f35640b0290 2024-03-16T17:48:23.579 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:23.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 -- 172.21.15.132:0/4083019056 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f355006b3b0 msgr2=0x7f355006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f355006b3b0 0x7f355006d870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3558036000 tx=0x7f355803c040 comp rx=0 tx=0).stop 2024-03-16T17:48:23.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 -- 172.21.15.132:0/4083019056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 msgr2=0x7f356415d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 0x7f356415d8b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f355400d5f0 tx=0x7f355400dab0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 -- 172.21.15.132:0/4083019056 shutdown_connections 2024-03-16T17:48:23.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f355006b3b0 0x7f355006d870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f356415bd90 0x7f356409d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35640b08d0 0x7f3564156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 --2- 172.21.15.132:0/4083019056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35640b0290 0x7f356415d8b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 -- 172.21.15.132:0/4083019056 >> 172.21.15.132:0/4083019056 conn(0x7f3564073170 msgr2=0x7f35641588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:23.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 -- 172.21.15.132:0/4083019056 shutdown_connections 2024-03-16T17:48:23.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.577+0000 7f3568da2640 1 -- 172.21.15.132:0/4083019056 wait complete. 2024-03-16T17:48:23.592 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:23.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.697+0000 7fbc87847640 1 Processor -- start 2024-03-16T17:48:23.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.697+0000 7fbc87847640 1 -- start start 2024-03-16T17:48:23.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.698+0000 7fbc87847640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc80161760 0x7fbc800b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.698+0000 7fbc87847640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc80161b40 0x7fbc800d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.698+0000 7fbc87847640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbc800d49f0 0x7fbc800d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.698+0000 7fbc87847640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc800cff20 con 0x7fbc80161b40 2024-03-16T17:48:23.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.698+0000 7fbc87847640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc800b5500 con 0x7fbc800d49f0 2024-03-16T17:48:23.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.698+0000 7fbc87847640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800cf5f0 con 0x7fbc80161760 2024-03-16T17:48:23.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.698+0000 7fbc84de2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc80161b40 0x7fbc800d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.698+0000 7fbc84de2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc80161b40 0x7fbc800d0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41434/0 (socket says 172.21.15.132:41434) 2024-03-16T17:48:23.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.698+0000 7fbc84de2640 1 -- 172.21.15.132:0/3253440554 learned_addr learned my addr 172.21.15.132:0/3253440554 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:23.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.699+0000 7fbc85de4640 1 --2- 172.21.15.132:0/3253440554 >> v2:172.21.15.194:3300/0 conn(0x7fbc800d49f0 0x7fbc800d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.699+0000 7fbc855e3640 1 --2- 172.21.15.132:0/3253440554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc80161760 0x7fbc800b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.699+0000 7fbc84de2640 1 -- 172.21.15.132:0/3253440554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc80161760 msgr2=0x7fbc800b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:23.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.699+0000 7fbc84de2640 1 --2- 172.21.15.132:0/3253440554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc80161760 0x7fbc800b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.699+0000 7fbc84de2640 1 -- 172.21.15.132:0/3253440554 >> v2:172.21.15.194:3300/0 conn(0x7fbc800d49f0 msgr2=0x7fbc800d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:23.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.699+0000 7fbc84de2640 1 --2- 172.21.15.132:0/3253440554 >> v2:172.21.15.194:3300/0 conn(0x7fbc800d49f0 0x7fbc800d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.699+0000 7fbc84de2640 1 -- 172.21.15.132:0/3253440554 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800cf8d0 con 0x7fbc80161b40 2024-03-16T17:48:23.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.700+0000 7fbc84de2640 1 --2- 172.21.15.132:0/3253440554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 0x7fbc800d0600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbc800d1450 tx=0x7fbc7002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146b93b0f3aff04 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:23.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.700+0000 7fbc77fff640 1 -- 172.21.15.132:0/3253440554 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70031870 con 0x7fbc80161b40 2024-03-16T17:48:23.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.700+0000 7fbc77fff640 1 -- 172.21.15.132:0/3253440554 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc700319d0 con 0x7fbc80161b40 2024-03-16T17:48:23.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.700+0000 7fbc77fff640 1 -- 172.21.15.132:0/3253440554 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70031d60 con 0x7fbc80161b40 2024-03-16T17:48:23.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.701+0000 7fbc87847640 1 -- 172.21.15.132:0/3253440554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 msgr2=0x7fbc800d0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.701+0000 7fbc87847640 1 --2- 172.21.15.132:0/3253440554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 0x7fbc800d0600 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbc800d1450 tx=0x7fbc7002b910 comp rx=0 tx=0).stop 2024-03-16T17:48:23.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.701+0000 7fbc87847640 1 -- 172.21.15.132:0/3253440554 shutdown_connections 2024-03-16T17:48:23.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.701+0000 7fbc87847640 1 --2- 172.21.15.132:0/3253440554 >> v2:172.21.15.194:3300/0 conn(0x7fbc800d49f0 0x7fbc800d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.701+0000 7fbc87847640 1 --2- 172.21.15.132:0/3253440554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 0x7fbc800d0600 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.701+0000 7fbc87847640 1 --2- 172.21.15.132:0/3253440554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc80161760 0x7fbc800b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.701+0000 7fbc87847640 1 -- 172.21.15.132:0/3253440554 >> 172.21.15.132:0/3253440554 conn(0x7fbc800d3ed0 msgr2=0x7fbc800d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:23.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.701+0000 7fbc87847640 1 -- 172.21.15.132:0/3253440554 shutdown_connections 2024-03-16T17:48:23.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.701+0000 7fbc87847640 1 -- 172.21.15.132:0/3253440554 wait complete. 2024-03-16T17:48:23.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.702+0000 7fbc87847640 1 Processor -- start 2024-03-16T17:48:23.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.702+0000 7fbc87847640 1 -- start start 2024-03-16T17:48:23.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc87847640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc800d49f0 0x7fbc800b8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc87847640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc80161760 0x7fbc80154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc87847640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 0x7fbc800b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc87847640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800b7480 con 0x7fbc80161b40 2024-03-16T17:48:23.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc87847640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800b7760 con 0x7fbc80161760 2024-03-16T17:48:23.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc87847640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800b7a40 con 0x7fbc800d49f0 2024-03-16T17:48:23.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc85de4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 0x7fbc800b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc85de4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 0x7fbc800b6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41444/0 (socket says 172.21.15.132:41444) 2024-03-16T17:48:23.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc85de4640 1 -- 172.21.15.132:0/3824113108 learned_addr learned my addr 172.21.15.132:0/3824113108 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:23.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc84de2640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc80161760 0x7fbc80154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc855e3640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc800d49f0 0x7fbc800b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc85de4640 1 -- 172.21.15.132:0/3824113108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc800d49f0 msgr2=0x7fbc800b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc85de4640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc800d49f0 0x7fbc800b8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc85de4640 1 -- 172.21.15.132:0/3824113108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc80161760 msgr2=0x7fbc80154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc85de4640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc80161760 0x7fbc80154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc85de4640 1 -- 172.21.15.132:0/3824113108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc700094d0 con 0x7fbc80161b40 2024-03-16T17:48:23.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.703+0000 7fbc855e3640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc800d49f0 0x7fbc800b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:23.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.704+0000 7fbc85de4640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 0x7fbc800b6a30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbc78007e60 tx=0x7fbc7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:23.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.704+0000 7fbc75ffb640 1 -- 172.21.15.132:0/3824113108 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78014620 con 0x7fbc80161b40 2024-03-16T17:48:23.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.704+0000 7fbc75ffb640 1 -- 172.21.15.132:0/3824113108 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7800ee90 con 0x7fbc80161b40 2024-03-16T17:48:23.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.704+0000 7fbc87847640 1 -- 172.21.15.132:0/3824113108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc800b7d20 con 0x7fbc80161b40 2024-03-16T17:48:23.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.704+0000 7fbc75ffb640 1 -- 172.21.15.132:0/3824113108 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc780149e0 con 0x7fbc80161b40 2024-03-16T17:48:23.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.704+0000 7fbc87847640 1 -- 172.21.15.132:0/3824113108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc80154840 con 0x7fbc80161b40 2024-03-16T17:48:23.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.705+0000 7fbc87847640 1 -- 172.21.15.132:0/3824113108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc80068450 con 0x7fbc80161b40 2024-03-16T17:48:23.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.705+0000 7fbc75ffb640 1 -- 172.21.15.132:0/3824113108 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fbc78014b40 con 0x7fbc80161b40 2024-03-16T17:48:23.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.706+0000 7fbc75ffb640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbc6406b3b0 0x7fbc6406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:23.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.706+0000 7fbc75ffb640 1 -- 172.21.15.132:0/3824113108 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc7808a4a0 con 0x7fbc80161b40 2024-03-16T17:48:23.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.706+0000 7fbc855e3640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbc6406b3b0 0x7fbc6406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:23.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.706+0000 7fbc855e3640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbc6406b3b0 0x7fbc6406d870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c006fd0 tx=0x7fbc7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:23.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.710+0000 7fbc75ffb640 1 -- 172.21.15.132:0/3824113108 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbc780550f0 con 0x7fbc80161b40 2024-03-16T17:48:23.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.882+0000 7fbc87847640 1 -- 172.21.15.132:0/3824113108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc800b8240 con 0x7fbc80161b40 2024-03-16T17:48:23.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.883+0000 7fbc75ffb640 1 -- 172.21.15.132:0/3824113108 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc800b8240 con 0x7fbc80161b40 2024-03-16T17:48:23.886 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:23.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 -- 172.21.15.132:0/3824113108 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbc6406b3b0 msgr2=0x7fbc6406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbc6406b3b0 0x7fbc6406d870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c006fd0 tx=0x7fbc7c008040 comp rx=0 tx=0).stop 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 -- 172.21.15.132:0/3824113108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 msgr2=0x7fbc800b6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 0x7fbc800b6a30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbc78007e60 tx=0x7fbc7800e4b0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 -- 172.21.15.132:0/3824113108 shutdown_connections 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbc6406b3b0 0x7fbc6406d870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc80161b40 0x7fbc800b6a30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc80161760 0x7fbc80154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 --2- 172.21.15.132:0/3824113108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc800d49f0 0x7fbc800b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 -- 172.21.15.132:0/3824113108 >> 172.21.15.132:0/3824113108 conn(0x7fbc800d3ed0 msgr2=0x7fbc8015e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 -- 172.21.15.132:0/3824113108 shutdown_connections 2024-03-16T17:48:23.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.885+0000 7fbc87847640 1 -- 172.21.15.132:0/3824113108 wait complete. 2024-03-16T17:48:23.899 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:24.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.998+0000 7fb051581640 1 Processor -- start 2024-03-16T17:48:24.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.998+0000 7fb051581640 1 -- start start 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.999+0000 7fb051581640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb04c15ba80 0x7fb04c15eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.999+0000 7fb051581640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c162460 con 0x7fb04c0b4160 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.999+0000 7fb051581640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c162740 con 0x7fb04c161a10 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.999+0000 7fb051581640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c15be60 con 0x7fb04c15ba80 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.999+0000 7fb04b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb04c0b4160 0x7fb04c06ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32958/0 (socket says 172.21.15.132:32958) 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:23.999+0000 7fb04b7fe640 1 -- 172.21.15.132:0/3575083898 learned_addr learned my addr 172.21.15.132:0/3575083898 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04affd640 1 --2- 172.21.15.132:0/3575083898 >> v2:172.21.15.194:3300/0 conn(0x7fb04c15ba80 0x7fb04c15eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542447093 0 0) 0x7fb04c162460 con 0x7fb04c0b4160 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb038003520 con 0x7fb04c0b4160 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033188163 0 0) 0x7fb04c162740 con 0x7fb04c161a10 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb04c162460 con 0x7fb04c161a10 2024-03-16T17:48:24.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 166417057 0 0) 0x7fb038003520 con 0x7fb04c0b4160 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 >> v2:172.21.15.194:3300/0 conn(0x7fb04c15ba80 msgr2=0x7fb04c15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 --2- 172.21.15.132:0/3575083898 >> v2:172.21.15.194:3300/0 conn(0x7fb04c15ba80 0x7fb04c15eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 >> v1:172.21.15.194:6789/0 conn(0x7fb04c161a10 legacy=0x7fb04c0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c15e6e0 con 0x7fb04c0b4160 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7fb0440019f0 con 0x7fb04c0b4160 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 >> v1:172.21.15.132:6789/0 conn(0x7fb04c0b4160 legacy=0x7fb04c06ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb038003b50 0x7fb038003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0380047c0 0x7fb038004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0380051d0 0x7fb03800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03800c0d0 con 0x7fb0380051d0 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03800c240 con 0x7fb0380047c0 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03800c400 con 0x7fb038003b50 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04b7fe640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0380051d0 0x7fb03800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04affd640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb038003b50 0x7fb038003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb043fff640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0380047c0 0x7fb038004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04b7fe640 1 -- 172.21.15.132:0/3575083898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb038003b50 msgr2=0x7fb038003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04b7fe640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb038003b50 0x7fb038003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04b7fe640 1 -- 172.21.15.132:0/3575083898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0380047c0 msgr2=0x7fb038004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04b7fe640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0380047c0 0x7fb038004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.000+0000 7fb04b7fe640 1 -- 172.21.15.132:0/3575083898 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038003520 con 0x7fb0380051d0 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.001+0000 7fb04b7fe640 1 -- 172.21.15.132:0/3575083898 reap_dead start 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.001+0000 7fb04b7fe640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0380051d0 0x7fb03800b980 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb04400a700 tx=0x7fb0380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7f26804b77a3da server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.001+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044034630 con 0x7fb0380051d0 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.001+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04402f070 con 0x7fb0380051d0 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.001+0000 7fb04a7fc640 1 -- 172.21.15.132:0/3575083898 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0440349d0 con 0x7fb0380051d0 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.002+0000 7fb051581640 1 -- 172.21.15.132:0/3575083898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0380051d0 msgr2=0x7fb03800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.002+0000 7fb051581640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0380051d0 0x7fb03800b980 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb04400a700 tx=0x7fb0380057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.002+0000 7fb051581640 1 -- 172.21.15.132:0/3575083898 shutdown_connections 2024-03-16T17:48:24.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.002+0000 7fb051581640 1 --2- 172.21.15.132:0/3575083898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0380051d0 0x7fb03800b980 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.002+0000 7fb051581640 1 -- 172.21.15.132:0/3575083898 >> 172.21.15.132:0/3575083898 conn(0x7fb04c06bff0 msgr2=0x7fb04c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:24.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.002+0000 7fb051581640 1 -- 172.21.15.132:0/3575083898 shutdown_connections 2024-03-16T17:48:24.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.002+0000 7fb051581640 1 -- 172.21.15.132:0/3575083898 wait complete. 2024-03-16T17:48:24.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.003+0000 7fb051581640 1 Processor -- start 2024-03-16T17:48:24.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.003+0000 7fb051581640 1 -- start start 2024-03-16T17:48:24.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb051581640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0380051d0 0x7fb04c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb051581640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb04c0b1010 0x7fb04c1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb051581640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb04c15be60 0x7fb04c145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb051581640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c15d280 con 0x7fb04c15be60 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb051581640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c1537b0 con 0x7fb0380051d0 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb051581640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c06df50 con 0x7fb04c0b1010 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb04b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb04c15be60 0x7fb04c145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb04b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb04c15be60 0x7fb04c145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41464/0 (socket says 172.21.15.132:41464) 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb04b7fe640 1 -- 172.21.15.132:0/3559638722 learned_addr learned my addr 172.21.15.132:0/3559638722 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb04affd640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0380051d0 0x7fb04c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb043fff640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb04c0b1010 0x7fb04c1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb04b7fe640 1 -- 172.21.15.132:0/3559638722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb04c0b1010 msgr2=0x7fb04c1543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb04b7fe640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb04c0b1010 0x7fb04c1543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb04b7fe640 1 -- 172.21.15.132:0/3559638722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0380051d0 msgr2=0x7fb04c15cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb04b7fe640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0380051d0 0x7fb04c15cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb04b7fe640 1 -- 172.21.15.132:0/3559638722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c15d460 con 0x7fb04c15be60 2024-03-16T17:48:24.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb04b7fe640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb04c15be60 0x7fb04c145140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb04400a820 tx=0x7fb044001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb0437fe640 1 -- 172.21.15.132:0/3559638722 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044034840 con 0x7fb04c15be60 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.004+0000 7fb0437fe640 1 -- 172.21.15.132:0/3559638722 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0440349a0 con 0x7fb04c15be60 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.005+0000 7fb0437fe640 1 -- 172.21.15.132:0/3559638722 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044034d10 con 0x7fb04c15be60 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.005+0000 7fb051581640 1 -- 172.21.15.132:0/3559638722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c06e1f0 con 0x7fb04c15be60 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.005+0000 7fb051581640 1 -- 172.21.15.132:0/3559638722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c15d740 con 0x7fb04c15be60 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.006+0000 7fb051581640 1 -- 172.21.15.132:0/3559638722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c068450 con 0x7fb04c15be60 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.006+0000 7fb0437fe640 1 -- 172.21.15.132:0/3559638722 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb044031030 con 0x7fb04c15be60 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.006+0000 7fb0437fe640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb02c06b3b0 0x7fb02c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.006+0000 7fb0437fe640 1 -- 172.21.15.132:0/3559638722 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0440abf60 con 0x7fb04c15be60 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.006+0000 7fb04affd640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb02c06b3b0 0x7fb02c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.007+0000 7fb04affd640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb02c06b3b0 0x7fb02c06d870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009a80 tx=0x7fb03c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:24.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.015+0000 7fb0437fe640 1 -- 172.21.15.132:0/3559638722 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb044076c30 con 0x7fb04c15be60 2024-03-16T17:48:24.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.192+0000 7fb051581640 1 -- 172.21.15.132:0/3559638722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb04c068450 con 0x7fb04c15be60 2024-03-16T17:48:24.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.193+0000 7fb0437fe640 1 -- 172.21.15.132:0/3559638722 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb04407a2f0 con 0x7fb04c15be60 2024-03-16T17:48:24.196 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.194+0000 7fb051581640 1 -- 172.21.15.132:0/3559638722 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb02c06b3b0 msgr2=0x7fb02c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.194+0000 7fb051581640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb02c06b3b0 0x7fb02c06d870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009a80 tx=0x7fb03c008040 comp rx=0 tx=0).stop 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.194+0000 7fb051581640 1 -- 172.21.15.132:0/3559638722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb04c15be60 msgr2=0x7fb04c145140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.194+0000 7fb051581640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb04c15be60 0x7fb04c145140 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb04400a820 tx=0x7fb044001cb0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.194+0000 7fb051581640 1 -- 172.21.15.132:0/3559638722 shutdown_connections 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.194+0000 7fb051581640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb02c06b3b0 0x7fb02c06d870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.194+0000 7fb051581640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb04c15be60 0x7fb04c145140 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.195+0000 7fb051581640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb04c0b1010 0x7fb04c1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.195+0000 7fb051581640 1 --2- 172.21.15.132:0/3559638722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0380051d0 0x7fb04c15cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.195+0000 7fb051581640 1 -- 172.21.15.132:0/3559638722 >> 172.21.15.132:0/3559638722 conn(0x7fb04c06bff0 msgr2=0x7fb04c1577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.195+0000 7fb051581640 1 -- 172.21.15.132:0/3559638722 shutdown_connections 2024-03-16T17:48:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.195+0000 7fb051581640 1 -- 172.21.15.132:0/3559638722 wait complete. 2024-03-16T17:48:24.209 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T17:48:24.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.306+0000 7f293b09a640 1 Processor -- start 2024-03-16T17:48:24.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.306+0000 7f293b09a640 1 -- start start 2024-03-16T17:48:24.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f293b09a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29340b3b50 0x7f2934072760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f293b09a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f293415e280 0x7f293415e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f293b09a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29340b5cb0 con 0x7f293406aee0 2024-03-16T17:48:24.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f293b09a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2934073020 con 0x7f29340b3b50 2024-03-16T17:48:24.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f293b09a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29340b53c0 con 0x7f293415e280 2024-03-16T17:48:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f2933fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29340b3b50 0x7f2934072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f2933fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29340b3b50 0x7f2934072760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41476/0 (socket says 172.21.15.132:41476) 2024-03-16T17:48:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f2933fff640 1 -- 172.21.15.132:0/3294560402 learned_addr learned my addr 172.21.15.132:0/3294560402 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f2939637640 1 --2- 172.21.15.132:0/3294560402 >> v2:172.21.15.194:3300/0 conn(0x7f293415e280 0x7f293415e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f2933fff640 1 -- 172.21.15.132:0/3294560402 >> v2:172.21.15.194:3300/0 conn(0x7f293415e280 msgr2=0x7f293415e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f2933fff640 1 --2- 172.21.15.132:0/3294560402 >> v2:172.21.15.194:3300/0 conn(0x7f293415e280 0x7f293415e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f2933fff640 1 -- 172.21.15.132:0/3294560402 >> v1:172.21.15.132:6789/0 conn(0x7f293406aee0 legacy=0x7f293406b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f29337fe640 1 -- 172.21.15.132:0/3294560402 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024865339 0 0) 0x7f29340b5cb0 con 0x7f293406aee0 2024-03-16T17:48:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f2933fff640 1 -- 172.21.15.132:0/3294560402 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934072d40 con 0x7f29340b3b50 2024-03-16T17:48:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.307+0000 7f2939637640 1 --2- 172.21.15.132:0/3294560402 >> v2:172.21.15.194:3300/0 conn(0x7f293415e280 0x7f293415e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.308+0000 7f2933fff640 1 --2- 172.21.15.132:0/3294560402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 0x7f2934072760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f293406bc30 tx=0x7f292002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b764f1cbab07c45 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.308+0000 7f29337fe640 1 -- 172.21.15.132:0/3294560402 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920030860 con 0x7f29340b3b50 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.309+0000 7f29337fe640 1 -- 172.21.15.132:0/3294560402 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29200309c0 con 0x7f29340b3b50 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.309+0000 7f29337fe640 1 -- 172.21.15.132:0/3294560402 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920030d50 con 0x7f29340b3b50 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.309+0000 7f293b09a640 1 -- 172.21.15.132:0/3294560402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 msgr2=0x7f2934072760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.309+0000 7f293b09a640 1 --2- 172.21.15.132:0/3294560402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 0x7f2934072760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f293406bc30 tx=0x7f292002b9a0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.309+0000 7f293b09a640 1 -- 172.21.15.132:0/3294560402 shutdown_connections 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.309+0000 7f293b09a640 1 --2- 172.21.15.132:0/3294560402 >> v2:172.21.15.194:3300/0 conn(0x7f293415e280 0x7f293415e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.309+0000 7f293b09a640 1 --2- 172.21.15.132:0/3294560402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 0x7f2934072760 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.309+0000 7f293b09a640 1 -- 172.21.15.132:0/3294560402 >> 172.21.15.132:0/3294560402 conn(0x7f29340b2850 msgr2=0x7f29340b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.309+0000 7f293b09a640 1 -- 172.21.15.132:0/3294560402 shutdown_connections 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.309+0000 7f293b09a640 1 -- 172.21.15.132:0/3294560402 wait complete. 2024-03-16T17:48:24.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.310+0000 7f293b09a640 1 Processor -- start 2024-03-16T17:48:24.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.310+0000 7f293b09a640 1 -- start start 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f293b09a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f293406aee0 0x7f2934145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f293b09a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 0x7f2934146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f293b09a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f293415e280 0x7f2934158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f293b09a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934145fd0 con 0x7f29340b3b50 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f293b09a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29341576e0 con 0x7f293406aee0 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f293b09a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29341579c0 con 0x7f293415e280 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f2933fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 0x7f2934146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f2933fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 0x7f2934146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41488/0 (socket says 172.21.15.132:41488) 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f2933fff640 1 -- 172.21.15.132:0/2146121320 learned_addr learned my addr 172.21.15.132:0/2146121320 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f2938e36640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f293406aee0 0x7f2934145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f2939637640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f293415e280 0x7f2934158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.311+0000 7f2933fff640 1 -- 172.21.15.132:0/2146121320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f293415e280 msgr2=0x7f2934158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f2933fff640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f293415e280 0x7f2934158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f2933fff640 1 -- 172.21.15.132:0/2146121320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f293406aee0 msgr2=0x7f2934145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f2933fff640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f293406aee0 0x7f2934145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f2933fff640 1 -- 172.21.15.132:0/2146121320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29200094d0 con 0x7f29340b3b50 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f2938e36640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f293406aee0 0x7f2934145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f2939637640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f293415e280 0x7f2934158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f2933fff640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 0x7f2934146300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29200090b0 tx=0x7f2920004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f29317fa640 1 -- 172.21.15.132:0/2146121320 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292003e040 con 0x7f29340b3b50 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f29317fa640 1 -- 172.21.15.132:0/2146121320 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2920039c90 con 0x7f29340b3b50 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f29317fa640 1 -- 172.21.15.132:0/2146121320 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2920004030 con 0x7f29340b3b50 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f293b09a640 1 -- 172.21.15.132:0/2146121320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2934157ca0 con 0x7f29340b3b50 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.312+0000 7f293b09a640 1 -- 172.21.15.132:0/2146121320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2934158260 con 0x7f29340b3b50 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.313+0000 7f293b09a640 1 -- 172.21.15.132:0/2146121320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2934067750 con 0x7f29340b3b50 2024-03-16T17:48:24.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.313+0000 7f29317fa640 1 -- 172.21.15.132:0/2146121320 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f29200041b0 con 0x7f29340b3b50 2024-03-16T17:48:24.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.314+0000 7f29317fa640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f291806b3b0 0x7f291806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.314+0000 7f29317fa640 1 -- 172.21.15.132:0/2146121320 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29200ac3c0 con 0x7f29340b3b50 2024-03-16T17:48:24.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.314+0000 7f2938e36640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f291806b3b0 0x7f291806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.314+0000 7f2938e36640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f291806b3b0 0x7f291806d870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2928000f60 tx=0x7f2928009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:24.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.318+0000 7f29317fa640 1 -- 172.21.15.132:0/2146121320 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f29200770b0 con 0x7f29340b3b50 2024-03-16T17:48:24.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.504+0000 7f293b09a640 1 -- 172.21.15.132:0/2146121320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2934071f30 con 0x7f29340b3b50 2024-03-16T17:48:24.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.504+0000 7f29317fa640 1 -- 172.21.15.132:0/2146121320 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f292007a770 con 0x7f29340b3b50 2024-03-16T17:48:24.508 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-03-16T17:48:24.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.506+0000 7f293b09a640 1 -- 172.21.15.132:0/2146121320 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f291806b3b0 msgr2=0x7f291806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.506+0000 7f293b09a640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f291806b3b0 0x7f291806d870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2928000f60 tx=0x7f2928009040 comp rx=0 tx=0).stop 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.506+0000 7f293b09a640 1 -- 172.21.15.132:0/2146121320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 msgr2=0x7f2934146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.506+0000 7f293b09a640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 0x7f2934146300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29200090b0 tx=0x7f2920004730 comp rx=0 tx=0).stop 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.506+0000 7f293b09a640 1 -- 172.21.15.132:0/2146121320 shutdown_connections 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.506+0000 7f293b09a640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f291806b3b0 0x7f291806d870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.506+0000 7f293b09a640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f293415e280 0x7f2934158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.506+0000 7f293b09a640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29340b3b50 0x7f2934146300 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.506+0000 7f293b09a640 1 --2- 172.21.15.132:0/2146121320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f293406aee0 0x7f2934145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.507+0000 7f293b09a640 1 -- 172.21.15.132:0/2146121320 >> 172.21.15.132:0/2146121320 conn(0x7f29340b2850 msgr2=0x7f293406fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.507+0000 7f293b09a640 1 -- 172.21.15.132:0/2146121320 shutdown_connections 2024-03-16T17:48:24.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.507+0000 7f293b09a640 1 -- 172.21.15.132:0/2146121320 wait complete. 2024-03-16T17:48:24.521 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-16T17:48:24.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:24.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-16T17:48:24.553 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2024-03-16T17:48:24.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:24.553 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-16T17:48:24.610 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:48:24.610 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:24.629 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:48:24.629 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:24.687 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-16T17:48:24.687 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:24.744 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:24.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.842+0000 7efe52b48640 1 Processor -- start 2024-03-16T17:48:24.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.842+0000 7efe52b48640 1 -- start start 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.843+0000 7efe52b48640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe4c0d1e00 0x7efe4c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.843+0000 7efe52b48640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efe4c0d1640 0x7efe4c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.843+0000 7efe52b48640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe4c0d21e0 0x7efe4c1583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe52b48640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c0d0040 con 0x7efe4c0d21e0 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe52b48640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c15f530 con 0x7efe4c0d1640 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe52b48640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c15e920 con 0x7efe4c0d1e00 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe510e5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe4c0d21e0 0x7efe4c1583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe510e5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe4c0d21e0 0x7efe4c1583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41504/0 (socket says 172.21.15.132:41504) 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe510e5640 1 -- 172.21.15.132:0/2601580951 learned_addr learned my addr 172.21.15.132:0/2601580951 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe4bfff640 1 --2- 172.21.15.132:0/2601580951 >> v2:172.21.15.194:3300/0 conn(0x7efe4c0d1640 0x7efe4c157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe508e4640 1 --2- 172.21.15.132:0/2601580951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe4c0d1e00 0x7efe4c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe510e5640 1 -- 172.21.15.132:0/2601580951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe4c0d1e00 msgr2=0x7efe4c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:24.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe510e5640 1 --2- 172.21.15.132:0/2601580951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe4c0d1e00 0x7efe4c0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe510e5640 1 -- 172.21.15.132:0/2601580951 >> v2:172.21.15.194:3300/0 conn(0x7efe4c0d1640 msgr2=0x7efe4c157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:24.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe510e5640 1 --2- 172.21.15.132:0/2601580951 >> v2:172.21.15.194:3300/0 conn(0x7efe4c0d1640 0x7efe4c157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe510e5640 1 -- 172.21.15.132:0/2601580951 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c15ec00 con 0x7efe4c0d21e0 2024-03-16T17:48:24.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.844+0000 7efe4bfff640 1 --2- 172.21.15.132:0/2601580951 >> v2:172.21.15.194:3300/0 conn(0x7efe4c0d1640 0x7efe4c157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:24.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.845+0000 7efe510e5640 1 --2- 172.21.15.132:0/2601580951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d21e0 0x7efe4c1583d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0729d0 tx=0x7efe4402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a2b21010290f1f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:24.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.845+0000 7efe4b7fe640 1 -- 172.21.15.132:0/2601580951 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4402ca70 con 0x7efe4c0d21e0 2024-03-16T17:48:24.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.845+0000 7efe4b7fe640 1 -- 172.21.15.132:0/2601580951 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4402cbd0 con 0x7efe4c0d21e0 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.845+0000 7efe4b7fe640 1 -- 172.21.15.132:0/2601580951 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe440343f0 con 0x7efe4c0d21e0 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.845+0000 7efe52b48640 1 -- 172.21.15.132:0/2601580951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d21e0 msgr2=0x7efe4c1583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.845+0000 7efe52b48640 1 --2- 172.21.15.132:0/2601580951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d21e0 0x7efe4c1583d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0729d0 tx=0x7efe4402bed0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.845+0000 7efe52b48640 1 -- 172.21.15.132:0/2601580951 shutdown_connections 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.845+0000 7efe52b48640 1 --2- 172.21.15.132:0/2601580951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d21e0 0x7efe4c1583d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.845+0000 7efe52b48640 1 --2- 172.21.15.132:0/2601580951 >> v2:172.21.15.194:3300/0 conn(0x7efe4c0d1640 0x7efe4c157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.845+0000 7efe52b48640 1 --2- 172.21.15.132:0/2601580951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe4c0d1e00 0x7efe4c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.846+0000 7efe52b48640 1 -- 172.21.15.132:0/2601580951 >> 172.21.15.132:0/2601580951 conn(0x7efe4c073220 msgr2=0x7efe4c09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.846+0000 7efe52b48640 1 -- 172.21.15.132:0/2601580951 shutdown_connections 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.846+0000 7efe52b48640 1 -- 172.21.15.132:0/2601580951 wait complete. 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.847+0000 7efe52b48640 1 Processor -- start 2024-03-16T17:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.847+0000 7efe52b48640 1 -- start start 2024-03-16T17:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.847+0000 7efe52b48640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe4c0d1640 0x7efe4c1f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.847+0000 7efe52b48640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d1e00 0x7efe4c1f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.847+0000 7efe52b48640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe4c0d21e0 0x7efe4c09f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe52b48640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c1f7d20 con 0x7efe4c0d1e00 2024-03-16T17:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe52b48640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c1f3dd0 con 0x7efe4c0d1640 2024-03-16T17:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe52b48640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c1f40b0 con 0x7efe4c0d21e0 2024-03-16T17:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe4bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d1e00 0x7efe4c1f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe4bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d1e00 0x7efe4c1f77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41518/0 (socket says 172.21.15.132:41518) 2024-03-16T17:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe4bfff640 1 -- 172.21.15.132:0/3070901597 learned_addr learned my addr 172.21.15.132:0/3070901597 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe508e4640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe4c0d1640 0x7efe4c1f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe4bfff640 1 -- 172.21.15.132:0/3070901597 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe4c0d21e0 msgr2=0x7efe4c09f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe4bfff640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe4c0d21e0 0x7efe4c09f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe4bfff640 1 -- 172.21.15.132:0/3070901597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe4c0d1640 msgr2=0x7efe4c1f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe4bfff640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe4c0d1640 0x7efe4c1f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe4bfff640 1 -- 172.21.15.132:0/3070901597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe44009b30 con 0x7efe4c0d1e00 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe4bfff640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d1e00 0x7efe4c1f77e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efe3800e810 tx=0x7efe3800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe497fa640 1 -- 172.21.15.132:0/3070901597 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38004030 con 0x7efe4c0d1e00 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe497fa640 1 -- 172.21.15.132:0/3070901597 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe38004190 con 0x7efe4c0d1e00 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe52b48640 1 -- 172.21.15.132:0/3070901597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4c1f4390 con 0x7efe4c0d1e00 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe497fa640 1 -- 172.21.15.132:0/3070901597 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38004520 con 0x7efe4c0d1e00 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.848+0000 7efe52b48640 1 -- 172.21.15.132:0/3070901597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c1f4950 con 0x7efe4c0d1e00 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.849+0000 7efe52b48640 1 -- 172.21.15.132:0/3070901597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4c074dc0 con 0x7efe4c0d1e00 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.850+0000 7efe497fa640 1 -- 172.21.15.132:0/3070901597 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7efe3800c6d0 con 0x7efe4c0d1e00 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.850+0000 7efe497fa640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7efe3006b3b0 0x7efe3006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:24.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.850+0000 7efe497fa640 1 -- 172.21.15.132:0/3070901597 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe38089810 con 0x7efe4c0d1e00 2024-03-16T17:48:24.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.850+0000 7efe508e4640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7efe3006b3b0 0x7efe3006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:24.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.851+0000 7efe508e4640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7efe3006b3b0 0x7efe3006d870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe40006fd0 tx=0x7efe40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:24.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:24.855+0000 7efe497fa640 1 -- 172.21.15.132:0/3070901597 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7efe38054470 con 0x7efe4c0d1e00 2024-03-16T17:48:25.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.028+0000 7efe52b48640 1 -- 172.21.15.132:0/3070901597 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe4c04f2c0 con 0x7efe4c0d1e00 2024-03-16T17:48:25.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.029+0000 7efe497fa640 1 -- 172.21.15.132:0/3070901597 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7efe38057b30 con 0x7efe4c0d1e00 2024-03-16T17:48:25.032 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:25.033 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:25.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 -- 172.21.15.132:0/3070901597 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7efe3006b3b0 msgr2=0x7efe3006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7efe3006b3b0 0x7efe3006d870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe40006fd0 tx=0x7efe40008040 comp rx=0 tx=0).stop 2024-03-16T17:48:25.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 -- 172.21.15.132:0/3070901597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d1e00 msgr2=0x7efe4c1f77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d1e00 0x7efe4c1f77e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efe3800e810 tx=0x7efe3800ecd0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 -- 172.21.15.132:0/3070901597 shutdown_connections 2024-03-16T17:48:25.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7efe3006b3b0 0x7efe3006d870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe4c0d21e0 0x7efe4c09f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe4c0d1e00 0x7efe4c1f77e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 --2- 172.21.15.132:0/3070901597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe4c0d1640 0x7efe4c1f37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 -- 172.21.15.132:0/3070901597 >> 172.21.15.132:0/3070901597 conn(0x7efe4c073220 msgr2=0x7efe4c0b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:25.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 -- 172.21.15.132:0/3070901597 shutdown_connections 2024-03-16T17:48:25.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.031+0000 7efe52b48640 1 -- 172.21.15.132:0/3070901597 wait complete. 2024-03-16T17:48:25.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:25.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:25.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.147+0000 7f323e0fa640 1 Processor -- start 2024-03-16T17:48:25.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.147+0000 7f323e0fa640 1 -- start start 2024-03-16T17:48:25.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.147+0000 7f323e0fa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3238072a40 0x7f32380b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.147+0000 7f323e0fa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32380b30f0 con 0x7f323806dba0 2024-03-16T17:48:25.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.147+0000 7f323e0fa640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323815aa80 con 0x7f3238154b80 2024-03-16T17:48:25.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.147+0000 7f323e0fa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323815b700 con 0x7f3238072a40 2024-03-16T17:48:25.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.148+0000 7f3237fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3238072a40 0x7f32380b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.148+0000 7f322ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f323806dba0 0x7f3238070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32968/0 (socket says 172.21.15.132:32968) 2024-03-16T17:48:25.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.148+0000 7f322ffff640 1 -- 172.21.15.132:0/2177223360 learned_addr learned my addr 172.21.15.132:0/2177223360 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:25.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.148+0000 7f3237fff640 1 -- 172.21.15.132:0/2177223360 >> v1:172.21.15.194:6789/0 conn(0x7f3238154b80 legacy=0x7f323806d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.148+0000 7f3237fff640 1 -- 172.21.15.132:0/2177223360 >> v1:172.21.15.132:6789/0 conn(0x7f323806dba0 legacy=0x7f3238070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.148+0000 7f3237fff640 1 -- 172.21.15.132:0/2177223360 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323815ad60 con 0x7f3238072a40 2024-03-16T17:48:25.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.148+0000 7f3236ffd640 1 -- 172.21.15.132:0/2177223360 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161096367 0 0) 0x7f3220001110 con 0x7f323806dba0 2024-03-16T17:48:25.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f3237fff640 1 --2- 172.21.15.132:0/2177223360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 0x7f32380b2bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f323000aea0 tx=0x7f323002d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da6db2df466528d server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:25.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f3236ffd640 1 -- 172.21.15.132:0/2177223360 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323002dbf0 con 0x7f3238072a40 2024-03-16T17:48:25.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f3236ffd640 1 -- 172.21.15.132:0/2177223360 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323002dd50 con 0x7f3238072a40 2024-03-16T17:48:25.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f3236ffd640 1 -- 172.21.15.132:0/2177223360 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230008660 con 0x7f3238072a40 2024-03-16T17:48:25.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f323e0fa640 1 -- 172.21.15.132:0/2177223360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 msgr2=0x7f32380b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f323e0fa640 1 --2- 172.21.15.132:0/2177223360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 0x7f32380b2bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f323000aea0 tx=0x7f323002d050 comp rx=0 tx=0).stop 2024-03-16T17:48:25.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f323e0fa640 1 -- 172.21.15.132:0/2177223360 shutdown_connections 2024-03-16T17:48:25.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f323e0fa640 1 --2- 172.21.15.132:0/2177223360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 0x7f32380b2bb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f323e0fa640 1 -- 172.21.15.132:0/2177223360 >> 172.21.15.132:0/2177223360 conn(0x7f323806aee0 msgr2=0x7f323806b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:25.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f323e0fa640 1 -- 172.21.15.132:0/2177223360 shutdown_connections 2024-03-16T17:48:25.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.149+0000 7f323e0fa640 1 -- 172.21.15.132:0/2177223360 wait complete. 2024-03-16T17:48:25.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.150+0000 7f323e0fa640 1 Processor -- start 2024-03-16T17:48:25.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f323e0fa640 1 -- start start 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f323e0fa640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f323806dba0 0x7f323814bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f323e0fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 0x7f32381524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f323e0fa640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3238154b80 0x7f3238152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f323e0fa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3238148850 con 0x7f3238072a40 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f323e0fa640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323814c2a0 con 0x7f323806dba0 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f323e0fa640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32380b0170 con 0x7f3238154b80 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f322ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 0x7f32381524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f322ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 0x7f32381524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41538/0 (socket says 172.21.15.132:41538) 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f322ffff640 1 -- 172.21.15.132:0/2339195935 learned_addr learned my addr 172.21.15.132:0/2339195935 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f32377fe640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f323806dba0 0x7f323814bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.151+0000 7f3237fff640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3238154b80 0x7f3238152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f322ffff640 1 -- 172.21.15.132:0/2339195935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3238154b80 msgr2=0x7f3238152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f322ffff640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3238154b80 0x7f3238152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f322ffff640 1 -- 172.21.15.132:0/2339195935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f323806dba0 msgr2=0x7f323814bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f322ffff640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f323806dba0 0x7f323814bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f322ffff640 1 -- 172.21.15.132:0/2339195935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323000ab80 con 0x7f3238072a40 2024-03-16T17:48:25.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f322ffff640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 0x7f32381524c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f322000c780 tx=0x7f322000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:25.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f3234ff9640 1 -- 172.21.15.132:0/2339195935 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32200072d0 con 0x7f3238072a40 2024-03-16T17:48:25.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f3234ff9640 1 -- 172.21.15.132:0/2339195935 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3220007450 con 0x7f3238072a40 2024-03-16T17:48:25.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f323e0fa640 1 -- 172.21.15.132:0/2339195935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32380b0450 con 0x7f3238072a40 2024-03-16T17:48:25.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f3234ff9640 1 -- 172.21.15.132:0/2339195935 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220001d10 con 0x7f3238072a40 2024-03-16T17:48:25.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.152+0000 7f323e0fa640 1 -- 172.21.15.132:0/2339195935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32380b0a10 con 0x7f3238072a40 2024-03-16T17:48:25.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.153+0000 7f323e0fa640 1 -- 172.21.15.132:0/2339195935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32380b0c30 con 0x7f3238072a40 2024-03-16T17:48:25.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.153+0000 7f3234ff9640 1 -- 172.21.15.132:0/2339195935 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f32200047e0 con 0x7f3238072a40 2024-03-16T17:48:25.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.154+0000 7f3234ff9640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f321806b3b0 0x7f321806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.154+0000 7f3234ff9640 1 -- 172.21.15.132:0/2339195935 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3220088ea0 con 0x7f3238072a40 2024-03-16T17:48:25.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.154+0000 7f32377fe640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f321806b3b0 0x7f321806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.154+0000 7f32377fe640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f321806b3b0 0x7f321806d870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3228000f60 tx=0x7f3228009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:25.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.158+0000 7f3234ff9640 1 -- 172.21.15.132:0/2339195935 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3220053bb0 con 0x7f3238072a40 2024-03-16T17:48:25.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.336+0000 7f323e0fa640 1 -- 172.21.15.132:0/2339195935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32380b30f0 con 0x7f3238072a40 2024-03-16T17:48:25.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.336+0000 7f3234ff9640 1 -- 172.21.15.132:0/2339195935 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32380b30f0 con 0x7f3238072a40 2024-03-16T17:48:25.340 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:25.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 -- 172.21.15.132:0/2339195935 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f321806b3b0 msgr2=0x7f321806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f321806b3b0 0x7f321806d870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3228000f60 tx=0x7f3228009040 comp rx=0 tx=0).stop 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 -- 172.21.15.132:0/2339195935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 msgr2=0x7f32381524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 0x7f32381524c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f322000c780 tx=0x7f322000cc40 comp rx=0 tx=0).stop 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 -- 172.21.15.132:0/2339195935 shutdown_connections 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f321806b3b0 0x7f321806d870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3238154b80 0x7f3238152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3238072a40 0x7f32381524c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 --2- 172.21.15.132:0/2339195935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f323806dba0 0x7f323814bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 -- 172.21.15.132:0/2339195935 >> 172.21.15.132:0/2339195935 conn(0x7f323806aee0 msgr2=0x7f32380b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 -- 172.21.15.132:0/2339195935 shutdown_connections 2024-03-16T17:48:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.338+0000 7f323e0fa640 1 -- 172.21.15.132:0/2339195935 wait complete. 2024-03-16T17:48:25.356 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:25.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.456+0000 7f1923cfb640 1 Processor -- start 2024-03-16T17:48:25.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.456+0000 7f1923cfb640 1 -- start start 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1923cfb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f191c0cfb70 0x7f191c0d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1923cfb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f191c0d2350 0x7f191c06bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1923cfb640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191c0d1980 con 0x7f191c0b1040 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1923cfb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191c0cfff0 con 0x7f191c0d2350 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1923cfb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0b2f90 con 0x7f191c0cfb70 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1922298640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f191c0d2350 0x7f191c06bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1922298640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f191c0d2350 0x7f191c06bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41540/0 (socket says 172.21.15.132:41540) 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1922298640 1 -- 172.21.15.132:0/3697220888 learned_addr learned my addr 172.21.15.132:0/3697220888 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1921296640 1 --2- 172.21.15.132:0/3697220888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f191c0cfb70 0x7f191c0d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1922298640 1 -- 172.21.15.132:0/3697220888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f191c0cfb70 msgr2=0x7f191c0d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:25.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1922298640 1 --2- 172.21.15.132:0/3697220888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f191c0cfb70 0x7f191c0d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1922298640 1 -- 172.21.15.132:0/3697220888 >> v1:172.21.15.194:6789/0 conn(0x7f191c0b1040 legacy=0x7f191c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.457+0000 7f1922298640 1 -- 172.21.15.132:0/3697220888 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c0b3270 con 0x7f191c0d2350 2024-03-16T17:48:25.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.458+0000 7f1922298640 1 --2- 172.21.15.132:0/3697220888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0d2350 0x7f191c06bff0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1914009e50 tx=0x7f191402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d4079ad7309b14 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:25.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.458+0000 7f1920a95640 1 -- 172.21.15.132:0/3697220888 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191402cb00 con 0x7f191c0d2350 2024-03-16T17:48:25.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.458+0000 7f1920a95640 1 -- 172.21.15.132:0/3697220888 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191402cc60 con 0x7f191c0d2350 2024-03-16T17:48:25.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.458+0000 7f1920a95640 1 -- 172.21.15.132:0/3697220888 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140343f0 con 0x7f191c0d2350 2024-03-16T17:48:25.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.458+0000 7f1923cfb640 1 -- 172.21.15.132:0/3697220888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0d2350 msgr2=0x7f191c06bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.458+0000 7f1923cfb640 1 --2- 172.21.15.132:0/3697220888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0d2350 0x7f191c06bff0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1914009e50 tx=0x7f191402bf60 comp rx=0 tx=0).stop 2024-03-16T17:48:25.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.459+0000 7f1923cfb640 1 -- 172.21.15.132:0/3697220888 shutdown_connections 2024-03-16T17:48:25.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.459+0000 7f1923cfb640 1 --2- 172.21.15.132:0/3697220888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0d2350 0x7f191c06bff0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.459+0000 7f1923cfb640 1 --2- 172.21.15.132:0/3697220888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f191c0cfb70 0x7f191c0d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.459+0000 7f1923cfb640 1 -- 172.21.15.132:0/3697220888 >> 172.21.15.132:0/3697220888 conn(0x7f191c073220 msgr2=0x7f191c09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:25.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.459+0000 7f1923cfb640 1 -- 172.21.15.132:0/3697220888 shutdown_connections 2024-03-16T17:48:25.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.459+0000 7f1923cfb640 1 -- 172.21.15.132:0/3697220888 wait complete. 2024-03-16T17:48:25.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.460+0000 7f1923cfb640 1 Processor -- start 2024-03-16T17:48:25.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.460+0000 7f1923cfb640 1 -- start start 2024-03-16T17:48:25.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.460+0000 7f1923cfb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f191c0b1040 0x7f191c09bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.460+0000 7f1923cfb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0cfb70 0x7f191c15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.460+0000 7f1923cfb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f191c1f3310 0x7f191c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.460+0000 7f1923cfb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c15e660 con 0x7f191c0cfb70 2024-03-16T17:48:25.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.460+0000 7f1923cfb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c1f37a0 con 0x7f191c1f3310 2024-03-16T17:48:25.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.460+0000 7f1923cfb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c09edb0 con 0x7f191c0b1040 2024-03-16T17:48:25.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1921296640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0cfb70 0x7f191c15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1921296640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0cfb70 0x7f191c15fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41554/0 (socket says 172.21.15.132:41554) 2024-03-16T17:48:25.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1921296640 1 -- 172.21.15.132:0/3459206494 learned_addr learned my addr 172.21.15.132:0/3459206494 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1922298640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f191c1f3310 0x7f191c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1921a97640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f191c0b1040 0x7f191c09bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1921296640 1 -- 172.21.15.132:0/3459206494 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f191c0b1040 msgr2=0x7f191c09bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1921296640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f191c0b1040 0x7f191c09bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1921296640 1 -- 172.21.15.132:0/3459206494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f191c1f3310 msgr2=0x7f191c09e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1921296640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f191c1f3310 0x7f191c09e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1921296640 1 -- 172.21.15.132:0/3459206494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914009b30 con 0x7f191c0cfb70 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1921296640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0cfb70 0x7f191c15fbb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f190c00d830 tx=0x7f190c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f19127fc640 1 -- 172.21.15.132:0/3459206494 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00b6c0 con 0x7f191c0cfb70 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f19127fc640 1 -- 172.21.15.132:0/3459206494 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c00b840 con 0x7f191c0cfb70 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f19127fc640 1 -- 172.21.15.132:0/3459206494 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c00bbf0 con 0x7f191c0cfb70 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1923cfb640 1 -- 172.21.15.132:0/3459206494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191c09f050 con 0x7f191c0cfb70 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.461+0000 7f1923cfb640 1 -- 172.21.15.132:0/3459206494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191c09f610 con 0x7f191c0cfb70 2024-03-16T17:48:25.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.462+0000 7f1923cfb640 1 -- 172.21.15.132:0/3459206494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191c15e810 con 0x7f191c0cfb70 2024-03-16T17:48:25.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.463+0000 7f19127fc640 1 -- 172.21.15.132:0/3459206494 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f190c01e460 con 0x7f191c0cfb70 2024-03-16T17:48:25.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.463+0000 7f19127fc640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f190006b3e0 0x7f190006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.463+0000 7f19127fc640 1 -- 172.21.15.132:0/3459206494 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f190c08a360 con 0x7f191c0cfb70 2024-03-16T17:48:25.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.463+0000 7f1921a97640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f190006b3e0 0x7f190006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.464+0000 7f1921a97640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f190006b3e0 0x7f190006d8a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1918001640 tx=0x7f1918009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.471+0000 7f19127fc640 1 -- 172.21.15.132:0/3459206494 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f191c15e810 con 0x7f191c0cfb70 2024-03-16T17:48:25.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.648+0000 7f1923cfb640 1 -- 172.21.15.132:0/3459206494 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f191c15e810 con 0x7f191c0cfb70 2024-03-16T17:48:25.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.648+0000 7f19127fc640 1 -- 172.21.15.132:0/3459206494 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f191c15e810 con 0x7f191c0cfb70 2024-03-16T17:48:25.652 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:25.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.650+0000 7f1923cfb640 1 -- 172.21.15.132:0/3459206494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f190006b3e0 msgr2=0x7f190006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.650+0000 7f1923cfb640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f190006b3e0 0x7f190006d8a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1918001640 tx=0x7f1918009040 comp rx=0 tx=0).stop 2024-03-16T17:48:25.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.650+0000 7f1923cfb640 1 -- 172.21.15.132:0/3459206494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0cfb70 msgr2=0x7f191c15fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.650+0000 7f1923cfb640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0cfb70 0x7f191c15fbb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f190c00d830 tx=0x7f190c00dcf0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.650+0000 7f1923cfb640 1 -- 172.21.15.132:0/3459206494 shutdown_connections 2024-03-16T17:48:25.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.650+0000 7f1923cfb640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f190006b3e0 0x7f190006d8a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.650+0000 7f1923cfb640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f191c1f3310 0x7f191c09e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.650+0000 7f1923cfb640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f191c0cfb70 0x7f191c15fbb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.651+0000 7f1923cfb640 1 --2- 172.21.15.132:0/3459206494 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f191c0b1040 0x7f191c09bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.651+0000 7f1923cfb640 1 -- 172.21.15.132:0/3459206494 >> 172.21.15.132:0/3459206494 conn(0x7f191c073220 msgr2=0x7f191c070550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:25.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.651+0000 7f1923cfb640 1 -- 172.21.15.132:0/3459206494 shutdown_connections 2024-03-16T17:48:25.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.651+0000 7f1923cfb640 1 -- 172.21.15.132:0/3459206494 wait complete. 2024-03-16T17:48:25.665 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:25.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.768+0000 7fd7523e2640 1 Processor -- start 2024-03-16T17:48:25.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.768+0000 7fd7523e2640 1 -- start start 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd7523e2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd74c15eee0 0x7fd74c0b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd7523e2640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd74c0b3f90 0x7fd74c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd7523e2640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74c15f370 con 0x7fd74c15ba80 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd7523e2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74c15be60 con 0x7fd74c15eee0 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd7523e2640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74c0b4390 con 0x7fd74c0b3f90 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd74b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd74c15eee0 0x7fd74c0b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd74b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd74c15eee0 0x7fd74c0b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41562/0 (socket says 172.21.15.132:41562) 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd74b7fe640 1 -- 172.21.15.132:0/3776843905 learned_addr learned my addr 172.21.15.132:0/3776843905 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd74b7fe640 1 -- 172.21.15.132:0/3776843905 >> v2:172.21.15.194:3300/0 conn(0x7fd74c0b3f90 msgr2=0x7fd74c06ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd75097f640 1 --2- 172.21.15.132:0/3776843905 >> v2:172.21.15.194:3300/0 conn(0x7fd74c0b3f90 0x7fd74c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd74b7fe640 1 --2- 172.21.15.132:0/3776843905 >> v2:172.21.15.194:3300/0 conn(0x7fd74c0b3f90 0x7fd74c06ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd74b7fe640 1 -- 172.21.15.132:0/3776843905 >> v1:172.21.15.194:6789/0 conn(0x7fd74c15ba80 legacy=0x7fd74c161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:25.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.769+0000 7fd74b7fe640 1 -- 172.21.15.132:0/3776843905 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c162460 con 0x7fd74c15eee0 2024-03-16T17:48:25.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.770+0000 7fd74b7fe640 1 --2- 172.21.15.132:0/3776843905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15eee0 0x7fd74c0b3a50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0afd40 tx=0x7fd74002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae56206ef780ed1a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:25.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.770+0000 7fd74affd640 1 -- 172.21.15.132:0/3776843905 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7400317e0 con 0x7fd74c15eee0 2024-03-16T17:48:25.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.770+0000 7fd74affd640 1 -- 172.21.15.132:0/3776843905 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd740031940 con 0x7fd74c15eee0 2024-03-16T17:48:25.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.770+0000 7fd74affd640 1 -- 172.21.15.132:0/3776843905 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740031cd0 con 0x7fd74c15eee0 2024-03-16T17:48:25.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.771+0000 7fd7523e2640 1 -- 172.21.15.132:0/3776843905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15eee0 msgr2=0x7fd74c0b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.771+0000 7fd7523e2640 1 --2- 172.21.15.132:0/3776843905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15eee0 0x7fd74c0b3a50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0afd40 tx=0x7fd74002b880 comp rx=0 tx=0).stop 2024-03-16T17:48:25.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.771+0000 7fd7523e2640 1 -- 172.21.15.132:0/3776843905 shutdown_connections 2024-03-16T17:48:25.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.771+0000 7fd7523e2640 1 --2- 172.21.15.132:0/3776843905 >> v2:172.21.15.194:3300/0 conn(0x7fd74c0b3f90 0x7fd74c06ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.771+0000 7fd7523e2640 1 --2- 172.21.15.132:0/3776843905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15eee0 0x7fd74c0b3a50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.771+0000 7fd7523e2640 1 -- 172.21.15.132:0/3776843905 >> 172.21.15.132:0/3776843905 conn(0x7fd74c06bff0 msgr2=0x7fd74c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:25.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.771+0000 7fd7523e2640 1 -- 172.21.15.132:0/3776843905 shutdown_connections 2024-03-16T17:48:25.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.771+0000 7fd7523e2640 1 -- 172.21.15.132:0/3776843905 wait complete. 2024-03-16T17:48:25.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.772+0000 7fd7523e2640 1 Processor -- start 2024-03-16T17:48:25.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.772+0000 7fd7523e2640 1 -- start start 2024-03-16T17:48:25.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.773+0000 7fd7523e2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74c0b3f90 0x7fd74c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.773+0000 7fd7523e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15ba80 0x7fd74c140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.773+0000 7fd7523e2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd74c15eee0 0x7fd74c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.773+0000 7fd7523e2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c1523d0 con 0x7fd74c15ba80 2024-03-16T17:48:25.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.773+0000 7fd7523e2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c140a40 con 0x7fd74c15eee0 2024-03-16T17:48:25.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.773+0000 7fd7523e2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c15a750 con 0x7fd74c0b3f90 2024-03-16T17:48:25.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.773+0000 7fd74b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15ba80 0x7fd74c140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.773+0000 7fd74b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15ba80 0x7fd74c140500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41576/0 (socket says 172.21.15.132:41576) 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.773+0000 7fd74b7fe640 1 -- 172.21.15.132:0/2705898633 learned_addr learned my addr 172.21.15.132:0/2705898633 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd75097f640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd74c15eee0 0x7fd74c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd74bfff640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74c0b3f90 0x7fd74c15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd74b7fe640 1 -- 172.21.15.132:0/2705898633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74c0b3f90 msgr2=0x7fd74c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd74b7fe640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74c0b3f90 0x7fd74c15a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd74b7fe640 1 -- 172.21.15.132:0/2705898633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd74c15eee0 msgr2=0x7fd74c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd74b7fe640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd74c15eee0 0x7fd74c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd74b7fe640 1 -- 172.21.15.132:0/2705898633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7400094d0 con 0x7fd74c15ba80 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd74b7fe640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15ba80 0x7fd74c140500 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd74002b8c0 tx=0x7fd7400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd748ff9640 1 -- 172.21.15.132:0/2705898633 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7400329c0 con 0x7fd74c15ba80 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd748ff9640 1 -- 172.21.15.132:0/2705898633 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd740032b40 con 0x7fd74c15ba80 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd7523e2640 1 -- 172.21.15.132:0/2705898633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74c15aa30 con 0x7fd74c15ba80 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd748ff9640 1 -- 172.21.15.132:0/2705898633 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7400453f0 con 0x7fd74c15ba80 2024-03-16T17:48:25.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.774+0000 7fd7523e2640 1 -- 172.21.15.132:0/2705898633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74c1528e0 con 0x7fd74c15ba80 2024-03-16T17:48:25.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.775+0000 7fd7523e2640 1 -- 172.21.15.132:0/2705898633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74c0734e0 con 0x7fd74c15ba80 2024-03-16T17:48:25.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.776+0000 7fd748ff9640 1 -- 172.21.15.132:0/2705898633 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fd74004d3f0 con 0x7fd74c15ba80 2024-03-16T17:48:25.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.776+0000 7fd748ff9640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd73806b3b0 0x7fd73806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:25.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.776+0000 7fd74bfff640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd73806b3b0 0x7fd73806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:25.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.776+0000 7fd748ff9640 1 -- 172.21.15.132:0/2705898633 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7400abb30 con 0x7fd74c15ba80 2024-03-16T17:48:25.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.777+0000 7fd74bfff640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd73806b3b0 0x7fd73806d870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd73c006fd0 tx=0x7fd73c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:25.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.780+0000 7fd748ff9640 1 -- 172.21.15.132:0/2705898633 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd740076830 con 0x7fd74c15ba80 2024-03-16T17:48:25.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.958+0000 7fd7523e2640 1 -- 172.21.15.132:0/2705898633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd74c04f330 con 0x7fd74c15ba80 2024-03-16T17:48:25.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.958+0000 7fd748ff9640 1 -- 172.21.15.132:0/2705898633 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd740079ef0 con 0x7fd74c15ba80 2024-03-16T17:48:25.962 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:25.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.960+0000 7fd7523e2640 1 -- 172.21.15.132:0/2705898633 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd73806b3b0 msgr2=0x7fd73806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.960+0000 7fd7523e2640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd73806b3b0 0x7fd73806d870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd73c006fd0 tx=0x7fd73c008040 comp rx=0 tx=0).stop 2024-03-16T17:48:25.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.960+0000 7fd7523e2640 1 -- 172.21.15.132:0/2705898633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15ba80 msgr2=0x7fd74c140500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:25.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.960+0000 7fd7523e2640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15ba80 0x7fd74c140500 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd74002b8c0 tx=0x7fd7400046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.960+0000 7fd7523e2640 1 -- 172.21.15.132:0/2705898633 shutdown_connections 2024-03-16T17:48:25.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.960+0000 7fd7523e2640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd73806b3b0 0x7fd73806d870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.960+0000 7fd7523e2640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd74c15eee0 0x7fd74c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.960+0000 7fd7523e2640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd74c15ba80 0x7fd74c140500 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.960+0000 7fd7523e2640 1 --2- 172.21.15.132:0/2705898633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74c0b3f90 0x7fd74c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:25.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.960+0000 7fd7523e2640 1 -- 172.21.15.132:0/2705898633 >> 172.21.15.132:0/2705898633 conn(0x7fd74c06bff0 msgr2=0x7fd74c0afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:25.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.961+0000 7fd7523e2640 1 -- 172.21.15.132:0/2705898633 shutdown_connections 2024-03-16T17:48:25.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:25.961+0000 7fd7523e2640 1 -- 172.21.15.132:0/2705898633 wait complete. 2024-03-16T17:48:25.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-16T17:48:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.074+0000 7f48fd691640 1 Processor -- start 2024-03-16T17:48:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.074+0000 7f48fd691640 1 -- start start 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48fd691640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f48f80ceb90 0x7f48f80cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48fd691640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48f80d0190 0x7f48f80d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48fd691640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f80c7470 con 0x7f48f815bf90 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48fd691640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f80c7140 con 0x7f48f80d0190 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48fd691640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f80ce050 con 0x7f48f80ceb90 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48f77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48f80d0190 0x7f48f80d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48f77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48f80d0190 0x7f48f80d0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41582/0 (socket says 172.21.15.132:41582) 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48f77fe640 1 -- 172.21.15.132:0/3662759261 learned_addr learned my addr 172.21.15.132:0/3662759261 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48f67fc640 1 --2- 172.21.15.132:0/3662759261 >> v2:172.21.15.194:3300/0 conn(0x7f48f80ceb90 0x7f48f80cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48f77fe640 1 -- 172.21.15.132:0/3662759261 >> v2:172.21.15.194:3300/0 conn(0x7f48f80ceb90 msgr2=0x7f48f80cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:26.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48f77fe640 1 --2- 172.21.15.132:0/3662759261 >> v2:172.21.15.194:3300/0 conn(0x7f48f80ceb90 0x7f48f80cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48f77fe640 1 -- 172.21.15.132:0/3662759261 >> v1:172.21.15.194:6789/0 conn(0x7f48f815bf90 legacy=0x7f48f80ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:26.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.075+0000 7f48f77fe640 1 -- 172.21.15.132:0/3662759261 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f80c7c80 con 0x7f48f80d0190 2024-03-16T17:48:26.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.076+0000 7f48f77fe640 1 --2- 172.21.15.132:0/3662759261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80d0190 0x7f48f80d0600 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f48f8072270 tx=0x7f48e802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119f93c140bd0e2a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:26.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.076+0000 7f48f5ffb640 1 -- 172.21.15.132:0/3662759261 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e80317e0 con 0x7f48f80d0190 2024-03-16T17:48:26.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.076+0000 7f48f5ffb640 1 -- 172.21.15.132:0/3662759261 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e8031940 con 0x7f48f80d0190 2024-03-16T17:48:26.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.076+0000 7f48f5ffb640 1 -- 172.21.15.132:0/3662759261 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8031cd0 con 0x7f48f80d0190 2024-03-16T17:48:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.077+0000 7f48fd691640 1 -- 172.21.15.132:0/3662759261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80d0190 msgr2=0x7f48f80d0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.077+0000 7f48fd691640 1 --2- 172.21.15.132:0/3662759261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80d0190 0x7f48f80d0600 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f48f8072270 tx=0x7f48e802b880 comp rx=0 tx=0).stop 2024-03-16T17:48:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.077+0000 7f48fd691640 1 -- 172.21.15.132:0/3662759261 shutdown_connections 2024-03-16T17:48:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.077+0000 7f48fd691640 1 --2- 172.21.15.132:0/3662759261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80d0190 0x7f48f80d0600 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.077+0000 7f48fd691640 1 --2- 172.21.15.132:0/3662759261 >> v2:172.21.15.194:3300/0 conn(0x7f48f80ceb90 0x7f48f80cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.077+0000 7f48fd691640 1 -- 172.21.15.132:0/3662759261 >> 172.21.15.132:0/3662759261 conn(0x7f48f80b3810 msgr2=0x7f48f80b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.077+0000 7f48fd691640 1 -- 172.21.15.132:0/3662759261 shutdown_connections 2024-03-16T17:48:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.077+0000 7f48fd691640 1 -- 172.21.15.132:0/3662759261 wait complete. 2024-03-16T17:48:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.078+0000 7f48fd691640 1 Processor -- start 2024-03-16T17:48:26.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.078+0000 7f48fd691640 1 -- start start 2024-03-16T17:48:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48fd691640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80ceb90 0x7f48f8145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48fd691640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48f80d0190 0x7f48f80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48fd691640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48f815bf90 0x7f48f80b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48fd691640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8145a60 con 0x7f48f80ceb90 2024-03-16T17:48:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48fd691640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80af2d0 con 0x7f48f815bf90 2024-03-16T17:48:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48fd691640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80af5b0 con 0x7f48f80d0190 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80ceb90 0x7f48f8145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80ceb90 0x7f48f8145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41584/0 (socket says 172.21.15.132:41584) 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f6ffd640 1 -- 172.21.15.132:0/990282274 learned_addr learned my addr 172.21.15.132:0/990282274 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f77fe640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48f815bf90 0x7f48f80b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f67fc640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48f80d0190 0x7f48f80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f6ffd640 1 -- 172.21.15.132:0/990282274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48f80d0190 msgr2=0x7f48f80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f6ffd640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48f80d0190 0x7f48f80aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f6ffd640 1 -- 172.21.15.132:0/990282274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48f815bf90 msgr2=0x7f48f80b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f6ffd640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48f815bf90 0x7f48f80b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f6ffd640 1 -- 172.21.15.132:0/990282274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e80094d0 con 0x7f48f80ceb90 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f67fc640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48f80d0190 0x7f48f80aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.079+0000 7f48f6ffd640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80ceb90 0x7f48f8145520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c7c0 tx=0x7f48f000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.080+0000 7f48ef7fe640 1 -- 172.21.15.132:0/990282274 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f000aa50 con 0x7f48f80ceb90 2024-03-16T17:48:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.080+0000 7f48ef7fe640 1 -- 172.21.15.132:0/990282274 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f000abb0 con 0x7f48f80ceb90 2024-03-16T17:48:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.080+0000 7f48fd691640 1 -- 172.21.15.132:0/990282274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f80af890 con 0x7f48f80ceb90 2024-03-16T17:48:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.080+0000 7f48ef7fe640 1 -- 172.21.15.132:0/990282274 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0012420 con 0x7f48f80ceb90 2024-03-16T17:48:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.080+0000 7f48fd691640 1 -- 172.21.15.132:0/990282274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f80afe50 con 0x7f48f80ceb90 2024-03-16T17:48:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.081+0000 7f48fd691640 1 -- 172.21.15.132:0/990282274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f80b0070 con 0x7f48f80ceb90 2024-03-16T17:48:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.081+0000 7f48ef7fe640 1 -- 172.21.15.132:0/990282274 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f48f0012580 con 0x7f48f80ceb90 2024-03-16T17:48:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.082+0000 7f48ef7fe640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f48d806b3b0 0x7f48d806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.082+0000 7f48ef7fe640 1 -- 172.21.15.132:0/990282274 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48f0089f50 con 0x7f48f80ceb90 2024-03-16T17:48:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.082+0000 7f48f67fc640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f48d806b3b0 0x7f48d806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.082+0000 7f48f67fc640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f48d806b3b0 0x7f48d806d870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f48f8159e50 tx=0x7f48e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:26.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.086+0000 7f48ef7fe640 1 -- 172.21.15.132:0/990282274 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f48f0054b20 con 0x7f48f80ceb90 2024-03-16T17:48:26.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.276+0000 7f48fd691640 1 -- 172.21.15.132:0/990282274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f48f809fe00 con 0x7f48f80ceb90 2024-03-16T17:48:26.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.276+0000 7f48ef7fe640 1 -- 172.21.15.132:0/990282274 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f48f0016020 con 0x7f48f80ceb90 2024-03-16T17:48:26.281 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-03-16T17:48:26.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.278+0000 7f48fd691640 1 -- 172.21.15.132:0/990282274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f48d806b3b0 msgr2=0x7f48d806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.278+0000 7f48fd691640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f48d806b3b0 0x7f48d806d870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f48f8159e50 tx=0x7f48e0008040 comp rx=0 tx=0).stop 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.278+0000 7f48fd691640 1 -- 172.21.15.132:0/990282274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80ceb90 msgr2=0x7f48f8145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.278+0000 7f48fd691640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80ceb90 0x7f48f8145520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f48f000c7c0 tx=0x7f48f000cc80 comp rx=0 tx=0).stop 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.278+0000 7f48fd691640 1 -- 172.21.15.132:0/990282274 shutdown_connections 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.278+0000 7f48fd691640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f48d806b3b0 0x7f48d806d870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.278+0000 7f48fd691640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48f815bf90 0x7f48f80b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.278+0000 7f48fd691640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48f80d0190 0x7f48f80aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.278+0000 7f48fd691640 1 --2- 172.21.15.132:0/990282274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f80ceb90 0x7f48f8145520 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.278+0000 7f48fd691640 1 -- 172.21.15.132:0/990282274 >> 172.21.15.132:0/990282274 conn(0x7f48f80b3810 msgr2=0x7f48f815a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.279+0000 7f48fd691640 1 -- 172.21.15.132:0/990282274 shutdown_connections 2024-03-16T17:48:26.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.279+0000 7f48fd691640 1 -- 172.21.15.132:0/990282274 wait complete. 2024-03-16T17:48:26.293 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-16T17:48:26.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:26.294 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-16T17:48:26.329 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-03-16T17:48:26.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:26.329 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-16T17:48:26.388 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-16T17:48:26.388 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:48:26.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.485+0000 7f034fe35640 1 Processor -- start 2024-03-16T17:48:26.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.485+0000 7f034fe35640 1 -- start start 2024-03-16T17:48:26.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034fe35640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f03480b3560 0x7f03480cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034fe35640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03480d1980 0x7f03480d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034fe35640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480d0680 con 0x7f0348161540 2024-03-16T17:48:26.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034fe35640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03480b4f30 con 0x7f03480b3560 2024-03-16T17:48:26.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034fe35640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03480d08d0 con 0x7f03480d1980 2024-03-16T17:48:26.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034dbd1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0348161540 0x7f03480cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35430/0 (socket says 172.21.15.132:35430) 2024-03-16T17:48:26.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034dbd1640 1 -- 172.21.15.132:0/3090716526 learned_addr learned my addr 172.21.15.132:0/3090716526 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:26.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034d3d0640 1 --2- 172.21.15.132:0/3090716526 >> v2:172.21.15.194:3300/0 conn(0x7f03480b3560 0x7f03480cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396805391 0 0) 0x7f03480d0680 con 0x7f0348161540 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034e3d2640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03480d1980 0x7f03480d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0334003520 con 0x7f0348161540 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 286702821 0 0) 0x7f0334003520 con 0x7f0348161540 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03480d1980 msgr2=0x7f03480d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03480d1980 0x7f03480d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 >> v2:172.21.15.194:3300/0 conn(0x7f03480b3560 msgr2=0x7f03480cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 --2- 172.21.15.132:0/3090716526 >> v2:172.21.15.194:3300/0 conn(0x7f03480b3560 0x7f03480cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480d0bb0 con 0x7f0348161540 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f0344001670 con 0x7f0348161540 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 >> v1:172.21.15.132:6789/0 conn(0x7f0348161540 legacy=0x7f03480cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03480d1980 0x7f0334003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0334003ef0 0x7f03340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0334004d00 0x7f0334005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480b4f30 con 0x7f0334003ef0 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480d08d0 con 0x7f0334004d00 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.486+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033400b980 con 0x7f03480d1980 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.487+0000 7f034d3d0640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0334003ef0 0x7f03340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.487+0000 7f034dbd1640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03480d1980 0x7f0334003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.487+0000 7f034e3d2640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0334004d00 0x7f0334005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.487+0000 7f034d3d0640 1 -- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03480d1980 msgr2=0x7f0334003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.487+0000 7f034d3d0640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03480d1980 0x7f0334003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.487+0000 7f034d3d0640 1 -- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0334004d00 msgr2=0x7f0334005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.487+0000 7f034d3d0640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0334004d00 0x7f0334005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.487+0000 7f034d3d0640 1 -- 172.21.15.132:0/3090716526 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0334003520 con 0x7f0334003ef0 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.487+0000 7f034e3d2640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0334004d00 0x7f0334005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034d3d0640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0334003ef0 0x7f03340047c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0338009650 tx=0x7f03340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b5fd7807536a73 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033803b400 con 0x7f0334003ef0 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338037050 con 0x7f0334003ef0 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034cbcf640 1 -- 172.21.15.132:0/3090716526 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033803b780 con 0x7f0334003ef0 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034fe35640 1 -- 172.21.15.132:0/3090716526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0334003ef0 msgr2=0x7f03340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034fe35640 1 --2- 172.21.15.132:0/3090716526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0334003ef0 0x7f03340047c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0338009650 tx=0x7f03340057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034e3d2640 1 -- 172.21.15.132:0/3090716526 reap_dead start 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034fe35640 1 -- 172.21.15.132:0/3090716526 shutdown_connections 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034fe35640 1 -- 172.21.15.132:0/3090716526 >> 172.21.15.132:0/3090716526 conn(0x7f034809d120 msgr2=0x7f03480d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034fe35640 1 -- 172.21.15.132:0/3090716526 shutdown_connections 2024-03-16T17:48:26.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.488+0000 7f034fe35640 1 -- 172.21.15.132:0/3090716526 wait complete. 2024-03-16T17:48:26.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034fe35640 1 Processor -- start 2024-03-16T17:48:26.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034fe35640 1 -- start start 2024-03-16T17:48:26.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034fe35640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0334003ef0 0x7f03480cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034fe35640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034814ff50 0x7f03480cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034fe35640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03481503d0 0x7f03480cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034fe35640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480cae80 con 0x7f03481503d0 2024-03-16T17:48:26.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034fe35640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480ca590 con 0x7f0334003ef0 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034fe35640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03480cb120 con 0x7f034814ff50 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034e3d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03481503d0 0x7f03480cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034e3d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03481503d0 0x7f03480cf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42800/0 (socket says 172.21.15.132:42800) 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034e3d2640 1 -- 172.21.15.132:0/804189522 learned_addr learned my addr 172.21.15.132:0/804189522 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034dbd1640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0334003ef0 0x7f03480cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.490+0000 7f034d3d0640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034814ff50 0x7f03480cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f034e3d2640 1 -- 172.21.15.132:0/804189522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034814ff50 msgr2=0x7f03480cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f034e3d2640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034814ff50 0x7f03480cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f034e3d2640 1 -- 172.21.15.132:0/804189522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0334003ef0 msgr2=0x7f03480cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f034e3d2640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0334003ef0 0x7f03480cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f034e3d2640 1 -- 172.21.15.132:0/804189522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480cb400 con 0x7f03481503d0 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f034d3d0640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034814ff50 0x7f03480cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f034e3d2640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03481503d0 0x7f03480cf4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f03480b68e0 tx=0x7f0340010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f033e7fc640 1 -- 172.21.15.132:0/804189522 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034001b070 con 0x7f03481503d0 2024-03-16T17:48:26.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f033e7fc640 1 -- 172.21.15.132:0/804189522 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034000f040 con 0x7f03481503d0 2024-03-16T17:48:26.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f033e7fc640 1 -- 172.21.15.132:0/804189522 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000e050 con 0x7f03481503d0 2024-03-16T17:48:26.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f034fe35640 1 -- 172.21.15.132:0/804189522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03480cb6e0 con 0x7f03481503d0 2024-03-16T17:48:26.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.491+0000 7f034fe35640 1 -- 172.21.15.132:0/804189522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03480cbc00 con 0x7f03481503d0 2024-03-16T17:48:26.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.492+0000 7f034fe35640 1 -- 172.21.15.132:0/804189522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034804f2c0 con 0x7f03481503d0 2024-03-16T17:48:26.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.492+0000 7f033e7fc640 1 -- 172.21.15.132:0/804189522 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f0340015440 con 0x7f03481503d0 2024-03-16T17:48:26.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.493+0000 7f033e7fc640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f032c06b3b0 0x7f032c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.493+0000 7f033e7fc640 1 -- 172.21.15.132:0/804189522 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0340089e40 con 0x7f03481503d0 2024-03-16T17:48:26.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.493+0000 7f034dbd1640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f032c06b3b0 0x7f032c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.493+0000 7f034dbd1640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f032c06b3b0 0x7f032c06d870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0344001eb0 tx=0x7f0344007bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:26.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.497+0000 7f033e7fc640 1 -- 172.21.15.132:0/804189522 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f03400549f0 con 0x7f03481503d0 2024-03-16T17:48:26.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.713+0000 7f034fe35640 1 -- 172.21.15.132:0/804189522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03480683c0 con 0x7f03481503d0 2024-03-16T17:48:26.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.713+0000 7f033e7fc640 1 -- 172.21.15.132:0/804189522 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4980 (secure 0 0 0) 0x7f03400580b0 con 0x7f03481503d0 2024-03-16T17:48:26.717 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:26.717 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/481194427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":481194427},{"type":"v1","addr":"172.21.15.194:6834","nonce":481194427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1590172463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1590172463},{"type":"v1","addr":"172.21.15.194:6835","nonce":1590172463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2008777747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2008777747},{"type":"v1","addr":"172.21.15.132:6835","nonce":2008777747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T17:47:49.814572+0000","modified":"2024-03-16T17:47:51.863322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1367984600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1367984600},{"type":"v1","addr":"172.21.15.132:6837","nonce":1367984600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-16T17:48:26.718 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-03-16T17:48:26.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 -- 172.21.15.132:0/804189522 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f032c06b3b0 msgr2=0x7f032c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f032c06b3b0 0x7f032c06d870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0344001eb0 tx=0x7f0344007bf0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 -- 172.21.15.132:0/804189522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03481503d0 msgr2=0x7f03480cf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03481503d0 0x7f03480cf4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f03480b68e0 tx=0x7f0340010590 comp rx=0 tx=0).stop 2024-03-16T17:48:26.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 -- 172.21.15.132:0/804189522 shutdown_connections 2024-03-16T17:48:26.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f032c06b3b0 0x7f032c06d870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03481503d0 0x7f03480cf4c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f034814ff50 0x7f03480cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 --2- 172.21.15.132:0/804189522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0334003ef0 0x7f03480cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 -- 172.21.15.132:0/804189522 >> 172.21.15.132:0/804189522 conn(0x7f034809d120 msgr2=0x7f03480b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:26.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 -- 172.21.15.132:0/804189522 shutdown_connections 2024-03-16T17:48:26.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.715+0000 7f034fe35640 1 -- 172.21.15.132:0/804189522 wait complete. 2024-03-16T17:48:26.730 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:26.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.830+0000 7f0a6fac9640 1 Processor -- start 2024-03-16T17:48:26.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.830+0000 7f0a6fac9640 1 -- start start 2024-03-16T17:48:26.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6fac9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a680b3560 0x7f0a680cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6fac9640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0a680d1980 0x7f0a680d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6fac9640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a680d0680 con 0x7f0a68161540 2024-03-16T17:48:26.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6fac9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a680b4f30 con 0x7f0a680b3560 2024-03-16T17:48:26.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6fac9640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a680d08d0 con 0x7f0a680d1980 2024-03-16T17:48:26.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6d064640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a680b3560 0x7f0a680cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6d064640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a680b3560 0x7f0a680cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42804/0 (socket says 172.21.15.132:42804) 2024-03-16T17:48:26.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6d064640 1 -- 172.21.15.132:0/2733175685 learned_addr learned my addr 172.21.15.132:0/2733175685 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:26.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6e066640 1 --2- 172.21.15.132:0/2733175685 >> v2:172.21.15.194:3300/0 conn(0x7f0a680d1980 0x7f0a680d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6d064640 1 -- 172.21.15.132:0/2733175685 >> v2:172.21.15.194:3300/0 conn(0x7f0a680d1980 msgr2=0x7f0a680d1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:26.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6d064640 1 --2- 172.21.15.132:0/2733175685 >> v2:172.21.15.194:3300/0 conn(0x7f0a680d1980 0x7f0a680d1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6d064640 1 -- 172.21.15.132:0/2733175685 >> v1:172.21.15.194:6789/0 conn(0x7f0a68161540 legacy=0x7f0a680cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:26.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.831+0000 7f0a6d064640 1 -- 172.21.15.132:0/2733175685 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680d0bb0 con 0x7f0a680b3560 2024-03-16T17:48:26.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.832+0000 7f0a6d064640 1 --2- 172.21.15.132:0/2733175685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a680b3560 0x7f0a680cf790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0a680d37a0 tx=0x7f0a6402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47307e9764cd6dea server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.832+0000 7f0a6c863640 1 -- 172.21.15.132:0/2733175685 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64031870 con 0x7f0a680b3560 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.832+0000 7f0a6c863640 1 -- 172.21.15.132:0/2733175685 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a640319d0 con 0x7f0a680b3560 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.832+0000 7f0a6c863640 1 -- 172.21.15.132:0/2733175685 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64031d60 con 0x7f0a680b3560 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.833+0000 7f0a6fac9640 1 -- 172.21.15.132:0/2733175685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a680b3560 msgr2=0x7f0a680cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.833+0000 7f0a6fac9640 1 --2- 172.21.15.132:0/2733175685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a680b3560 0x7f0a680cf790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0a680d37a0 tx=0x7f0a6402b910 comp rx=0 tx=0).stop 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.833+0000 7f0a6fac9640 1 -- 172.21.15.132:0/2733175685 shutdown_connections 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.833+0000 7f0a6fac9640 1 --2- 172.21.15.132:0/2733175685 >> v2:172.21.15.194:3300/0 conn(0x7f0a680d1980 0x7f0a680d1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.833+0000 7f0a6fac9640 1 --2- 172.21.15.132:0/2733175685 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a680b3560 0x7f0a680cf790 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.833+0000 7f0a6fac9640 1 -- 172.21.15.132:0/2733175685 >> 172.21.15.132:0/2733175685 conn(0x7f0a6809d120 msgr2=0x7f0a680d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.833+0000 7f0a6fac9640 1 -- 172.21.15.132:0/2733175685 shutdown_connections 2024-03-16T17:48:26.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.833+0000 7f0a6fac9640 1 -- 172.21.15.132:0/2733175685 wait complete. 2024-03-16T17:48:26.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.835+0000 7f0a6fac9640 1 Processor -- start 2024-03-16T17:48:26.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.835+0000 7f0a6fac9640 1 -- start start 2024-03-16T17:48:26.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6fac9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680b3560 0x7f0a6814da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6fac9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a680d1980 0x7f0a681f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6fac9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a68161540 0x7f0a680b8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6fac9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680b9270 con 0x7f0a68161540 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6fac9640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680b9550 con 0x7f0a680b3560 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6fac9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680b9830 con 0x7f0a680d1980 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6e066640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a68161540 0x7f0a680b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6e066640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a68161540 0x7f0a680b8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42820/0 (socket says 172.21.15.132:42820) 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6e066640 1 -- 172.21.15.132:0/1650120218 learned_addr learned my addr 172.21.15.132:0/1650120218 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6d865640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680b3560 0x7f0a6814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.836+0000 7f0a6d064640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a680d1980 0x7f0a681f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a6e066640 1 -- 172.21.15.132:0/1650120218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a680d1980 msgr2=0x7f0a681f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a6e066640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a680d1980 0x7f0a681f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a6e066640 1 -- 172.21.15.132:0/1650120218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680b3560 msgr2=0x7f0a6814da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a6e066640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680b3560 0x7f0a6814da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a6e066640 1 -- 172.21.15.132:0/1650120218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a640094d0 con 0x7f0a68161540 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a6e066640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a68161540 0x7f0a680b8980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000cd70 tx=0x7f0a6000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:26.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a5e7fc640 1 -- 172.21.15.132:0/1650120218 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60003b90 con 0x7f0a68161540 2024-03-16T17:48:26.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a5e7fc640 1 -- 172.21.15.132:0/1650120218 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a60003cf0 con 0x7f0a68161540 2024-03-16T17:48:26.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a5e7fc640 1 -- 172.21.15.132:0/1650120218 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60004240 con 0x7f0a68161540 2024-03-16T17:48:26.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a6fac9640 1 -- 172.21.15.132:0/1650120218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a680b9b10 con 0x7f0a68161540 2024-03-16T17:48:26.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.837+0000 7f0a6fac9640 1 -- 172.21.15.132:0/1650120218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a681f3870 con 0x7f0a68161540 2024-03-16T17:48:26.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.838+0000 7f0a6fac9640 1 -- 172.21.15.132:0/1650120218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6815bf40 con 0x7f0a68161540 2024-03-16T17:48:26.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.838+0000 7f0a5e7fc640 1 -- 172.21.15.132:0/1650120218 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f0a600043a0 con 0x7f0a68161540 2024-03-16T17:48:26.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.839+0000 7f0a5e7fc640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a4c06b3b0 0x7f0a4c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:26.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.839+0000 7f0a5e7fc640 1 -- 172.21.15.132:0/1650120218 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a60012070 con 0x7f0a68161540 2024-03-16T17:48:26.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.839+0000 7f0a6d865640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a4c06b3b0 0x7f0a4c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:26.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.839+0000 7f0a6d865640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a4c06b3b0 0x7f0a4c06d870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0a58006fd0 tx=0x7f0a58009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:26.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:26.843+0000 7f0a5e7fc640 1 -- 172.21.15.132:0/1650120218 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0a6815bf40 con 0x7f0a68161540 2024-03-16T17:48:27.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.022+0000 7f0a6fac9640 1 -- 172.21.15.132:0/1650120218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a6815bf40 con 0x7f0a68161540 2024-03-16T17:48:27.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.023+0000 7f0a5e7fc640 1 -- 172.21.15.132:0/1650120218 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f0a6815bf40 con 0x7f0a68161540 2024-03-16T17:48:27.027 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:27.027 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 -- 172.21.15.132:0/1650120218 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a4c06b3b0 msgr2=0x7f0a4c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a4c06b3b0 0x7f0a4c06d870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0a58006fd0 tx=0x7f0a58009060 comp rx=0 tx=0).stop 2024-03-16T17:48:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 -- 172.21.15.132:0/1650120218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a68161540 msgr2=0x7f0a680b8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a68161540 0x7f0a680b8980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000cd70 tx=0x7f0a6000a660 comp rx=0 tx=0).stop 2024-03-16T17:48:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 -- 172.21.15.132:0/1650120218 shutdown_connections 2024-03-16T17:48:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a4c06b3b0 0x7f0a4c06d870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a68161540 0x7f0a680b8980 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a680d1980 0x7f0a681f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 --2- 172.21.15.132:0/1650120218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a680b3560 0x7f0a6814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 -- 172.21.15.132:0/1650120218 >> 172.21.15.132:0/1650120218 conn(0x7f0a6809d120 msgr2=0x7f0a6806bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:27.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 -- 172.21.15.132:0/1650120218 shutdown_connections 2024-03-16T17:48:27.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.025+0000 7f0a6fac9640 1 -- 172.21.15.132:0/1650120218 wait complete. 2024-03-16T17:48:27.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-16T17:47:47.817831+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-16T17:47:48.791306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:27.041 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:27.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.141+0000 7ffb1a48f640 1 Processor -- start 2024-03-16T17:48:27.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.141+0000 7ffb1a48f640 1 -- start start 2024-03-16T17:48:27.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.142+0000 7ffb1a48f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ffb1415c4f0 0x7ffb140d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.142+0000 7ffb1a48f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb1415d640 0x7ffb1415da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.142+0000 7ffb1a48f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb140ce2e0 con 0x7ffb140b30d0 2024-03-16T17:48:27.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.142+0000 7ffb1a48f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb140ceb80 con 0x7ffb1415d640 2024-03-16T17:48:27.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.142+0000 7ffb1a48f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb140cf720 con 0x7ffb1415c4f0 2024-03-16T17:48:27.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.142+0000 7ffb18a2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb1415d640 0x7ffb1415da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.142+0000 7ffb18a2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb1415d640 0x7ffb1415da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42826/0 (socket says 172.21.15.132:42826) 2024-03-16T17:48:27.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.142+0000 7ffb18a2c640 1 -- 172.21.15.132:0/3248122635 learned_addr learned my addr 172.21.15.132:0/3248122635 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:27.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.142+0000 7ffb13fff640 1 --2- 172.21.15.132:0/3248122635 >> v2:172.21.15.194:3300/0 conn(0x7ffb1415c4f0 0x7ffb140d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.143+0000 7ffb18a2c640 1 -- 172.21.15.132:0/3248122635 >> v2:172.21.15.194:3300/0 conn(0x7ffb1415c4f0 msgr2=0x7ffb140d1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:27.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.143+0000 7ffb18a2c640 1 --2- 172.21.15.132:0/3248122635 >> v2:172.21.15.194:3300/0 conn(0x7ffb1415c4f0 0x7ffb140d1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.143+0000 7ffb18a2c640 1 -- 172.21.15.132:0/3248122635 >> v1:172.21.15.194:6789/0 conn(0x7ffb140b30d0 legacy=0x7ffb140cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.143+0000 7ffb18a2c640 1 -- 172.21.15.132:0/3248122635 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1415dfb0 con 0x7ffb1415d640 2024-03-16T17:48:27.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.143+0000 7ffb18a2c640 1 --2- 172.21.15.132:0/3248122635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1415d640 0x7ffb1415da70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffb14074db0 tx=0x7ffb0c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a6d44dd6dea5fa server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:27.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.143+0000 7ffb12ffd640 1 -- 172.21.15.132:0/3248122635 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c02cb20 con 0x7ffb1415d640 2024-03-16T17:48:27.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.144+0000 7ffb12ffd640 1 -- 172.21.15.132:0/3248122635 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c02cc80 con 0x7ffb1415d640 2024-03-16T17:48:27.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.144+0000 7ffb12ffd640 1 -- 172.21.15.132:0/3248122635 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0343f0 con 0x7ffb1415d640 2024-03-16T17:48:27.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.144+0000 7ffb1a48f640 1 -- 172.21.15.132:0/3248122635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1415d640 msgr2=0x7ffb1415da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.144+0000 7ffb1a48f640 1 --2- 172.21.15.132:0/3248122635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1415d640 0x7ffb1415da70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffb14074db0 tx=0x7ffb0c02bf80 comp rx=0 tx=0).stop 2024-03-16T17:48:27.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.144+0000 7ffb1a48f640 1 -- 172.21.15.132:0/3248122635 shutdown_connections 2024-03-16T17:48:27.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.144+0000 7ffb1a48f640 1 --2- 172.21.15.132:0/3248122635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb1415d640 0x7ffb1415da70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.144+0000 7ffb1a48f640 1 --2- 172.21.15.132:0/3248122635 >> v2:172.21.15.194:3300/0 conn(0x7ffb1415c4f0 0x7ffb140d1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.144+0000 7ffb1a48f640 1 -- 172.21.15.132:0/3248122635 >> 172.21.15.132:0/3248122635 conn(0x7ffb14073220 msgr2=0x7ffb1409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:27.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.144+0000 7ffb1a48f640 1 -- 172.21.15.132:0/3248122635 shutdown_connections 2024-03-16T17:48:27.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.144+0000 7ffb1a48f640 1 -- 172.21.15.132:0/3248122635 wait complete. 2024-03-16T17:48:27.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.145+0000 7ffb1a48f640 1 Processor -- start 2024-03-16T17:48:27.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.145+0000 7ffb1a48f640 1 -- start start 2024-03-16T17:48:27.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb1a48f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140b30d0 0x7ffb1406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb1a48f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb1415c4f0 0x7ffb14152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb1a48f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1415d640 0x7ffb14158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb1a48f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1406d870 con 0x7ffb140b30d0 2024-03-16T17:48:27.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb1a48f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb14153490 con 0x7ffb1415d640 2024-03-16T17:48:27.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb1a48f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb14152180 con 0x7ffb1415c4f0 2024-03-16T17:48:27.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb13fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140b30d0 0x7ffb1406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb13fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140b30d0 0x7ffb1406d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42828/0 (socket says 172.21.15.132:42828) 2024-03-16T17:48:27.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb13fff640 1 -- 172.21.15.132:0/1223380209 learned_addr learned my addr 172.21.15.132:0/1223380209 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:27.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb18a2c640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1415d640 0x7ffb14158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.146+0000 7ffb137fe640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb1415c4f0 0x7ffb14152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb13fff640 1 -- 172.21.15.132:0/1223380209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb1415c4f0 msgr2=0x7ffb14152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb13fff640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb1415c4f0 0x7ffb14152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb13fff640 1 -- 172.21.15.132:0/1223380209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1415d640 msgr2=0x7ffb14158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb13fff640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1415d640 0x7ffb14158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb13fff640 1 -- 172.21.15.132:0/1223380209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c009b30 con 0x7ffb140b30d0 2024-03-16T17:48:27.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb13fff640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140b30d0 0x7ffb1406d330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e9b0 tx=0x7ffb0400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:27.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb10ff9640 1 -- 172.21.15.132:0/1223380209 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04009670 con 0x7ffb140b30d0 2024-03-16T17:48:27.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb10ff9640 1 -- 172.21.15.132:0/1223380209 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0400c9a0 con 0x7ffb140b30d0 2024-03-16T17:48:27.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb1a48f640 1 -- 172.21.15.132:0/1223380209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb14151ea0 con 0x7ffb140b30d0 2024-03-16T17:48:27.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb10ff9640 1 -- 172.21.15.132:0/1223380209 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400cd50 con 0x7ffb140b30d0 2024-03-16T17:48:27.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.147+0000 7ffb1a48f640 1 -- 172.21.15.132:0/1223380209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb14152a30 con 0x7ffb140b30d0 2024-03-16T17:48:27.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.148+0000 7ffb1a48f640 1 -- 172.21.15.132:0/1223380209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1409fe70 con 0x7ffb140b30d0 2024-03-16T17:48:27.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.148+0000 7ffb10ff9640 1 -- 172.21.15.132:0/1223380209 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7ffb04013470 con 0x7ffb140b30d0 2024-03-16T17:48:27.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.149+0000 7ffb10ff9640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffaf406b3b0 0x7ffaf406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.149+0000 7ffb10ff9640 1 -- 172.21.15.132:0/1223380209 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb04089e00 con 0x7ffb140b30d0 2024-03-16T17:48:27.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.149+0000 7ffb137fe640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffaf406b3b0 0x7ffaf406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.149+0000 7ffb137fe640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffaf406b3b0 0x7ffaf406d870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb14156270 tx=0x7ffafc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:27.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.154+0000 7ffb10ff9640 1 -- 172.21.15.132:0/1223380209 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ffb04054b10 con 0x7ffb140b30d0 2024-03-16T17:48:27.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.326+0000 7ffb1a48f640 1 -- 172.21.15.132:0/1223380209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb1404f330 con 0x7ffb140b30d0 2024-03-16T17:48:27.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.326+0000 7ffb10ff9640 1 -- 172.21.15.132:0/1223380209 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb040170a0 con 0x7ffb140b30d0 2024-03-16T17:48:27.330 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:27.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 -- 172.21.15.132:0/1223380209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffaf406b3b0 msgr2=0x7ffaf406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffaf406b3b0 0x7ffaf406d870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb14156270 tx=0x7ffafc009040 comp rx=0 tx=0).stop 2024-03-16T17:48:27.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 -- 172.21.15.132:0/1223380209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140b30d0 msgr2=0x7ffb1406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140b30d0 0x7ffb1406d330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400e9b0 tx=0x7ffb0400ee70 comp rx=0 tx=0).stop 2024-03-16T17:48:27.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 -- 172.21.15.132:0/1223380209 shutdown_connections 2024-03-16T17:48:27.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffaf406b3b0 0x7ffaf406d870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb1415d640 0x7ffb14158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb1415c4f0 0x7ffb14152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 --2- 172.21.15.132:0/1223380209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140b30d0 0x7ffb1406d330 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 -- 172.21.15.132:0/1223380209 >> 172.21.15.132:0/1223380209 conn(0x7ffb14073220 msgr2=0x7ffb140cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:27.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 -- 172.21.15.132:0/1223380209 shutdown_connections 2024-03-16T17:48:27.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.328+0000 7ffb1a48f640 1 -- 172.21.15.132:0/1223380209 wait complete. 2024-03-16T17:48:27.343 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-16T17:48:27.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.454+0000 7ff9662b5640 1 Processor -- start 2024-03-16T17:48:27.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.454+0000 7ff9662b5640 1 -- start start 2024-03-16T17:48:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.454+0000 7ff9662b5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161760 0x7ff9600b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.454+0000 7ff9662b5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff9600d0d10 0x7ff9600c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.454+0000 7ff9662b5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9600cff20 con 0x7ff960161b40 2024-03-16T17:48:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.454+0000 7ff9662b5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9600b5500 con 0x7ff9600d0d10 2024-03-16T17:48:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.454+0000 7ff9662b5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600cf5f0 con 0x7ff960161760 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.455+0000 7ff964852640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff9600d0d10 0x7ff9600c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.455+0000 7ff964852640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff9600d0d10 0x7ff9600c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42844/0 (socket says 172.21.15.132:42844) 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.455+0000 7ff964852640 1 -- 172.21.15.132:0/1809616606 learned_addr learned my addr 172.21.15.132:0/1809616606 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.455+0000 7ff95ffff640 1 --2- 172.21.15.132:0/1809616606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161760 0x7ff9600b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.455+0000 7ff964852640 1 -- 172.21.15.132:0/1809616606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161760 msgr2=0x7ff9600b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.455+0000 7ff964852640 1 --2- 172.21.15.132:0/1809616606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161760 0x7ff9600b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.455+0000 7ff964852640 1 -- 172.21.15.132:0/1809616606 >> v1:172.21.15.194:6789/0 conn(0x7ff960161b40 legacy=0x7ff9600d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.455+0000 7ff964852640 1 -- 172.21.15.132:0/1809616606 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9600cf8d0 con 0x7ff9600d0d10 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff964852640 1 --2- 172.21.15.132:0/1809616606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9600d0d10 0x7ff9600c7d00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff958009e50 tx=0x7ff95802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae15ba3770b81c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff95effd640 1 -- 172.21.15.132:0/1809616606 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95802cb00 con 0x7ff9600d0d10 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff95effd640 1 -- 172.21.15.132:0/1809616606 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95802cc60 con 0x7ff9600d0d10 2024-03-16T17:48:27.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff95effd640 1 -- 172.21.15.132:0/1809616606 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580343f0 con 0x7ff9600d0d10 2024-03-16T17:48:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff9662b5640 1 -- 172.21.15.132:0/1809616606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9600d0d10 msgr2=0x7ff9600c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff9662b5640 1 --2- 172.21.15.132:0/1809616606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9600d0d10 0x7ff9600c7d00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff958009e50 tx=0x7ff95802bf60 comp rx=0 tx=0).stop 2024-03-16T17:48:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff9662b5640 1 -- 172.21.15.132:0/1809616606 shutdown_connections 2024-03-16T17:48:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff9662b5640 1 --2- 172.21.15.132:0/1809616606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9600d0d10 0x7ff9600c7d00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff9662b5640 1 --2- 172.21.15.132:0/1809616606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161760 0x7ff9600b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff9662b5640 1 -- 172.21.15.132:0/1809616606 >> 172.21.15.132:0/1809616606 conn(0x7ff9600d3ed0 msgr2=0x7ff9600d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff9662b5640 1 -- 172.21.15.132:0/1809616606 shutdown_connections 2024-03-16T17:48:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.456+0000 7ff9662b5640 1 -- 172.21.15.132:0/1809616606 wait complete. 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.457+0000 7ff9662b5640 1 Processor -- start 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.458+0000 7ff9662b5640 1 -- start start 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.458+0000 7ff9662b5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9600d0d10 0x7ff960154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.458+0000 7ff9662b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff960161760 0x7ff9600cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.458+0000 7ff9662b5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161b40 0x7ff9600d1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.458+0000 7ff9662b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff960154990 con 0x7ff960161760 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.458+0000 7ff9662b5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600b7730 con 0x7ff9600d0d10 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.458+0000 7ff9662b5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600b6b90 con 0x7ff960161b40 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.458+0000 7ff95f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff960161760 0x7ff9600cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.458+0000 7ff95f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff960161760 0x7ff9600cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42856/0 (socket says 172.21.15.132:42856) 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.458+0000 7ff95f7fe640 1 -- 172.21.15.132:0/2346084160 learned_addr learned my addr 172.21.15.132:0/2346084160 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff95ffff640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9600d0d10 0x7ff960154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff964852640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161b40 0x7ff9600d1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff95f7fe640 1 -- 172.21.15.132:0/2346084160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161b40 msgr2=0x7ff9600d1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff95f7fe640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161b40 0x7ff9600d1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff95f7fe640 1 -- 172.21.15.132:0/2346084160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9600d0d10 msgr2=0x7ff960154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff95f7fe640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9600d0d10 0x7ff960154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff95f7fe640 1 -- 172.21.15.132:0/2346084160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff958009b30 con 0x7ff960161760 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff964852640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161b40 0x7ff9600d1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff95f7fe640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff960161760 0x7ff9600cd840 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c3f0 tx=0x7ff95400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff95cff9640 1 -- 172.21.15.132:0/2346084160 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9540052d0 con 0x7ff960161760 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff95cff9640 1 -- 172.21.15.132:0/2346084160 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff954005450 con 0x7ff960161760 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff9662b5640 1 -- 172.21.15.132:0/2346084160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9600b6e00 con 0x7ff960161760 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff95cff9640 1 -- 172.21.15.132:0/2346084160 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954007260 con 0x7ff960161760 2024-03-16T17:48:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.459+0000 7ff9662b5640 1 -- 172.21.15.132:0/2346084160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9600b73c0 con 0x7ff960161760 2024-03-16T17:48:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.460+0000 7ff9662b5640 1 -- 172.21.15.132:0/2346084160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff960068450 con 0x7ff960161760 2024-03-16T17:48:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.461+0000 7ff95cff9640 1 -- 172.21.15.132:0/2346084160 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7ff9540073c0 con 0x7ff960161760 2024-03-16T17:48:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.461+0000 7ff95cff9640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff94c06b3b0 0x7ff94c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.461+0000 7ff95ffff640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff94c06b3b0 0x7ff94c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.461+0000 7ff95cff9640 1 -- 172.21.15.132:0/2346084160 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff954088e50 con 0x7ff960161760 2024-03-16T17:48:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.462+0000 7ff95ffff640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff94c06b3b0 0x7ff94c06d870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9600d2c30 tx=0x7ff950009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:27.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.465+0000 7ff95cff9640 1 -- 172.21.15.132:0/2346084160 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff954053bf0 con 0x7ff960161760 2024-03-16T17:48:27.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.665+0000 7ff9662b5640 1 -- 172.21.15.132:0/2346084160 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9600b78c0 con 0x7ff960161760 2024-03-16T17:48:27.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.665+0000 7ff95cff9640 1 -- 172.21.15.132:0/2346084160 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9540572b0 con 0x7ff960161760 2024-03-16T17:48:27.669 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 -- 172.21.15.132:0/2346084160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff94c06b3b0 msgr2=0x7ff94c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff94c06b3b0 0x7ff94c06d870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9600d2c30 tx=0x7ff950009190 comp rx=0 tx=0).stop 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 -- 172.21.15.132:0/2346084160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff960161760 msgr2=0x7ff9600cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff960161760 0x7ff9600cd840 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c3f0 tx=0x7ff95400c8b0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 -- 172.21.15.132:0/2346084160 shutdown_connections 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff94c06b3b0 0x7ff94c06d870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff960161b40 0x7ff9600d1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff960161760 0x7ff9600cd840 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 --2- 172.21.15.132:0/2346084160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9600d0d10 0x7ff960154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 -- 172.21.15.132:0/2346084160 >> 172.21.15.132:0/2346084160 conn(0x7ff9600d3ed0 msgr2=0x7ff96015f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 -- 172.21.15.132:0/2346084160 shutdown_connections 2024-03-16T17:48:27.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.667+0000 7ff9662b5640 1 -- 172.21.15.132:0/2346084160 wait complete. 2024-03-16T17:48:27.681 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-16T17:48:27.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.782+0000 7f7cd9a4e640 1 Processor -- start 2024-03-16T17:48:27.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.782+0000 7f7cd9a4e640 1 -- start start 2024-03-16T17:48:27.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.782+0000 7f7cd9a4e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7cd415e220 0x7f7cd40d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.782+0000 7f7cd9a4e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d0ec0 0x7f7cd40d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.782+0000 7f7cd9a4e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd40d16a0 con 0x7f7cd40d26f0 2024-03-16T17:48:27.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.782+0000 7f7cd9a4e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd40d2b80 con 0x7f7cd415e220 2024-03-16T17:48:27.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.782+0000 7f7cd9a4e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40b32f0 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.783+0000 7f7cd2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7cd415e220 0x7f7cd40d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.783+0000 7f7cd37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7cd40d26f0 0x7f7cd40cea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35440/0 (socket says 172.21.15.132:35440) 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.783+0000 7f7cd2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7cd415e220 0x7f7cd40d4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42864/0 (socket says 172.21.15.132:42864) 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.783+0000 7f7cd37fe640 1 -- 172.21.15.132:0/1724605400 learned_addr learned my addr 172.21.15.132:0/1724605400 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.783+0000 7f7cd27fc640 1 --2- 172.21.15.132:0/1724605400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d0ec0 0x7f7cd40d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.783+0000 7f7cd2ffd640 1 -- 172.21.15.132:0/1724605400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d0ec0 msgr2=0x7f7cd40d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.783+0000 7f7cd2ffd640 1 --2- 172.21.15.132:0/1724605400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d0ec0 0x7f7cd40d21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.783+0000 7f7cd2ffd640 1 -- 172.21.15.132:0/1724605400 >> v1:172.21.15.132:6789/0 conn(0x7f7cd40d26f0 legacy=0x7f7cd40cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.783+0000 7f7cd2ffd640 1 -- 172.21.15.132:0/1724605400 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40b35d0 con 0x7f7cd415e220 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.783+0000 7f7cd1ffb640 1 -- 172.21.15.132:0/1724605400 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502504839 0 0) 0x7f7cd40d16a0 con 0x7f7cd40d26f0 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd2ffd640 1 --2- 172.21.15.132:0/1724605400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd415e220 0x7f7cd40d4a10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40097a0 tx=0x7f7cc402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10819fa41a2963fd server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd1ffb640 1 -- 172.21.15.132:0/1724605400 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4031830 con 0x7f7cd415e220 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd1ffb640 1 -- 172.21.15.132:0/1724605400 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc4031990 con 0x7f7cd415e220 2024-03-16T17:48:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd1ffb640 1 -- 172.21.15.132:0/1724605400 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4031d20 con 0x7f7cd415e220 2024-03-16T17:48:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/1724605400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd415e220 msgr2=0x7f7cd40d4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd9a4e640 1 --2- 172.21.15.132:0/1724605400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd415e220 0x7f7cd40d4a10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40097a0 tx=0x7f7cc402b8d0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/1724605400 shutdown_connections 2024-03-16T17:48:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd9a4e640 1 --2- 172.21.15.132:0/1724605400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d0ec0 0x7f7cd40d21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd9a4e640 1 --2- 172.21.15.132:0/1724605400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd415e220 0x7f7cd40d4a10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/1724605400 >> 172.21.15.132:0/1724605400 conn(0x7f7cd40d3e80 msgr2=0x7f7cd40d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/1724605400 shutdown_connections 2024-03-16T17:48:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.784+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/1724605400 wait complete. 2024-03-16T17:48:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.786+0000 7f7cd9a4e640 1 Processor -- start 2024-03-16T17:48:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.786+0000 7f7cd9a4e640 1 -- start start 2024-03-16T17:48:27.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd9a4e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd40d0ec0 0x7f7cd41575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd9a4e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d26f0 0x7f7cd40b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd9a4e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd415e220 0x7f7cd40cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd9a4e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40b1680 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd9a4e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40b0ad0 con 0x7f7cd415e220 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd9a4e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd40b0ce0 con 0x7f7cd40d26f0 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd40d0ec0 0x7f7cd41575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd40d0ec0 0x7f7cd41575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42874/0 (socket says 172.21.15.132:42874) 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd2ffd640 1 -- 172.21.15.132:0/3563702287 learned_addr learned my addr 172.21.15.132:0/3563702287 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd37fe640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd415e220 0x7f7cd40cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd2ffd640 1 -- 172.21.15.132:0/3563702287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d26f0 msgr2=0x7f7cd40b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd27fc640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d26f0 0x7f7cd40b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd2ffd640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d26f0 0x7f7cd40b6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd2ffd640 1 -- 172.21.15.132:0/3563702287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd415e220 msgr2=0x7f7cd40cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd2ffd640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd415e220 0x7f7cd40cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd2ffd640 1 -- 172.21.15.132:0/3563702287 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4009400 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd37fe640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd415e220 0x7f7cd40cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd27fc640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d26f0 0x7f7cd40b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:27.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd2ffd640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd40d0ec0 0x7f7cd41575e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4000c00 tx=0x7f7cc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:27.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cbbfff640 1 -- 172.21.15.132:0/3563702287 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc4004230 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cbbfff640 1 -- 172.21.15.132:0/3563702287 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc4004390 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/3563702287 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd40b0fc0 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cbbfff640 1 -- 172.21.15.132:0/3563702287 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc403a8a0 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.788+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/3563702287 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd40b70a0 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.789+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/3563702287 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd4068450 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.790+0000 7f7cbbfff640 1 -- 172.21.15.132:0/3563702287 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f7cc403aa00 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.790+0000 7f7cbbfff640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7cc006b3b0 0x7f7cc006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:27.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.790+0000 7f7cd27fc640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7cc006b3b0 0x7f7cc006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:27.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.790+0000 7f7cbbfff640 1 -- 172.21.15.132:0/3563702287 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cc40ac1d0 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.791+0000 7f7cd27fc640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7cc006b3b0 0x7f7cc006d870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8006fd0 tx=0x7f7cc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:27.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.795+0000 7f7cbbfff640 1 -- 172.21.15.132:0/3563702287 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7cc4076ec0 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.992+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/3563702287 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7cd40a1e50 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.993+0000 7f7cbbfff640 1 -- 172.21.15.132:0/3563702287 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7cc403acb0 con 0x7f7cd40d0ec0 2024-03-16T17:48:27.996 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/3563702287 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7cc006b3b0 msgr2=0x7f7cc006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7cc006b3b0 0x7f7cc006d870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8006fd0 tx=0x7f7cc8008040 comp rx=0 tx=0).stop 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/3563702287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd40d0ec0 msgr2=0x7f7cd41575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd40d0ec0 0x7f7cd41575e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4000c00 tx=0x7f7cc40046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/3563702287 shutdown_connections 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7cc006b3b0 0x7f7cc006d870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd415e220 0x7f7cd40cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cd40d26f0 0x7f7cd40b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 --2- 172.21.15.132:0/3563702287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cd40d0ec0 0x7f7cd41575e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/3563702287 >> 172.21.15.132:0/3563702287 conn(0x7f7cd40d3e80 msgr2=0x7f7cd406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/3563702287 shutdown_connections 2024-03-16T17:48:27.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:27.995+0000 7f7cd9a4e640 1 -- 172.21.15.132:0/3563702287 wait complete. 2024-03-16T17:48:28.009 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:48:28.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.107+0000 7fddd0e22640 1 Processor -- start 2024-03-16T17:48:28.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.107+0000 7fddd0e22640 1 -- start start 2024-03-16T17:48:28.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddd0e22640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddcc156410 0x7fddcc15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddd0e22640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fddcc0d1b90 0x7fddcc0d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddd0e22640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddcc15f920 0x7fddcc15fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddd0e22640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc0d2530 con 0x7fddcc15f920 2024-03-16T17:48:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddd0e22640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc15d2f0 con 0x7fddcc0d1b90 2024-03-16T17:48:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddd0e22640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc09b700 con 0x7fddcc156410 2024-03-16T17:48:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddcad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddcc15f920 0x7fddcc15fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddcad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddcc15f920 0x7fddcc15fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42878/0 (socket says 172.21.15.132:42878) 2024-03-16T17:48:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddcad9d640 1 -- 172.21.15.132:0/989902528 learned_addr learned my addr 172.21.15.132:0/989902528 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddc1d9b640 1 --2- 172.21.15.132:0/989902528 >> v2:172.21.15.194:3300/0 conn(0x7fddcc0d1b90 0x7fddcc0d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddca59c640 1 --2- 172.21.15.132:0/989902528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddcc156410 0x7fddcc15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddcad9d640 1 -- 172.21.15.132:0/989902528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddcc156410 msgr2=0x7fddcc15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddcad9d640 1 --2- 172.21.15.132:0/989902528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddcc156410 0x7fddcc15cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddcad9d640 1 -- 172.21.15.132:0/989902528 >> v2:172.21.15.194:3300/0 conn(0x7fddcc0d1b90 msgr2=0x7fddcc0d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddcad9d640 1 --2- 172.21.15.132:0/989902528 >> v2:172.21.15.194:3300/0 conn(0x7fddcc0d1b90 0x7fddcc0d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddcad9d640 1 -- 172.21.15.132:0/989902528 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc1567f0 con 0x7fddcc15f920 2024-03-16T17:48:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.108+0000 7fddc1d9b640 1 --2- 172.21.15.132:0/989902528 >> v2:172.21.15.194:3300/0 conn(0x7fddcc0d1b90 0x7fddcc0d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.109+0000 7fddcad9d640 1 --2- 172.21.15.132:0/989902528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 0x7fddcc15fd70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0729d0 tx=0x7fddc402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad2b0d6716634da server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddc9d9b640 1 -- 172.21.15.132:0/989902528 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc402c950 con 0x7fddcc15f920 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddc9d9b640 1 -- 172.21.15.132:0/989902528 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc402cab0 con 0x7fddcc15f920 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddc9d9b640 1 -- 172.21.15.132:0/989902528 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc402ce40 con 0x7fddcc15f920 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddd0e22640 1 -- 172.21.15.132:0/989902528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 msgr2=0x7fddcc15fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddd0e22640 1 --2- 172.21.15.132:0/989902528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 0x7fddcc15fd70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0729d0 tx=0x7fddc402bdb0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddd0e22640 1 -- 172.21.15.132:0/989902528 shutdown_connections 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddd0e22640 1 --2- 172.21.15.132:0/989902528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 0x7fddcc15fd70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddd0e22640 1 --2- 172.21.15.132:0/989902528 >> v2:172.21.15.194:3300/0 conn(0x7fddcc0d1b90 0x7fddcc0d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddd0e22640 1 --2- 172.21.15.132:0/989902528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddcc156410 0x7fddcc15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddd0e22640 1 -- 172.21.15.132:0/989902528 >> 172.21.15.132:0/989902528 conn(0x7fddcc073220 msgr2=0x7fddcc09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddd0e22640 1 -- 172.21.15.132:0/989902528 shutdown_connections 2024-03-16T17:48:28.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.110+0000 7fddd0e22640 1 -- 172.21.15.132:0/989902528 wait complete. 2024-03-16T17:48:28.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.112+0000 7fddd0e22640 1 Processor -- start 2024-03-16T17:48:28.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.112+0000 7fddd0e22640 1 -- start start 2024-03-16T17:48:28.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.112+0000 7fddd0e22640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddcc0d1b90 0x7fddcc157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.112+0000 7fddd0e22640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddcc156410 0x7fddcc152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.112+0000 7fddd0e22640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 0x7fddcc1f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.112+0000 7fddd0e22640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0b5090 con 0x7fddcc15f920 2024-03-16T17:48:28.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.112+0000 7fddd0e22640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0b4480 con 0x7fddcc0d1b90 2024-03-16T17:48:28.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.112+0000 7fddd0e22640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0b4760 con 0x7fddcc156410 2024-03-16T17:48:28.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddcad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 0x7fddcc1f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddcad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 0x7fddcc1f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42888/0 (socket says 172.21.15.132:42888) 2024-03-16T17:48:28.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddcad9d640 1 -- 172.21.15.132:0/70101147 learned_addr learned my addr 172.21.15.132:0/70101147 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:28.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddca59c640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddcc0d1b90 0x7fddcc157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddc1d9b640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddcc156410 0x7fddcc152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddcad9d640 1 -- 172.21.15.132:0/70101147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddcc156410 msgr2=0x7fddcc152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddcad9d640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddcc156410 0x7fddcc152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddcad9d640 1 -- 172.21.15.132:0/70101147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddcc0d1b90 msgr2=0x7fddcc157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddcad9d640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddcc0d1b90 0x7fddcc157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddcad9d640 1 -- 172.21.15.132:0/70101147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4009b30 con 0x7fddcc15f920 2024-03-16T17:48:28.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddcad9d640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 0x7fddcc1f0ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fddc4036040 tx=0x7fddc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:28.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddc37fe640 1 -- 172.21.15.132:0/70101147 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4040670 con 0x7fddcc15f920 2024-03-16T17:48:28.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddc37fe640 1 -- 172.21.15.132:0/70101147 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc40407d0 con 0x7fddcc15f920 2024-03-16T17:48:28.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddc37fe640 1 -- 172.21.15.132:0/70101147 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc4040b80 con 0x7fddcc15f920 2024-03-16T17:48:28.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddd0e22640 1 -- 172.21.15.132:0/70101147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc0b4a40 con 0x7fddcc15f920 2024-03-16T17:48:28.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.113+0000 7fddd0e22640 1 -- 172.21.15.132:0/70101147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc1578d0 con 0x7fddcc15f920 2024-03-16T17:48:28.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.114+0000 7fddd0e22640 1 -- 172.21.15.132:0/70101147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc157e10 con 0x7fddcc15f920 2024-03-16T17:48:28.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.115+0000 7fddc37fe640 1 -- 172.21.15.132:0/70101147 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fddc4040ce0 con 0x7fddcc15f920 2024-03-16T17:48:28.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.115+0000 7fddc37fe640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fddac06b3b0 0x7fddac06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.116+0000 7fddc37fe640 1 -- 172.21.15.132:0/70101147 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddc40acb30 con 0x7fddcc15f920 2024-03-16T17:48:28.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.116+0000 7fddca59c640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fddac06b3b0 0x7fddac06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.116+0000 7fddca59c640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fddac06b3b0 0x7fddac06d870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fddbc006fd0 tx=0x7fddbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:28.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.120+0000 7fddc37fe640 1 -- 172.21.15.132:0/70101147 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fddcc157e10 con 0x7fddcc15f920 2024-03-16T17:48:28.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.328+0000 7fddd0e22640 1 -- 172.21.15.132:0/70101147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddcc157e10 con 0x7fddcc15f920 2024-03-16T17:48:28.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.328+0000 7fddc37fe640 1 -- 172.21.15.132:0/70101147 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4980 (secure 0 0 0) 0x7fddcc157e10 con 0x7fddcc15f920 2024-03-16T17:48:28.332 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:28.332 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/481194427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":481194427},{"type":"v1","addr":"172.21.15.194:6834","nonce":481194427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1590172463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1590172463},{"type":"v1","addr":"172.21.15.194:6835","nonce":1590172463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2008777747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2008777747},{"type":"v1","addr":"172.21.15.132:6835","nonce":2008777747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T17:47:49.814572+0000","modified":"2024-03-16T17:47:51.863322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1367984600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1367984600},{"type":"v1","addr":"172.21.15.132:6837","nonce":1367984600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-16T17:48:28.333 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-03-16T17:48:28.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.330+0000 7fddd0e22640 1 -- 172.21.15.132:0/70101147 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fddac06b3b0 msgr2=0x7fddac06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.330+0000 7fddd0e22640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fddac06b3b0 0x7fddac06d870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fddbc006fd0 tx=0x7fddbc008040 comp rx=0 tx=0).stop 2024-03-16T17:48:28.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.330+0000 7fddd0e22640 1 -- 172.21.15.132:0/70101147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 msgr2=0x7fddcc1f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.330+0000 7fddd0e22640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 0x7fddcc1f0ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fddc4036040 tx=0x7fddc4004a40 comp rx=0 tx=0).stop 2024-03-16T17:48:28.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.330+0000 7fddd0e22640 1 -- 172.21.15.132:0/70101147 shutdown_connections 2024-03-16T17:48:28.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.330+0000 7fddd0e22640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fddac06b3b0 0x7fddac06d870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.330+0000 7fddd0e22640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddcc15f920 0x7fddcc1f0ad0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.330+0000 7fddd0e22640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddcc156410 0x7fddcc152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.330+0000 7fddd0e22640 1 --2- 172.21.15.132:0/70101147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddcc0d1b90 0x7fddcc157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.330+0000 7fddd0e22640 1 -- 172.21.15.132:0/70101147 >> 172.21.15.132:0/70101147 conn(0x7fddcc073220 msgr2=0x7fddcc0705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:28.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.331+0000 7fddd0e22640 1 -- 172.21.15.132:0/70101147 shutdown_connections 2024-03-16T17:48:28.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.331+0000 7fddd0e22640 1 -- 172.21.15.132:0/70101147 wait complete. 2024-03-16T17:48:28.345 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:28.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.446+0000 7f4ab9c84640 1 Processor -- start 2024-03-16T17:48:28.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.446+0000 7f4ab9c84640 1 -- start start 2024-03-16T17:48:28.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.447+0000 7f4ab9c84640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4ab40d0ee0 0x7f4ab40cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.447+0000 7f4ab9c84640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ab40b4960 0x7f4ab40cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.447+0000 7f4ab9c84640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab40d4990 con 0x7f4ab415e110 2024-03-16T17:48:28.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.447+0000 7f4ab9c84640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab40d4c70 con 0x7f4ab40b4960 2024-03-16T17:48:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.447+0000 7f4ab9c84640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab40d2450 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.447+0000 7f4ab3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ab40b4960 0x7f4ab40cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.447+0000 7f4ab3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ab40b4960 0x7f4ab40cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42896/0 (socket says 172.21.15.132:42896) 2024-03-16T17:48:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.447+0000 7f4ab3fff640 1 -- 172.21.15.132:0/3246201688 learned_addr learned my addr 172.21.15.132:0/3246201688 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.447+0000 7f4aabfff640 1 --2- 172.21.15.132:0/3246201688 >> v2:172.21.15.194:3300/0 conn(0x7f4ab40d0ee0 0x7f4ab40cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.448+0000 7f4ab3fff640 1 -- 172.21.15.132:0/3246201688 >> v2:172.21.15.194:3300/0 conn(0x7f4ab40d0ee0 msgr2=0x7f4ab40cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.448+0000 7f4ab3fff640 1 --2- 172.21.15.132:0/3246201688 >> v2:172.21.15.194:3300/0 conn(0x7f4ab40d0ee0 0x7f4ab40cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.448+0000 7f4ab3fff640 1 -- 172.21.15.132:0/3246201688 >> v1:172.21.15.194:6789/0 conn(0x7f4ab415e110 legacy=0x7f4ab40d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.448+0000 7f4ab3fff640 1 -- 172.21.15.132:0/3246201688 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab40d2730 con 0x7f4ab40b4960 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.448+0000 7f4ab3fff640 1 --2- 172.21.15.132:0/3246201688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40b4960 0x7f4ab40cef50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4ab408c6f0 tx=0x7f4aac02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ed1121f44c0f50 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.448+0000 7f4ab2ffd640 1 -- 172.21.15.132:0/3246201688 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac02cb20 con 0x7f4ab40b4960 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.448+0000 7f4ab2ffd640 1 -- 172.21.15.132:0/3246201688 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac02cc80 con 0x7f4ab40b4960 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.448+0000 7f4ab2ffd640 1 -- 172.21.15.132:0/3246201688 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0343f0 con 0x7f4ab40b4960 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.449+0000 7f4ab9c84640 1 -- 172.21.15.132:0/3246201688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40b4960 msgr2=0x7f4ab40cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.449+0000 7f4ab9c84640 1 --2- 172.21.15.132:0/3246201688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40b4960 0x7f4ab40cef50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4ab408c6f0 tx=0x7f4aac02bf80 comp rx=0 tx=0).stop 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.449+0000 7f4ab9c84640 1 -- 172.21.15.132:0/3246201688 shutdown_connections 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.449+0000 7f4ab9c84640 1 --2- 172.21.15.132:0/3246201688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40b4960 0x7f4ab40cef50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.449+0000 7f4ab9c84640 1 --2- 172.21.15.132:0/3246201688 >> v2:172.21.15.194:3300/0 conn(0x7f4ab40d0ee0 0x7f4ab40cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.449+0000 7f4ab9c84640 1 -- 172.21.15.132:0/3246201688 >> 172.21.15.132:0/3246201688 conn(0x7f4ab40d3e70 msgr2=0x7f4ab40d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.449+0000 7f4ab9c84640 1 -- 172.21.15.132:0/3246201688 shutdown_connections 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.449+0000 7f4ab9c84640 1 -- 172.21.15.132:0/3246201688 wait complete. 2024-03-16T17:48:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.450+0000 7f4ab9c84640 1 Processor -- start 2024-03-16T17:48:28.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.450+0000 7f4ab9c84640 1 -- start start 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4ab9c84640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ab40b4960 0x7f4ab40c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4ab9c84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40d0ee0 0x7f4ab41f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4ab9c84640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab415e110 0x7f4ab40b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4ab9c84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40c92b0 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4ab9c84640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab41f47d0 con 0x7f4ab415e110 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4ab9c84640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40c7cd0 con 0x7f4ab40b4960 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4aabfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40d0ee0 0x7f4ab41f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4aabfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40d0ee0 0x7f4ab41f4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42902/0 (socket says 172.21.15.132:42902) 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4aabfff640 1 -- 172.21.15.132:0/152059253 learned_addr learned my addr 172.21.15.132:0/152059253 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4ab3fff640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab415e110 0x7f4ab40b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4ab37fe640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ab40b4960 0x7f4ab40c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4aabfff640 1 -- 172.21.15.132:0/152059253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ab40b4960 msgr2=0x7f4ab40c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4aabfff640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ab40b4960 0x7f4ab40c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4aabfff640 1 -- 172.21.15.132:0/152059253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab415e110 msgr2=0x7f4ab40b7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.451+0000 7f4aabfff640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab415e110 0x7f4ab40b7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.452+0000 7f4aabfff640 1 -- 172.21.15.132:0/152059253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac009b30 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.452+0000 7f4ab37fe640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ab40b4960 0x7f4ab40c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.452+0000 7f4aabfff640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40d0ee0 0x7f4ab41f4290 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00e9b0 tx=0x7f4a9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.452+0000 7f4ab0ff9640 1 -- 172.21.15.132:0/152059253 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c009670 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.452+0000 7f4ab0ff9640 1 -- 172.21.15.132:0/152059253 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c00c9a0 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.452+0000 7f4ab0ff9640 1 -- 172.21.15.132:0/152059253 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c00cd50 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.452+0000 7f4ab9c84640 1 -- 172.21.15.132:0/152059253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab40c7fb0 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.452+0000 7f4ab9c84640 1 -- 172.21.15.132:0/152059253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab40c8570 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.453+0000 7f4ab9c84640 1 -- 172.21.15.132:0/152059253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab406c100 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.453+0000 7f4ab0ff9640 1 -- 172.21.15.132:0/152059253 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f4a9c013470 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.454+0000 7f4ab0ff9640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4a9406b3b0 0x7f4a9406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.454+0000 7f4ab0ff9640 1 -- 172.21.15.132:0/152059253 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a9c089da0 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.454+0000 7f4ab37fe640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4a9406b3b0 0x7f4a9406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.454+0000 7f4ab37fe640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4a9406b3b0 0x7f4a9406d870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40d0190 tx=0x7f4aa4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:28.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.458+0000 7f4ab0ff9640 1 -- 172.21.15.132:0/152059253 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4a9c054ab0 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.637+0000 7f4ab9c84640 1 -- 172.21.15.132:0/152059253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ab404f2c0 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.638+0000 7f4ab0ff9640 1 -- 172.21.15.132:0/152059253 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f4a9c017090 con 0x7f4ab40d0ee0 2024-03-16T17:48:28.642 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:28.642 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 -- 172.21.15.132:0/152059253 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4a9406b3b0 msgr2=0x7f4a9406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4a9406b3b0 0x7f4a9406d870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40d0190 tx=0x7f4aa4009040 comp rx=0 tx=0).stop 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 -- 172.21.15.132:0/152059253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40d0ee0 msgr2=0x7f4ab41f4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40d0ee0 0x7f4ab41f4290 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00e9b0 tx=0x7f4a9c00ee70 comp rx=0 tx=0).stop 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 -- 172.21.15.132:0/152059253 shutdown_connections 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f4a9406b3b0 0x7f4a9406d870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab415e110 0x7f4ab40b7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ab40d0ee0 0x7f4ab41f4290 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 --2- 172.21.15.132:0/152059253 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ab40b4960 0x7f4ab40c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 -- 172.21.15.132:0/152059253 >> 172.21.15.132:0/152059253 conn(0x7f4ab40d3e70 msgr2=0x7f4ab40b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:28.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 -- 172.21.15.132:0/152059253 shutdown_connections 2024-03-16T17:48:28.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.640+0000 7f4ab9c84640 1 -- 172.21.15.132:0/152059253 wait complete. 2024-03-16T17:48:28.657 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-16T17:48:28.658 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:48:28.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.755+0000 7f22840d4640 1 Processor -- start 2024-03-16T17:48:28.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.755+0000 7f22840d4640 1 -- start start 2024-03-16T17:48:28.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.756+0000 7f22840d4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c06ca00 0x7f227c1622e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.756+0000 7f22840d4640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f227c0af570 0x7f227c0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.756+0000 7f22840d4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c06cfe0 con 0x7f227c15dfe0 2024-03-16T17:48:28.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.756+0000 7f22840d4640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c0aea90 con 0x7f227c0af570 2024-03-16T17:48:28.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.756+0000 7f22840d4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c0aed70 con 0x7f227c06ca00 2024-03-16T17:48:28.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.757+0000 7f2282671640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f227c0af570 0x7f227c0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.757+0000 7f228166f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c06ca00 0x7f227c1622e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.757+0000 7f2282671640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f227c0af570 0x7f227c0afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.132:38562/0 (socket says 172.21.15.132:38562) 2024-03-16T17:48:28.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.757+0000 7f2282671640 1 -- 172.21.15.132:0/242378118 learned_addr learned my addr 172.21.15.132:0/242378118 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:28.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.757+0000 7f2281e70640 1 --1- 172.21.15.132:0/242378118 >> v1:172.21.15.194:6789/0 conn(0x7f227c15dfe0 0x7f227c161bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:54516/0 (socket says 172.21.15.132:54516) 2024-03-16T17:48:28.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.757+0000 7f228166f640 1 -- 172.21.15.132:0/242378118 >> v2:172.21.15.194:3300/0 conn(0x7f227c0af570 msgr2=0x7f227c0afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:28.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.757+0000 7f228166f640 1 --2- 172.21.15.132:0/242378118 >> v2:172.21.15.194:3300/0 conn(0x7f227c0af570 0x7f227c0afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.757+0000 7f228166f640 1 -- 172.21.15.132:0/242378118 >> v1:172.21.15.194:6789/0 conn(0x7f227c15dfe0 legacy=0x7f227c161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.757+0000 7f228166f640 1 -- 172.21.15.132:0/242378118 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c0af050 con 0x7f227c06ca00 2024-03-16T17:48:28.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.757+0000 7f2282671640 1 --2- 172.21.15.132:0/242378118 >> v2:172.21.15.194:3300/0 conn(0x7f227c0af570 0x7f227c0afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:28.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.758+0000 7f228166f640 1 --2- 172.21.15.132:0/242378118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c06ca00 0x7f227c1622e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22780097a0 tx=0x7f227802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e98a7a8f5ed597b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:28.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.758+0000 7f2280e6e640 1 -- 172.21.15.132:0/242378118 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278031830 con 0x7f227c06ca00 2024-03-16T17:48:28.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.758+0000 7f2280e6e640 1 -- 172.21.15.132:0/242378118 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2278031990 con 0x7f227c06ca00 2024-03-16T17:48:28.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.758+0000 7f2280e6e640 1 -- 172.21.15.132:0/242378118 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278031d20 con 0x7f227c06ca00 2024-03-16T17:48:28.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.758+0000 7f22840d4640 1 -- 172.21.15.132:0/242378118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c06ca00 msgr2=0x7f227c1622e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.758+0000 7f22840d4640 1 --2- 172.21.15.132:0/242378118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c06ca00 0x7f227c1622e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22780097a0 tx=0x7f227802b8d0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.758+0000 7f22840d4640 1 -- 172.21.15.132:0/242378118 shutdown_connections 2024-03-16T17:48:28.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.758+0000 7f22840d4640 1 --2- 172.21.15.132:0/242378118 >> v2:172.21.15.194:3300/0 conn(0x7f227c0af570 0x7f227c0afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.758+0000 7f22840d4640 1 --2- 172.21.15.132:0/242378118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c06ca00 0x7f227c1622e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.758+0000 7f22840d4640 1 -- 172.21.15.132:0/242378118 >> 172.21.15.132:0/242378118 conn(0x7f227c0d1c20 msgr2=0x7f227c0d2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:28.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.759+0000 7f22840d4640 1 -- 172.21.15.132:0/242378118 shutdown_connections 2024-03-16T17:48:28.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.759+0000 7f22840d4640 1 -- 172.21.15.132:0/242378118 wait complete. 2024-03-16T17:48:28.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f22840d4640 1 Processor -- start 2024-03-16T17:48:28.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f22840d4640 1 -- start start 2024-03-16T17:48:28.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f22840d4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f227c06ca00 0x7f227c09f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f22840d4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227c0af570 0x7f227c1f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f22840d4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c15dfe0 0x7f227c1f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f22840d4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c09dca0 con 0x7f227c0af570 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f22840d4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c09e910 con 0x7f227c06ca00 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f22840d4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c09d020 con 0x7f227c15dfe0 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f228166f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227c0af570 0x7f227c1f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f228166f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227c0af570 0x7f227c1f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42904/0 (socket says 172.21.15.132:42904) 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.760+0000 7f228166f640 1 -- 172.21.15.132:0/299396472 learned_addr learned my addr 172.21.15.132:0/299396472 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f2281e70640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f227c06ca00 0x7f227c09f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f2282671640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c15dfe0 0x7f227c1f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f228166f640 1 -- 172.21.15.132:0/299396472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c15dfe0 msgr2=0x7f227c1f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f228166f640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c15dfe0 0x7f227c1f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f228166f640 1 -- 172.21.15.132:0/299396472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f227c06ca00 msgr2=0x7f227c09f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:28.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f228166f640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f227c06ca00 0x7f227c09f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f228166f640 1 -- 172.21.15.132:0/299396472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274009b30 con 0x7f227c0af570 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f2281e70640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f227c06ca00 0x7f227c09f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f228166f640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227c0af570 0x7f227c1f6ef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2278034040 tx=0x7f22780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f22727fc640 1 -- 172.21.15.132:0/299396472 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227803a8f0 con 0x7f227c0af570 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f22727fc640 1 -- 172.21.15.132:0/299396472 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227803aa70 con 0x7f227c0af570 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f22727fc640 1 -- 172.21.15.132:0/299396472 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227803ae20 con 0x7f227c0af570 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f22840d4640 1 -- 172.21.15.132:0/299396472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2278009400 con 0x7f227c0af570 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.761+0000 7f22840d4640 1 -- 172.21.15.132:0/299396472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c09d5e0 con 0x7f227c0af570 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.762+0000 7f22840d4640 1 -- 172.21.15.132:0/299396472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c06d2a0 con 0x7f227c0af570 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.763+0000 7f22727fc640 1 -- 172.21.15.132:0/299396472 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f227804d440 con 0x7f227c0af570 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.763+0000 7f22727fc640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f226006b3b0 0x7f226006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.763+0000 7f22727fc640 1 -- 172.21.15.132:0/299396472 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22780abc90 con 0x7f227c0af570 2024-03-16T17:48:28.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.763+0000 7f2281e70640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f226006b3b0 0x7f226006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:28.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.764+0000 7f2281e70640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f226006b3b0 0x7f226006d870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f226c000f60 tx=0x7f226c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:28.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:28.767+0000 7f22727fc640 1 -- 172.21.15.132:0/299396472 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f227c06d2a0 con 0x7f227c0af570 2024-03-16T17:48:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.049+0000 7f22840d4640 1 -- 172.21.15.132:0/299396472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f227c06d2a0 con 0x7f227c0af570 2024-03-16T17:48:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.050+0000 7f22727fc640 1 -- 172.21.15.132:0/299396472 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4980 (secure 0 0 0) 0x7f227c06d2a0 con 0x7f227c0af570 2024-03-16T17:48:29.054 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:29.054 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/481194427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":481194427},{"type":"v1","addr":"172.21.15.194:6834","nonce":481194427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1590172463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1590172463},{"type":"v1","addr":"172.21.15.194:6835","nonce":1590172463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2008777747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2008777747},{"type":"v1","addr":"172.21.15.132:6835","nonce":2008777747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T17:47:49.814572+0000","modified":"2024-03-16T17:47:51.863322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1367984600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1367984600},{"type":"v1","addr":"172.21.15.132:6837","nonce":1367984600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-16T17:48:29.054 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-03-16T17:48:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 -- 172.21.15.132:0/299396472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f226006b3b0 msgr2=0x7f226006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f226006b3b0 0x7f226006d870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f226c000f60 tx=0x7f226c009040 comp rx=0 tx=0).stop 2024-03-16T17:48:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 -- 172.21.15.132:0/299396472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227c0af570 msgr2=0x7f227c1f6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227c0af570 0x7f227c1f6ef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2278034040 tx=0x7f22780046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 -- 172.21.15.132:0/299396472 shutdown_connections 2024-03-16T17:48:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f226006b3b0 0x7f226006d870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f227c15dfe0 0x7f227c1f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f227c0af570 0x7f227c1f6ef0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 --2- 172.21.15.132:0/299396472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f227c06ca00 0x7f227c09f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 -- 172.21.15.132:0/299396472 >> 172.21.15.132:0/299396472 conn(0x7f227c0d1c20 msgr2=0x7f227c0c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:29.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 -- 172.21.15.132:0/299396472 shutdown_connections 2024-03-16T17:48:29.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.052+0000 7f22840d4640 1 -- 172.21.15.132:0/299396472 wait complete. 2024-03-16T17:48:29.067 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:48:29.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.165+0000 7f346cb1e640 1 Processor -- start 2024-03-16T17:48:29.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.165+0000 7f346cb1e640 1 -- start start 2024-03-16T17:48:29.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f346cb1e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3468156410 0x7f346815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f346cb1e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f34680d1ff0 0x7f3468160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f346cb1e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346815d2f0 con 0x7f34680d1b90 2024-03-16T17:48:29.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f346cb1e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346809b700 con 0x7f34680d1ff0 2024-03-16T17:48:29.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f346cb1e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34681567f0 con 0x7f3468156410 2024-03-16T17:48:29.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f345ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f34680d1b90 0x7f346815f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35444/0 (socket says 172.21.15.132:35444) 2024-03-16T17:48:29.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f345ffff640 1 -- 172.21.15.132:0/1642322590 learned_addr learned my addr 172.21.15.132:0/1642322590 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:29.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f3466d9d640 1 --2- 172.21.15.132:0/1642322590 >> v2:172.21.15.194:3300/0 conn(0x7f34680d1ff0 0x7f3468160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f346659c640 1 --2- 172.21.15.132:0/1642322590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3468156410 0x7f346815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f3465d9b640 1 -- 172.21.15.132:0/1642322590 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157970040 0 0) 0x7f346815d2f0 con 0x7f34680d1b90 2024-03-16T17:48:29.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f3465d9b640 1 -- 172.21.15.132:0/1642322590 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3454003520 con 0x7f34680d1b90 2024-03-16T17:48:29.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f3466d9d640 1 -- 172.21.15.132:0/1642322590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3468156410 msgr2=0x7f346815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:29.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f3466d9d640 1 --2- 172.21.15.132:0/1642322590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3468156410 0x7f346815cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f3466d9d640 1 -- 172.21.15.132:0/1642322590 >> v1:172.21.15.132:6789/0 conn(0x7f34680d1b90 legacy=0x7f346815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.167+0000 7f3466d9d640 1 -- 172.21.15.132:0/1642322590 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346809b180 con 0x7f34680d1ff0 2024-03-16T17:48:29.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.168+0000 7f3466d9d640 1 --2- 172.21.15.132:0/1642322590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680d1ff0 0x7f3468160030 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3460009d90 tx=0x7f346002bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f693f60cfdb195d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:29.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.168+0000 7f3465d9b640 1 -- 172.21.15.132:0/1642322590 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346002cb30 con 0x7f34680d1ff0 2024-03-16T17:48:29.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.168+0000 7f3465d9b640 1 -- 172.21.15.132:0/1642322590 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346002cc90 con 0x7f34680d1ff0 2024-03-16T17:48:29.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.168+0000 7f3465d9b640 1 -- 172.21.15.132:0/1642322590 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460034440 con 0x7f34680d1ff0 2024-03-16T17:48:29.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.169+0000 7f346cb1e640 1 -- 172.21.15.132:0/1642322590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680d1ff0 msgr2=0x7f3468160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.169+0000 7f346cb1e640 1 --2- 172.21.15.132:0/1642322590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680d1ff0 0x7f3468160030 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3460009d90 tx=0x7f346002bd80 comp rx=0 tx=0).stop 2024-03-16T17:48:29.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.169+0000 7f346cb1e640 1 -- 172.21.15.132:0/1642322590 shutdown_connections 2024-03-16T17:48:29.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.169+0000 7f346cb1e640 1 --2- 172.21.15.132:0/1642322590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680d1ff0 0x7f3468160030 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.169+0000 7f346cb1e640 1 --2- 172.21.15.132:0/1642322590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3468156410 0x7f346815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.169+0000 7f346cb1e640 1 -- 172.21.15.132:0/1642322590 >> 172.21.15.132:0/1642322590 conn(0x7f3468073220 msgr2=0x7f346809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:29.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.169+0000 7f346cb1e640 1 -- 172.21.15.132:0/1642322590 shutdown_connections 2024-03-16T17:48:29.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.169+0000 7f346cb1e640 1 -- 172.21.15.132:0/1642322590 wait complete. 2024-03-16T17:48:29.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.170+0000 7f346cb1e640 1 Processor -- start 2024-03-16T17:48:29.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.170+0000 7f346cb1e640 1 -- start start 2024-03-16T17:48:29.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f346cb1e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680d1b90 0x7f3468154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f346cb1e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680d1ff0 0x7f34680cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f346cb1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3468156410 0x7f346815f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f346cb1e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34681f4730 con 0x7f3468156410 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f346cb1e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34681f3bb0 con 0x7f34680d1ff0 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f346cb1e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34681f3e90 con 0x7f34680d1b90 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f3466d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3468156410 0x7f346815f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f3466d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3468156410 0x7f346815f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42916/0 (socket says 172.21.15.132:42916) 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f3466d9d640 1 -- 172.21.15.132:0/3469468011 learned_addr learned my addr 172.21.15.132:0/3469468011 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f346659c640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680d1b90 0x7f3468154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f345ffff640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680d1ff0 0x7f34680cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f3466d9d640 1 -- 172.21.15.132:0/3469468011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680d1b90 msgr2=0x7f3468154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f3466d9d640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680d1b90 0x7f3468154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f3466d9d640 1 -- 172.21.15.132:0/3469468011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680d1ff0 msgr2=0x7f34680cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f3466d9d640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680d1ff0 0x7f34680cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f3466d9d640 1 -- 172.21.15.132:0/3469468011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460009a70 con 0x7f3468156410 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f346659c640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680d1b90 0x7f3468154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.171+0000 7f3466d9d640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3468156410 0x7f346815f140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3460009d90 tx=0x7f3460004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.172+0000 7f345effd640 1 -- 172.21.15.132:0/3469468011 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460034e50 con 0x7f3468156410 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.172+0000 7f345effd640 1 -- 172.21.15.132:0/3469468011 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3460040450 con 0x7f3468156410 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.172+0000 7f346cb1e640 1 -- 172.21.15.132:0/3469468011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34681f4170 con 0x7f3468156410 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.172+0000 7f345effd640 1 -- 172.21.15.132:0/3469468011 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460040800 con 0x7f3468156410 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.172+0000 7f346cb1e640 1 -- 172.21.15.132:0/3469468011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3468154a50 con 0x7f3468156410 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.173+0000 7f346cb1e640 1 -- 172.21.15.132:0/3469468011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346806bff0 con 0x7f3468156410 2024-03-16T17:48:29.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.173+0000 7f345effd640 1 -- 172.21.15.132:0/3469468011 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f3460040960 con 0x7f3468156410 2024-03-16T17:48:29.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.174+0000 7f345effd640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f344806b3b0 0x7f344806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.174+0000 7f345effd640 1 -- 172.21.15.132:0/3469468011 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34600ac780 con 0x7f3468156410 2024-03-16T17:48:29.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.174+0000 7f346659c640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f344806b3b0 0x7f344806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.174+0000 7f346659c640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f344806b3b0 0x7f344806d870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3458009a20 tx=0x7f3458008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:29.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.182+0000 7f345effd640 1 -- 172.21.15.132:0/3469468011 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f346806bff0 con 0x7f3468156410 2024-03-16T17:48:29.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.394+0000 7f346cb1e640 1 -- 172.21.15.132:0/3469468011 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f346806bff0 con 0x7f3468156410 2024-03-16T17:48:29.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.395+0000 7f345effd640 1 -- 172.21.15.132:0/3469468011 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4980 (secure 0 0 0) 0x7f346806bff0 con 0x7f3468156410 2024-03-16T17:48:29.399 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:29.399 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/481194427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":481194427},{"type":"v1","addr":"172.21.15.194:6834","nonce":481194427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1590172463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1590172463},{"type":"v1","addr":"172.21.15.194:6835","nonce":1590172463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2008777747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2008777747},{"type":"v1","addr":"172.21.15.132:6835","nonce":2008777747}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T17:47:49.814572+0000","modified":"2024-03-16T17:47:51.863322+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1367984600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1367984600},{"type":"v1","addr":"172.21.15.132:6837","nonce":1367984600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-16T17:48:29.399 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-03-16T17:48:29.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 -- 172.21.15.132:0/3469468011 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f344806b3b0 msgr2=0x7f344806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f344806b3b0 0x7f344806d870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3458009a20 tx=0x7f3458008040 comp rx=0 tx=0).stop 2024-03-16T17:48:29.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 -- 172.21.15.132:0/3469468011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3468156410 msgr2=0x7f346815f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3468156410 0x7f346815f140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3460009d90 tx=0x7f3460004a40 comp rx=0 tx=0).stop 2024-03-16T17:48:29.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 -- 172.21.15.132:0/3469468011 shutdown_connections 2024-03-16T17:48:29.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f344806b3b0 0x7f344806d870 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3468156410 0x7f346815f140 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680d1ff0 0x7f34680cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 --2- 172.21.15.132:0/3469468011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680d1b90 0x7f3468154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 -- 172.21.15.132:0/3469468011 >> 172.21.15.132:0/3469468011 conn(0x7f3468073220 msgr2=0x7f3468155440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:29.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 -- 172.21.15.132:0/3469468011 shutdown_connections 2024-03-16T17:48:29.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.397+0000 7f346cb1e640 1 -- 172.21.15.132:0/3469468011 wait complete. 2024-03-16T17:48:29.411 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.513+0000 7f7101c84640 1 Processor -- start 2024-03-16T17:48:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.513+0000 7f7101c84640 1 -- start start 2024-03-16T17:48:29.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.514+0000 7f7101c84640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f70fc0d1e00 0x7f70fc0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.514+0000 7f7101c84640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70fc06d2a0 0x7f70fc1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.514+0000 7f7101c84640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc0d0040 con 0x7f70fc0d1640 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.514+0000 7f7101c84640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc158ae0 con 0x7f70fc0d1e00 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.514+0000 7f7101c84640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc15f530 con 0x7f70fc06d2a0 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.514+0000 7f70faffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f70fc0d1640 0x7f70fc157e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35450/0 (socket says 172.21.15.132:35450) 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.514+0000 7f70faffd640 1 -- 172.21.15.132:0/859689120 learned_addr learned my addr 172.21.15.132:0/859689120 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.514+0000 7f70fb7fe640 1 --2- 172.21.15.132:0/859689120 >> v2:172.21.15.194:3300/0 conn(0x7f70fc0d1e00 0x7f70fc0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.515+0000 7f70fbfff640 1 --2- 172.21.15.132:0/859689120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70fc06d2a0 0x7f70fc1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.515+0000 7f70fa7fc640 1 -- 172.21.15.132:0/859689120 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585788929 0 0) 0x7f70f0001110 con 0x7f70fc0d1640 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.515+0000 7f70fa7fc640 1 -- 172.21.15.132:0/859689120 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e4003520 con 0x7f70fc0d1640 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.515+0000 7f70fbfff640 1 -- 172.21.15.132:0/859689120 >> v2:172.21.15.194:3300/0 conn(0x7f70fc0d1e00 msgr2=0x7f70fc0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.515+0000 7f70fa7fc640 1 -- 172.21.15.132:0/859689120 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772486093 0 0) 0x7f70e4003520 con 0x7f70fc0d1640 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.515+0000 7f70fbfff640 1 --2- 172.21.15.132:0/859689120 >> v2:172.21.15.194:3300/0 conn(0x7f70fc0d1e00 0x7f70fc0cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.515+0000 7f70fbfff640 1 -- 172.21.15.132:0/859689120 >> v1:172.21.15.132:6789/0 conn(0x7f70fc0d1640 legacy=0x7f70fc157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.515+0000 7f70fbfff640 1 -- 172.21.15.132:0/859689120 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc15e920 con 0x7f70fc06d2a0 2024-03-16T17:48:29.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.515+0000 7f70fb7fe640 1 --2- 172.21.15.132:0/859689120 >> v2:172.21.15.194:3300/0 conn(0x7f70fc0d1e00 0x7f70fc0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:29.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.516+0000 7f70fbfff640 1 --2- 172.21.15.132:0/859689120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70fc06d2a0 0x7f70fc1585a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009d90 tx=0x7f70f402bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c9df20e98870af0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:29.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.516+0000 7f70fa7fc640 1 -- 172.21.15.132:0/859689120 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f0001800 con 0x7f70fc06d2a0 2024-03-16T17:48:29.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.516+0000 7f70fa7fc640 1 -- 172.21.15.132:0/859689120 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f402c8a0 con 0x7f70fc06d2a0 2024-03-16T17:48:29.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.516+0000 7f70fa7fc640 1 -- 172.21.15.132:0/859689120 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f402cc30 con 0x7f70fc06d2a0 2024-03-16T17:48:29.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.517+0000 7f7101c84640 1 -- 172.21.15.132:0/859689120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70fc06d2a0 msgr2=0x7f70fc1585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.517+0000 7f7101c84640 1 --2- 172.21.15.132:0/859689120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70fc06d2a0 0x7f70fc1585a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009d90 tx=0x7f70f402bd70 comp rx=0 tx=0).stop 2024-03-16T17:48:29.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.517+0000 7f7101c84640 1 -- 172.21.15.132:0/859689120 shutdown_connections 2024-03-16T17:48:29.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.517+0000 7f7101c84640 1 --2- 172.21.15.132:0/859689120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70fc06d2a0 0x7f70fc1585a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.517+0000 7f7101c84640 1 --2- 172.21.15.132:0/859689120 >> v2:172.21.15.194:3300/0 conn(0x7f70fc0d1e00 0x7f70fc0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.517+0000 7f7101c84640 1 -- 172.21.15.132:0/859689120 >> 172.21.15.132:0/859689120 conn(0x7f70fc073220 msgr2=0x7f70fc09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:29.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.517+0000 7f7101c84640 1 -- 172.21.15.132:0/859689120 shutdown_connections 2024-03-16T17:48:29.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.517+0000 7f7101c84640 1 -- 172.21.15.132:0/859689120 wait complete. 2024-03-16T17:48:29.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.519+0000 7f7101c84640 1 Processor -- start 2024-03-16T17:48:29.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.519+0000 7f7101c84640 1 -- start start 2024-03-16T17:48:29.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f7101c84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70fc06d2a0 0x7f70fc152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f7101c84640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70fc0d1640 0x7f70fc0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f7101c84640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70fc0d1e00 0x7f70fc0af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f7101c84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0b1da0 con 0x7f70fc06d2a0 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f7101c84640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc150900 con 0x7f70fc0d1640 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f7101c84640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc150ec0 con 0x7f70fc0d1e00 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f70fb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70fc06d2a0 0x7f70fc152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f70fb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70fc06d2a0 0x7f70fc152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42928/0 (socket says 172.21.15.132:42928) 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f70fb7fe640 1 -- 172.21.15.132:0/3370958235 learned_addr learned my addr 172.21.15.132:0/3370958235 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f70fb7fe640 1 -- 172.21.15.132:0/3370958235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70fc0d1e00 msgr2=0x7f70fc0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f70fb7fe640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70fc0d1e00 0x7f70fc0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f70fb7fe640 1 -- 172.21.15.132:0/3370958235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70fc0d1640 msgr2=0x7f70fc0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f70faffd640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70fc0d1640 0x7f70fc0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f70fb7fe640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70fc0d1640 0x7f70fc0aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.520+0000 7f70fb7fe640 1 -- 172.21.15.132:0/3370958235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec009400 con 0x7f70fc06d2a0 2024-03-16T17:48:29.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.521+0000 7f70fb7fe640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70fc06d2a0 0x7f70fc152cc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00e990 tx=0x7f70ec00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:29.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.521+0000 7f70e3fff640 1 -- 172.21.15.132:0/3370958235 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00c9e0 con 0x7f70fc06d2a0 2024-03-16T17:48:29.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.521+0000 7f70e3fff640 1 -- 172.21.15.132:0/3370958235 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec00cb40 con 0x7f70fc06d2a0 2024-03-16T17:48:29.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.521+0000 7f7101c84640 1 -- 172.21.15.132:0/3370958235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f4009a70 con 0x7f70fc06d2a0 2024-03-16T17:48:29.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.521+0000 7f70e3fff640 1 -- 172.21.15.132:0/3370958235 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00ced0 con 0x7f70fc06d2a0 2024-03-16T17:48:29.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.521+0000 7f7101c84640 1 -- 172.21.15.132:0/3370958235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc156080 con 0x7f70fc06d2a0 2024-03-16T17:48:29.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.522+0000 7f7101c84640 1 -- 172.21.15.132:0/3370958235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc074dc0 con 0x7f70fc06d2a0 2024-03-16T17:48:29.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.522+0000 7f70e3fff640 1 -- 172.21.15.132:0/3370958235 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f70ec013470 con 0x7f70fc06d2a0 2024-03-16T17:48:29.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.523+0000 7f70e3fff640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f70e806b3b0 0x7f70e806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.523+0000 7f70e3fff640 1 -- 172.21.15.132:0/3370958235 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70ec089e40 con 0x7f70fc06d2a0 2024-03-16T17:48:29.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.523+0000 7f70faffd640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f70e806b3b0 0x7f70e806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.523+0000 7f70faffd640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f70e806b3b0 0x7f70e806d870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0b23e0 tx=0x7f70f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:29.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.527+0000 7f70e3fff640 1 -- 172.21.15.132:0/3370958235 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f70ec054aa0 con 0x7f70fc06d2a0 2024-03-16T17:48:29.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.729+0000 7f7101c84640 1 -- 172.21.15.132:0/3370958235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70fc04f2c0 con 0x7f70fc06d2a0 2024-03-16T17:48:29.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.730+0000 7f70e3fff640 1 -- 172.21.15.132:0/3370958235 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f70ec058160 con 0x7f70fc06d2a0 2024-03-16T17:48:29.734 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:29.734 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:47:51.485026+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:47:47.817831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-16T17:47:48.791306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 -- 172.21.15.132:0/3370958235 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f70e806b3b0 msgr2=0x7f70e806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f70e806b3b0 0x7f70e806d870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0b23e0 tx=0x7f70f0009040 comp rx=0 tx=0).stop 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 -- 172.21.15.132:0/3370958235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70fc06d2a0 msgr2=0x7f70fc152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70fc06d2a0 0x7f70fc152cc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00e990 tx=0x7f70ec00ee50 comp rx=0 tx=0).stop 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 -- 172.21.15.132:0/3370958235 shutdown_connections 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f70e806b3b0 0x7f70e806d870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70fc0d1e00 0x7f70fc0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70fc0d1640 0x7f70fc0aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 --2- 172.21.15.132:0/3370958235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70fc06d2a0 0x7f70fc152cc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 -- 172.21.15.132:0/3370958235 >> 172.21.15.132:0/3370958235 conn(0x7f70fc073220 msgr2=0x7f70fc0b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 -- 172.21.15.132:0/3370958235 shutdown_connections 2024-03-16T17:48:29.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.732+0000 7f7101c84640 1 -- 172.21.15.132:0/3370958235 wait complete. 2024-03-16T17:48:29.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-16T17:48:29.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.871+0000 7fed918c3640 1 Processor -- start 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.871+0000 7fed918c3640 1 -- start start 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.872+0000 7fed918c3640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fed8c0b4530 0x7fed8c0c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.872+0000 7fed918c3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 0x7fed8c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.872+0000 7fed918c3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c0cc430 con 0x7fed8c09afb0 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.872+0000 7fed918c3640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c09b440 con 0x7fed8c0b4530 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.872+0000 7fed918c3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0c74e0 con 0x7fed8c0c76f0 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed8b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fed8c09afb0 0x7fed8c161b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35460/0 (socket says 172.21.15.132:35460) 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed8b7fe640 1 -- 172.21.15.132:0/154484388 learned_addr learned my addr 172.21.15.132:0/154484388 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed8affd640 1 --2- 172.21.15.132:0/154484388 >> v2:172.21.15.194:3300/0 conn(0x7fed8c0b4530 0x7fed8c0c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed83fff640 1 --2- 172.21.15.132:0/154484388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 0x7fed8c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed8a7fc640 1 -- 172.21.15.132:0/154484388 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415770144 0 0) 0x7fed8c0cc430 con 0x7fed8c09afb0 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed8a7fc640 1 -- 172.21.15.132:0/154484388 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed78003520 con 0x7fed8c09afb0 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed8affd640 1 -- 172.21.15.132:0/154484388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 msgr2=0x7fed8c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed8affd640 1 --2- 172.21.15.132:0/154484388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 0x7fed8c09aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed8affd640 1 -- 172.21.15.132:0/154484388 >> v1:172.21.15.132:6789/0 conn(0x7fed8c09afb0 legacy=0x7fed8c161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed8a7fc640 1 -- 172.21.15.132:0/154484388 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4088120255 0 0) 0x7fed78003520 con 0x7fed8c09afb0 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed8affd640 1 -- 172.21.15.132:0/154484388 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c06d0c0 con 0x7fed8c0b4530 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.873+0000 7fed83fff640 1 --2- 172.21.15.132:0/154484388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 0x7fed8c09aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.874+0000 7fed8affd640 1 --2- 172.21.15.132:0/154484388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c0b4530 0x7fed8c0c6fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0097d0 tx=0x7fed7c02b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21aeea83be91ba5c server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.874+0000 7fed8a7fc640 1 -- 172.21.15.132:0/154484388 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed840019f0 con 0x7fed8c0b4530 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.874+0000 7fed8a7fc640 1 -- 172.21.15.132:0/154484388 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c02e050 con 0x7fed8c0b4530 2024-03-16T17:48:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.874+0000 7fed8a7fc640 1 -- 172.21.15.132:0/154484388 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c030710 con 0x7fed8c0b4530 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.875+0000 7fed918c3640 1 -- 172.21.15.132:0/154484388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c0b4530 msgr2=0x7fed8c0c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.875+0000 7fed918c3640 1 --2- 172.21.15.132:0/154484388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c0b4530 0x7fed8c0c6fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0097d0 tx=0x7fed7c02b800 comp rx=0 tx=0).stop 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.875+0000 7fed918c3640 1 -- 172.21.15.132:0/154484388 shutdown_connections 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.875+0000 7fed918c3640 1 --2- 172.21.15.132:0/154484388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 0x7fed8c09aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.875+0000 7fed918c3640 1 --2- 172.21.15.132:0/154484388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c0b4530 0x7fed8c0c6fa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.875+0000 7fed918c3640 1 -- 172.21.15.132:0/154484388 >> 172.21.15.132:0/154484388 conn(0x7fed8c0d1db0 msgr2=0x7fed8c0d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.875+0000 7fed918c3640 1 -- 172.21.15.132:0/154484388 shutdown_connections 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.875+0000 7fed918c3640 1 -- 172.21.15.132:0/154484388 wait complete. 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.876+0000 7fed918c3640 1 Processor -- start 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.876+0000 7fed918c3640 1 -- start start 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed918c3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c09afb0 0x7fed8c0ce810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed918c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8c0b4530 0x7fed8c0cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed918c3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 0x7fed8c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed918c3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0b5ad0 con 0x7fed8c0b4530 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed918c3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0b4e50 con 0x7fed8c09afb0 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed918c3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0b5130 con 0x7fed8c0c76f0 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed83fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8c0b4530 0x7fed8c0cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed83fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8c0b4530 0x7fed8c0cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42934/0 (socket says 172.21.15.132:42934) 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed83fff640 1 -- 172.21.15.132:0/4275244622 learned_addr learned my addr 172.21.15.132:0/4275244622 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed8affd640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c09afb0 0x7fed8c0ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed8b7fe640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 0x7fed8c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed83fff640 1 -- 172.21.15.132:0/4275244622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 msgr2=0x7fed8c153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed83fff640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 0x7fed8c153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed83fff640 1 -- 172.21.15.132:0/4275244622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c09afb0 msgr2=0x7fed8c0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed83fff640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c09afb0 0x7fed8c0ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed83fff640 1 -- 172.21.15.132:0/4275244622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74009400 con 0x7fed8c0b4530 2024-03-16T17:48:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed8affd640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c09afb0 0x7fed8c0ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.877+0000 7fed8b7fe640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 0x7fed8c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.878+0000 7fed83fff640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8c0b4530 0x7fed8c0cb5e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fed7400e960 tx=0x7fed7400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.878+0000 7fed88ff9640 1 -- 172.21.15.132:0/4275244622 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7400ca00 con 0x7fed8c0b4530 2024-03-16T17:48:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.878+0000 7fed88ff9640 1 -- 172.21.15.132:0/4275244622 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7400cb60 con 0x7fed8c0b4530 2024-03-16T17:48:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.878+0000 7fed918c3640 1 -- 172.21.15.132:0/4275244622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c009400 con 0x7fed8c0b4530 2024-03-16T17:48:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.878+0000 7fed88ff9640 1 -- 172.21.15.132:0/4275244622 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74013470 con 0x7fed8c0b4530 2024-03-16T17:48:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.878+0000 7fed918c3640 1 -- 172.21.15.132:0/4275244622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c0b56f0 con 0x7fed8c0b4530 2024-03-16T17:48:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.879+0000 7fed918c3640 1 -- 172.21.15.132:0/4275244622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c04f330 con 0x7fed8c0b4530 2024-03-16T17:48:29.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.880+0000 7fed88ff9640 1 -- 172.21.15.132:0/4275244622 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fed740135d0 con 0x7fed8c0b4530 2024-03-16T17:48:29.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.880+0000 7fed88ff9640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed6c06b3b0 0x7fed6c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.880+0000 7fed88ff9640 1 -- 172.21.15.132:0/4275244622 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed74089e30 con 0x7fed8c0b4530 2024-03-16T17:48:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.880+0000 7fed8affd640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed6c06b3b0 0x7fed6c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.881+0000 7fed8affd640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed6c06b3b0 0x7fed6c06d870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed7c034000 tx=0x7fed7c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:29.884+0000 7fed88ff9640 1 -- 172.21.15.132:0/4275244622 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fed74054b20 con 0x7fed8c0b4530 2024-03-16T17:48:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.099+0000 7fed918c3640 1 -- 172.21.15.132:0/4275244622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fed8c09b7c0 con 0x7fed8c0b4530 2024-03-16T17:48:30.103 INFO:tasks.ceph.mon.a.smithi132.stderr:2024-03-16T17:48:30.100+0000 7f3d65edd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-16T17:48:30.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.103+0000 7fed88ff9640 1 -- 172.21.15.132:0/4275244622 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fed740581e0 con 0x7fed8c0b4530 2024-03-16T17:48:30.106 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-16T17:48:30.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.105+0000 7fed918c3640 1 -- 172.21.15.132:0/4275244622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed6c06b3b0 msgr2=0x7fed6c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:30.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.105+0000 7fed918c3640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed6c06b3b0 0x7fed6c06d870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed7c034000 tx=0x7fed7c008030 comp rx=0 tx=0).stop 2024-03-16T17:48:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.105+0000 7fed918c3640 1 -- 172.21.15.132:0/4275244622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8c0b4530 msgr2=0x7fed8c0cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.105+0000 7fed918c3640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8c0b4530 0x7fed8c0cb5e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fed7400e960 tx=0x7fed7400ee20 comp rx=0 tx=0).stop 2024-03-16T17:48:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.106+0000 7fed918c3640 1 -- 172.21.15.132:0/4275244622 shutdown_connections 2024-03-16T17:48:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.106+0000 7fed918c3640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fed6c06b3b0 0x7fed6c06d870 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed7c034000 tx=0x7fed7c008030 comp rx=0 tx=0).stop 2024-03-16T17:48:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.106+0000 7fed918c3640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed8c0c76f0 0x7fed8c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.106+0000 7fed918c3640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed8c0b4530 0x7fed8c0cb5e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.106+0000 7fed918c3640 1 --2- 172.21.15.132:0/4275244622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed8c09afb0 0x7fed8c0ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.106+0000 7fed918c3640 1 -- 172.21.15.132:0/4275244622 >> 172.21.15.132:0/4275244622 conn(0x7fed8c0d1db0 msgr2=0x7fed8c0d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.106+0000 7fed918c3640 1 -- 172.21.15.132:0/4275244622 shutdown_connections 2024-03-16T17:48:30.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.106+0000 7fed918c3640 1 -- 172.21.15.132:0/4275244622 wait complete. 2024-03-16T17:48:30.114 INFO:tasks.ceph.mds.a.smithi132.stderr: -6829> 2024-03-16T17:47:54.421+0000 7f3e59299640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T17:48:30.124 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-16T17:48:30.147 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2024-03-16T17:48:30.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.224+0000 7fb3e186b640 1 Processor -- start 2024-03-16T17:48:30.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.224+0000 7fb3e186b640 1 -- start start 2024-03-16T17:48:30.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.224+0000 7fb3e186b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3dc15e0e0 0x7fb3dc0d2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:30.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3e186b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3dc15e4c0 0x7fb3dc0d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3e186b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb3dc0b2e20 0x7fb3dc0b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3e186b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0b0db0 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3e186b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0d4db0 con 0x7fb3dc0b2e20 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3e186b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0d1d50 con 0x7fb3dc15e4c0 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3daffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3dc15e0e0 0x7fb3dc0d2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3daffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3dc15e0e0 0x7fb3dc0d2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42954/0 (socket says 172.21.15.132:42954) 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3daffd640 1 -- 172.21.15.132:0/2502132744 learned_addr learned my addr 172.21.15.132:0/2502132744 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3db7fe640 1 --2- 172.21.15.132:0/2502132744 >> v2:172.21.15.194:3300/0 conn(0x7fb3dc0b2e20 0x7fb3dc0b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3daffd640 1 -- 172.21.15.132:0/2502132744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3dc15e4c0 msgr2=0x7fb3dc0d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3daffd640 1 --2- 172.21.15.132:0/2502132744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3dc15e4c0 0x7fb3dc0d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3daffd640 1 -- 172.21.15.132:0/2502132744 >> v2:172.21.15.194:3300/0 conn(0x7fb3dc0b2e20 msgr2=0x7fb3dc0b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3daffd640 1 --2- 172.21.15.132:0/2502132744 >> v2:172.21.15.194:3300/0 conn(0x7fb3dc0b2e20 0x7fb3dc0b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3daffd640 1 -- 172.21.15.132:0/2502132744 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0d2030 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.225+0000 7fb3db7fe640 1 --2- 172.21.15.132:0/2502132744 >> v2:172.21.15.194:3300/0 conn(0x7fb3dc0b2e20 0x7fb3dc0b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3daffd640 1 --2- 172.21.15.132:0/2502132744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 0x7fb3dc0d2390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0b5970 tx=0x7fb3cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c055790957630e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3da7fc640 1 -- 172.21.15.132:0/2502132744 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc031870 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3da7fc640 1 -- 172.21.15.132:0/2502132744 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc0319d0 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3da7fc640 1 -- 172.21.15.132:0/2502132744 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc031d60 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3e186b640 1 -- 172.21.15.132:0/2502132744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 msgr2=0x7fb3dc0d2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3e186b640 1 --2- 172.21.15.132:0/2502132744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 0x7fb3dc0d2390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0b5970 tx=0x7fb3cc02b910 comp rx=0 tx=0).stop 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3e186b640 1 -- 172.21.15.132:0/2502132744 shutdown_connections 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3e186b640 1 --2- 172.21.15.132:0/2502132744 >> v2:172.21.15.194:3300/0 conn(0x7fb3dc0b2e20 0x7fb3dc0b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3e186b640 1 --2- 172.21.15.132:0/2502132744 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3dc15e4c0 0x7fb3dc0d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3e186b640 1 --2- 172.21.15.132:0/2502132744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 0x7fb3dc0d2390 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3e186b640 1 -- 172.21.15.132:0/2502132744 >> 172.21.15.132:0/2502132744 conn(0x7fb3dc0d3ed0 msgr2=0x7fb3dc0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3e186b640 1 -- 172.21.15.132:0/2502132744 shutdown_connections 2024-03-16T17:48:30.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.226+0000 7fb3e186b640 1 -- 172.21.15.132:0/2502132744 wait complete. 2024-03-16T17:48:30.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.228+0000 7fb3e186b640 1 Processor -- start 2024-03-16T17:48:30.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.228+0000 7fb3e186b640 1 -- start start 2024-03-16T17:48:30.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.228+0000 7fb3e186b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc0b2e20 0x7fb3dc153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:30.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.228+0000 7fb3e186b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 0x7fb3dc0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:30.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.228+0000 7fb3e186b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3dc15e4c0 0x7fb3dc15fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:30.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.228+0000 7fb3e186b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc15ea80 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.228+0000 7fb3e186b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc15ed20 con 0x7fb3dc0b2e20 2024-03-16T17:48:30.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.228+0000 7fb3e186b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc15f000 con 0x7fb3dc15e4c0 2024-03-16T17:48:30.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 0x7fb3dc0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:30.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 0x7fb3dc0cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42968/0 (socket says 172.21.15.132:42968) 2024-03-16T17:48:30.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d27fc640 1 -- 172.21.15.132:0/3141354140 learned_addr learned my addr 172.21.15.132:0/3141354140 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:30.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3daffd640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc0b2e20 0x7fb3dc153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:30.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3db7fe640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3dc15e4c0 0x7fb3dc15fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:30.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d27fc640 1 -- 172.21.15.132:0/3141354140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3dc15e4c0 msgr2=0x7fb3dc15fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:30.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d27fc640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3dc15e4c0 0x7fb3dc15fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:30.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d27fc640 1 -- 172.21.15.132:0/3141354140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc0b2e20 msgr2=0x7fb3dc153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:30.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d27fc640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc0b2e20 0x7fb3dc153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:30.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d27fc640 1 -- 172.21.15.132:0/3141354140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc0094d0 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3db7fe640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3dc15e4c0 0x7fb3dc15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:30.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d27fc640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 0x7fb3dc0cc000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400b410 tx=0x7fb3c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:30.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d8ff9640 1 -- 172.21.15.132:0/3141354140 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4011830 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d8ff9640 1 -- 172.21.15.132:0/3141354140 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c40119b0 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3e186b640 1 -- 172.21.15.132:0/3141354140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc15f2e0 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3d8ff9640 1 -- 172.21.15.132:0/3141354140 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4011d60 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.229+0000 7fb3e186b640 1 -- 172.21.15.132:0/3141354140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc0c7c20 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.230+0000 7fb3e186b640 1 -- 172.21.15.132:0/3141354140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc0b11b0 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.231+0000 7fb3d8ff9640 1 -- 172.21.15.132:0/3141354140 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb3c401a400 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.231+0000 7fb3d8ff9640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb3bc06b3b0 0x7fb3bc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.231+0000 7fb3d8ff9640 1 -- 172.21.15.132:0/3141354140 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fb3c4089e00 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.231+0000 7fb3daffd640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb3bc06b3b0 0x7fb3bc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.231+0000 7fb3daffd640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb3bc06b3b0 0x7fb3bc06d870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc036000 tx=0x7fb3cc03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.235+0000 7fb3d8ff9640 1 -- 172.21.15.132:0/3141354140 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb3c4054990 con 0x7fb3dc15e0e0 2024-03-16T17:48:30.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:30.443+0000 7fb3e186b640 1 -- 172.21.15.132:0/3141354140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb3dc068450 con 0x7fb3dc15e0e0 2024-03-16T17:48:31.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.110+0000 7fb3d8ff9640 1 -- 172.21.15.132:0/3141354140 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb3c40150a0 con 0x7fb3dc15e0e0 2024-03-16T17:48:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.113+0000 7fb3e186b640 1 -- 172.21.15.132:0/3141354140 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb3bc06b3b0 msgr2=0x7fb3bc06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.113+0000 7fb3e186b640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb3bc06b3b0 0x7fb3bc06d870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc036000 tx=0x7fb3cc03c040 comp rx=0 tx=0).stop 2024-03-16T17:48:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.113+0000 7fb3e186b640 1 -- 172.21.15.132:0/3141354140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 msgr2=0x7fb3dc0cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.113+0000 7fb3e186b640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 0x7fb3dc0cc000 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400b410 tx=0x7fb3c400b8d0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.113+0000 7fb3e186b640 1 -- 172.21.15.132:0/3141354140 shutdown_connections 2024-03-16T17:48:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.113+0000 7fb3e186b640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb3bc06b3b0 0x7fb3bc06d870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.113+0000 7fb3e186b640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3dc15e4c0 0x7fb3dc15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.113+0000 7fb3e186b640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3dc15e0e0 0x7fb3dc0cc000 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.113+0000 7fb3e186b640 1 --2- 172.21.15.132:0/3141354140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3dc0b2e20 0x7fb3dc153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.113+0000 7fb3e186b640 1 -- 172.21.15.132:0/3141354140 >> 172.21.15.132:0/3141354140 conn(0x7fb3dc0d3ed0 msgr2=0x7fb3dc06b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.114+0000 7fb3e186b640 1 -- 172.21.15.132:0/3141354140 shutdown_connections 2024-03-16T17:48:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.114+0000 7fb3e186b640 1 -- 172.21.15.132:0/3141354140 wait complete. 2024-03-16T17:48:31.129 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-16T17:48:31.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.271+0000 7f74ab1b5640 1 Processor -- start 2024-03-16T17:48:31.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.271+0000 7f74ab1b5640 1 -- start start 2024-03-16T17:48:31.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.272+0000 7f74ab1b5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f74a406efa0 0x7f74a40d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:31.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.272+0000 7f74ab1b5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40d07e0 con 0x7f74a40d21e0 2024-03-16T17:48:31.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.272+0000 7f74ab1b5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a40d2610 con 0x7f74a4161540 2024-03-16T17:48:31.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.272+0000 7f74ab1b5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a40d0a30 con 0x7f74a406efa0 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.272+0000 7f74a9752640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f74a40d21e0 0x7f74a40cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35482/0 (socket says 172.21.15.132:35482) 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.272+0000 7f74a9752640 1 -- 172.21.15.132:0/586877926 learned_addr learned my addr 172.21.15.132:0/586877926 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.272+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859577765 0 0) 0x7f74a40d07e0 con 0x7f74a40d21e0 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.272+0000 7f74a3fff640 1 --2- 172.21.15.132:0/586877926 >> v2:172.21.15.194:3300/0 conn(0x7f74a406efa0 0x7f74a40d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.272+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f748c003520 con 0x7f74a40d21e0 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965791377 0 0) 0x7f748c003520 con 0x7f74a40d21e0 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 >> v2:172.21.15.194:3300/0 conn(0x7f74a406efa0 msgr2=0x7f74a40d1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 --2- 172.21.15.132:0/586877926 >> v2:172.21.15.194:3300/0 conn(0x7f74a406efa0 0x7f74a40d1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 >> v1:172.21.15.194:6789/0 conn(0x7f74a4161540 legacy=0x7f74a406f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40d0d10 con 0x7f74a40d21e0 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f749c0019f0 con 0x7f74a40d21e0 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 >> v1:172.21.15.132:6789/0 conn(0x7f74a40d21e0 legacy=0x7f74a40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c003970 0x7f748c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:31.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f748c0047c0 0x7f748c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f748c005180 0x7f748c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40d0a30 con 0x7f748c003970 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c00c0d0 con 0x7f748c005180 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c00c290 con 0x7f748c0047c0 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a8f51640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c003970 0x7f748c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a9752640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f748c005180 0x7f748c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a3fff640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f748c0047c0 0x7f748c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a8f51640 1 -- 172.21.15.132:0/586877926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f748c0047c0 msgr2=0x7f748c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a8f51640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f748c0047c0 0x7f748c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a8f51640 1 -- 172.21.15.132:0/586877926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f748c005180 msgr2=0x7f748c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a8f51640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f748c005180 0x7f748c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a8f51640 1 -- 172.21.15.132:0/586877926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c003520 con 0x7f748c003970 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.273+0000 7f74a9752640 1 -- 172.21.15.132:0/586877926 reap_dead start 2024-03-16T17:48:31.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.274+0000 7f74a8f51640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c003970 0x7f748c003d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7494001750 tx=0x7f748c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4a9e81fcb1157f server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.274+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940052d0 con 0x7f748c003970 2024-03-16T17:48:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.274+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749402e050 con 0x7f748c003970 2024-03-16T17:48:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.274+0000 7f74a37fe640 1 -- 172.21.15.132:0/586877926 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494003830 con 0x7f748c003970 2024-03-16T17:48:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.274+0000 7f74ab1b5640 1 -- 172.21.15.132:0/586877926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c003970 msgr2=0x7f748c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.274+0000 7f74ab1b5640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c003970 0x7f748c003d90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7494001750 tx=0x7f748c0057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.274+0000 7f74ab1b5640 1 -- 172.21.15.132:0/586877926 shutdown_connections 2024-03-16T17:48:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.274+0000 7f74ab1b5640 1 --2- 172.21.15.132:0/586877926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c003970 0x7f748c003d90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.275+0000 7f74ab1b5640 1 -- 172.21.15.132:0/586877926 >> 172.21.15.132:0/586877926 conn(0x7f74a409aa70 msgr2=0x7f74a409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.275+0000 7f74ab1b5640 1 -- 172.21.15.132:0/586877926 shutdown_connections 2024-03-16T17:48:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.275+0000 7f74ab1b5640 1 -- 172.21.15.132:0/586877926 wait complete. 2024-03-16T17:48:31.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.276+0000 7f74ab1b5640 1 Processor -- start 2024-03-16T17:48:31.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.276+0000 7f74ab1b5640 1 -- start start 2024-03-16T17:48:31.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.276+0000 7f74ab1b5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f748c003970 0x7f74a40b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:31.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.276+0000 7f74ab1b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a40cb5c0 0x7f74a41551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:31.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74ab1b5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40c5d70 0x7f74a40cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74ab1b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40b4fb0 con 0x7f74a40cb5c0 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74ab1b5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40b5290 con 0x7f74a40c5d70 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74ab1b5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a40b5570 con 0x7f748c003970 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a40cb5c0 0x7f74a41551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a40cb5c0 0x7f74a41551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42984/0 (socket says 172.21.15.132:42984) 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a3fff640 1 -- 172.21.15.132:0/1211041128 learned_addr learned my addr 172.21.15.132:0/1211041128 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a9752640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40c5d70 0x7f74a40cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a8f51640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f748c003970 0x7f74a40b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a3fff640 1 -- 172.21.15.132:0/1211041128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f748c003970 msgr2=0x7f74a40b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a3fff640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f748c003970 0x7f74a40b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a3fff640 1 -- 172.21.15.132:0/1211041128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40c5d70 msgr2=0x7f74a40cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a3fff640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40c5d70 0x7f74a40cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a3fff640 1 -- 172.21.15.132:0/1211041128 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40b5850 con 0x7f74a40cb5c0 2024-03-16T17:48:31.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a9752640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40c5d70 0x7f74a40cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a8f51640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f748c003970 0x7f74a40b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a3fff640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a40cb5c0 0x7f74a41551d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f749800f5a0 tx=0x7f749800fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a17fa640 1 -- 172.21.15.132:0/1211041128 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498014870 con 0x7f74a40cb5c0 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a17fa640 1 -- 172.21.15.132:0/1211041128 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74980149d0 con 0x7f74a40cb5c0 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74ab1b5640 1 -- 172.21.15.132:0/1211041128 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a40b5b30 con 0x7f74a40cb5c0 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74a17fa640 1 -- 172.21.15.132:0/1211041128 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498014d40 con 0x7f74a40cb5c0 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.277+0000 7f74ab1b5640 1 -- 172.21.15.132:0/1211041128 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a40cba40 con 0x7f74a40cb5c0 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.278+0000 7f74ab1b5640 1 -- 172.21.15.132:0/1211041128 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a409ff60 con 0x7f74a40cb5c0 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.279+0000 7f74a17fa640 1 -- 172.21.15.132:0/1211041128 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f7498015410 con 0x7f74a40cb5c0 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.279+0000 7f74a17fa640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f749006b3e0 0x7f749006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.279+0000 7f74a8f51640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f749006b3e0 0x7f749006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.279+0000 7f74a17fa640 1 -- 172.21.15.132:0/1211041128 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f749808a520 con 0x7f74a40cb5c0 2024-03-16T17:48:31.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.280+0000 7f74a8f51640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f749006b3e0 0x7f749006d8a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7494033000 tx=0x7f7494009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:31.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.284+0000 7f74a17fa640 1 -- 172.21.15.132:0/1211041128 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7498055140 con 0x7f74a40cb5c0 2024-03-16T17:48:31.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:31.456+0000 7f74ab1b5640 1 -- 172.21.15.132:0/1211041128 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f74a404f330 con 0x7f74a40cb5c0 2024-03-16T17:48:32.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.112+0000 7f74a17fa640 1 -- 172.21.15.132:0/1211041128 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7498058800 con 0x7f74a40cb5c0 2024-03-16T17:48:32.116 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2024-03-16T17:48:32.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 -- 172.21.15.132:0/1211041128 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f749006b3e0 msgr2=0x7f749006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:32.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f749006b3e0 0x7f749006d8a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7494033000 tx=0x7f7494009030 comp rx=0 tx=0).stop 2024-03-16T17:48:32.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 -- 172.21.15.132:0/1211041128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a40cb5c0 msgr2=0x7f74a41551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:32.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a40cb5c0 0x7f74a41551d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f749800f5a0 tx=0x7f749800fa60 comp rx=0 tx=0).stop 2024-03-16T17:48:32.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 -- 172.21.15.132:0/1211041128 shutdown_connections 2024-03-16T17:48:32.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f749006b3e0 0x7f749006d8a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74a40c5d70 0x7f74a40cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74a40cb5c0 0x7f74a41551d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 --2- 172.21.15.132:0/1211041128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f748c003970 0x7f74a40b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 -- 172.21.15.132:0/1211041128 >> 172.21.15.132:0/1211041128 conn(0x7f74a409aa70 msgr2=0x7f74a40ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:32.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 -- 172.21.15.132:0/1211041128 shutdown_connections 2024-03-16T17:48:32.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.115+0000 7f74ab1b5640 1 -- 172.21.15.132:0/1211041128 wait complete. 2024-03-16T17:48:32.132 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-16T17:48:32.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.236+0000 7f0a4d2c9640 1 Processor -- start 2024-03-16T17:48:32.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.236+0000 7f0a4d2c9640 1 -- start start 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.237+0000 7f0a4d2c9640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0a48072760 0x7f0a4815e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.237+0000 7f0a4d2c9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a480b5cb0 con 0x7f0a480b3b50 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.237+0000 7f0a4d2c9640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a480b53c0 con 0x7f0a4806aee0 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.237+0000 7f0a4d2c9640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a48073020 con 0x7f0a48072760 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.237+0000 7f0a467fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0a480b3b50 0x7f0a4815e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35494/0 (socket says 172.21.15.132:35494) 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.237+0000 7f0a467fc640 1 -- 172.21.15.132:0/429912427 learned_addr learned my addr 172.21.15.132:0/429912427 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125674863 0 0) 0x7f0a480b5cb0 con 0x7f0a480b3b50 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a30003520 con 0x7f0a480b3b50 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a477fe640 1 --2- 172.21.15.132:0/429912427 >> v2:172.21.15.194:3300/0 conn(0x7f0a48072760 0x7f0a4815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1267391628 0 0) 0x7f0a30003520 con 0x7f0a480b3b50 2024-03-16T17:48:32.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 >> v2:172.21.15.194:3300/0 conn(0x7f0a48072760 msgr2=0x7f0a4815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 --2- 172.21.15.132:0/429912427 >> v2:172.21.15.194:3300/0 conn(0x7f0a48072760 0x7f0a4815e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 >> v1:172.21.15.194:6789/0 conn(0x7f0a4806aee0 legacy=0x7f0a4806b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48072d40 con 0x7f0a480b3b50 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f0a3c001670 con 0x7f0a480b3b50 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 >> v1:172.21.15.132:6789/0 conn(0x7f0a480b3b50 legacy=0x7f0a4815e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a30003970 0x7f0a30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a300047c0 0x7f0a30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a300052a0 0x7f0a3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a48073020 con 0x7f0a30003970 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3000c170 con 0x7f0a300052a0 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3000c330 con 0x7f0a300047c0 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a46ffd640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a30003970 0x7f0a30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a477fe640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a300052a0 0x7f0a3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:32.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a467fc640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a300047c0 0x7f0a30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a46ffd640 1 -- 172.21.15.132:0/429912427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a300047c0 msgr2=0x7f0a30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a46ffd640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a300047c0 0x7f0a30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a46ffd640 1 -- 172.21.15.132:0/429912427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a300052a0 msgr2=0x7f0a3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a46ffd640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a300052a0 0x7f0a3000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a477fe640 1 -- 172.21.15.132:0/429912427 reap_dead start 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.238+0000 7f0a46ffd640 1 -- 172.21.15.132:0/429912427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30003520 con 0x7f0a30003970 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.239+0000 7f0a46ffd640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a30003970 0x7f0a30003d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0a38001e20 tx=0x7f0a300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255f498a90301a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.239+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38003b70 con 0x7f0a30003970 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.239+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a38003cd0 con 0x7f0a30003970 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.239+0000 7f0a45ffb640 1 -- 172.21.15.132:0/429912427 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38005310 con 0x7f0a30003970 2024-03-16T17:48:32.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.240+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/429912427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a30003970 msgr2=0x7f0a30003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:32.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.240+0000 7f0a4d2c9640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a30003970 0x7f0a30003d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0a38001e20 tx=0x7f0a300057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.240+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/429912427 shutdown_connections 2024-03-16T17:48:32.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.240+0000 7f0a4d2c9640 1 --2- 172.21.15.132:0/429912427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a30003970 0x7f0a30003d90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.240+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/429912427 >> 172.21.15.132:0/429912427 conn(0x7f0a480b2850 msgr2=0x7f0a480b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:32.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.240+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/429912427 shutdown_connections 2024-03-16T17:48:32.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.240+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/429912427 wait complete. 2024-03-16T17:48:32.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.241+0000 7f0a4d2c9640 1 Processor -- start 2024-03-16T17:48:32.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.241+0000 7f0a4d2c9640 1 -- start start 2024-03-16T17:48:32.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a4d2c9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a30003970 0x7f0a4815a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:32.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a4d2c9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a4815ec40 0x7f0a481f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:32.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a4d2c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a481f5570 0x7f0a4815c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:32.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a4d2c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4815a9a0 con 0x7f0a481f5570 2024-03-16T17:48:32.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a4d2c9640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481e6860 con 0x7f0a4815ec40 2024-03-16T17:48:32.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a4d2c9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a481e6b40 con 0x7f0a30003970 2024-03-16T17:48:32.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a481f5570 0x7f0a4815c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a481f5570 0x7f0a4815c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42998/0 (socket says 172.21.15.132:42998) 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a477fe640 1 -- 172.21.15.132:0/2926870924 learned_addr learned my addr 172.21.15.132:0/2926870924 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a46ffd640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a30003970 0x7f0a4815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a467fc640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a4815ec40 0x7f0a481f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a477fe640 1 -- 172.21.15.132:0/2926870924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a30003970 msgr2=0x7f0a4815a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a477fe640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a30003970 0x7f0a4815a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a477fe640 1 -- 172.21.15.132:0/2926870924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a4815ec40 msgr2=0x7f0a481f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a477fe640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a4815ec40 0x7f0a481f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a477fe640 1 -- 172.21.15.132:0/2926870924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a481e6e20 con 0x7f0a481f5570 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a477fe640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a481f5570 0x7f0a4815c590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0a480ce870 tx=0x7f0a4000bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a2f7fe640 1 -- 172.21.15.132:0/2926870924 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40010780 con 0x7f0a481f5570 2024-03-16T17:48:32.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a2f7fe640 1 -- 172.21.15.132:0/2926870924 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40010900 con 0x7f0a481f5570 2024-03-16T17:48:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.242+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/2926870924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a481e7100 con 0x7f0a481f5570 2024-03-16T17:48:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.243+0000 7f0a2f7fe640 1 -- 172.21.15.132:0/2926870924 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40010cb0 con 0x7f0a481f5570 2024-03-16T17:48:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.243+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/2926870924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4815fab0 con 0x7f0a481f5570 2024-03-16T17:48:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.243+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/2926870924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a481e7620 con 0x7f0a481f5570 2024-03-16T17:48:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.244+0000 7f0a2f7fe640 1 -- 172.21.15.132:0/2926870924 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f0a40014430 con 0x7f0a481f5570 2024-03-16T17:48:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.244+0000 7f0a2f7fe640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a3406b3b0 0x7f0a3406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.244+0000 7f0a46ffd640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a3406b3b0 0x7f0a3406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.244+0000 7f0a2f7fe640 1 -- 172.21.15.132:0/2926870924 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f0a40089da0 con 0x7f0a481f5570 2024-03-16T17:48:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.245+0000 7f0a46ffd640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a3406b3b0 0x7f0a3406d870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a38034000 tx=0x7f0a3803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:32.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.249+0000 7f0a2f7fe640 1 -- 172.21.15.132:0/2926870924 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0a481e7620 con 0x7f0a481f5570 2024-03-16T17:48:32.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:32.420+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/2926870924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a481e7620 con 0x7f0a481f5570 2024-03-16T17:48:33.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.117+0000 7f0a2f7fe640 1 -- 172.21.15.132:0/2926870924 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0a481e7620 con 0x7f0a481f5570 2024-03-16T17:48:33.121 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2024-03-16T17:48:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.120+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/2926870924 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a3406b3b0 msgr2=0x7f0a3406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.120+0000 7f0a4d2c9640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a3406b3b0 0x7f0a3406d870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a38034000 tx=0x7f0a3803b040 comp rx=0 tx=0).stop 2024-03-16T17:48:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.120+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/2926870924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a481f5570 msgr2=0x7f0a4815c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.120+0000 7f0a4d2c9640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a481f5570 0x7f0a4815c590 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0a480ce870 tx=0x7f0a4000bb80 comp rx=0 tx=0).stop 2024-03-16T17:48:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.120+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/2926870924 shutdown_connections 2024-03-16T17:48:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.120+0000 7f0a4d2c9640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0a3406b3b0 0x7f0a3406d870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:33.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.120+0000 7f0a4d2c9640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a481f5570 0x7f0a4815c590 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:33.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.120+0000 7f0a4d2c9640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a4815ec40 0x7f0a481f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:33.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.121+0000 7f0a4d2c9640 1 --2- 172.21.15.132:0/2926870924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a30003970 0x7f0a4815a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:33.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.121+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/2926870924 >> 172.21.15.132:0/2926870924 conn(0x7f0a480b2850 msgr2=0x7f0a480ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:33.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.121+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/2926870924 shutdown_connections 2024-03-16T17:48:33.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:33.121+0000 7f0a4d2c9640 1 -- 172.21.15.132:0/2926870924 wait complete. 2024-03-16T17:48:33.138 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-16T17:48:33.138 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-16T17:48:33.138 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-16T17:48:33.138 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T17:48:33.139 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-16T17:48:33.139 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-16T17:48:33.139 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-16T17:48:33.139 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T17:48:33.139 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-16T17:48:33.139 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-16T17:48:33.139 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-16T17:48:33.139 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T17:48:33.140 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-16T17:48:33.140 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-16T17:48:33.140 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-16T17:48:33.140 INFO:teuthology.orchestra.run:waiting for 300 2024-03-16T17:48:33.152 INFO:tasks.ceph.mds.d:Stopped 2024-03-16T17:48:33.152 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-16T17:48:33.153 INFO:tasks.ceph.mds.c:Stopped 2024-03-16T17:48:33.153 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-16T17:48:33.154 INFO:tasks.ceph.mds.b:Stopped 2024-03-16T17:48:33.154 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-16T17:48:33.196 INFO:tasks.ceph.mds.c:Started 2024-03-16T17:48:33.196 INFO:tasks.ceph.mds.d:Started 2024-03-16T17:48:33.197 DEBUG:teuthology.parallel:result is None 2024-03-16T17:48:33.197 DEBUG:teuthology.parallel:result is None 2024-03-16T17:48:33.197 INFO:tasks.ceph.mds.b:Started 2024-03-16T17:48:33.197 DEBUG:teuthology.parallel:result is None 2024-03-16T17:48:33.272 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2024-03-16T17:48:33.277 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-03-16T17:48:33.278 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-03-16T17:48:35.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-03-16T17:48:39.152 INFO:tasks.ceph.mds.a:Stopped 2024-03-16T17:48:39.152 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-16T17:48:39.156 INFO:tasks.ceph.mds.a:Started 2024-03-16T17:48:39.156 DEBUG:teuthology.parallel:result is None 2024-03-16T17:48:39.156 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-16T17:48:39.242 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2024-03-16T17:48:39.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.264+0000 7f0217181640 1 Processor -- start 2024-03-16T17:48:39.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.264+0000 7f0217181640 1 -- start start 2024-03-16T17:48:39.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.265+0000 7f0217181640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f021015be40 0x7f021009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:39.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.265+0000 7f0217181640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f02100b2f50 0x7f021009afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:39.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.265+0000 7f0217181640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021015c220 con 0x7f02100c6d50 2024-03-16T17:48:39.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.265+0000 7f0217181640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02100b1850 con 0x7f021015be40 2024-03-16T17:48:39.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.265+0000 7f0217181640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02100b1b30 con 0x7f02100b2f50 2024-03-16T17:48:39.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.265+0000 7f0214f1d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f021015be40 0x7f021009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:39.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.265+0000 7f0214f1d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f021015be40 0x7f021009aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56296/0 (socket says 172.21.15.132:56296) 2024-03-16T17:48:39.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.265+0000 7f0214f1d640 1 -- 172.21.15.132:0/649722291 learned_addr learned my addr 172.21.15.132:0/649722291 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:39.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.265+0000 7f021571e640 1 --2- 172.21.15.132:0/649722291 >> v2:172.21.15.194:3300/0 conn(0x7f02100b2f50 0x7f021009afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:39.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.266+0000 7f0214f1d640 1 -- 172.21.15.132:0/649722291 >> v2:172.21.15.194:3300/0 conn(0x7f02100b2f50 msgr2=0x7f021009afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:39.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.266+0000 7f0214f1d640 1 --2- 172.21.15.132:0/649722291 >> v2:172.21.15.194:3300/0 conn(0x7f02100b2f50 0x7f021009afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:39.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.266+0000 7f0214f1d640 1 -- 172.21.15.132:0/649722291 >> v1:172.21.15.194:6789/0 conn(0x7f02100c6d50 legacy=0x7f021015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:39.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.266+0000 7f0214f1d640 1 -- 172.21.15.132:0/649722291 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100d08c0 con 0x7f021015be40 2024-03-16T17:48:39.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.266+0000 7f0214f1d640 1 --2- 172.21.15.132:0/649722291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f021015be40 0x7f021009aa70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f02100b49b0 tx=0x7f020002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedd3528de29306a server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:39.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.266+0000 7f020f7fe640 1 -- 172.21.15.132:0/649722291 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200030860 con 0x7f021015be40 2024-03-16T17:48:39.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.267+0000 7f020f7fe640 1 -- 172.21.15.132:0/649722291 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02000309c0 con 0x7f021015be40 2024-03-16T17:48:39.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.267+0000 7f020f7fe640 1 -- 172.21.15.132:0/649722291 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200030d50 con 0x7f021015be40 2024-03-16T17:48:39.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.267+0000 7f0217181640 1 -- 172.21.15.132:0/649722291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f021015be40 msgr2=0x7f021009aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.267+0000 7f0217181640 1 --2- 172.21.15.132:0/649722291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f021015be40 0x7f021009aa70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f02100b49b0 tx=0x7f020002b9a0 comp rx=0 tx=0).stop 2024-03-16T17:48:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.267+0000 7f0217181640 1 -- 172.21.15.132:0/649722291 shutdown_connections 2024-03-16T17:48:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.267+0000 7f0217181640 1 --2- 172.21.15.132:0/649722291 >> v2:172.21.15.194:3300/0 conn(0x7f02100b2f50 0x7f021009afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.267+0000 7f0217181640 1 --2- 172.21.15.132:0/649722291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f021015be40 0x7f021009aa70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.267+0000 7f0217181640 1 -- 172.21.15.132:0/649722291 >> 172.21.15.132:0/649722291 conn(0x7f02100d1db0 msgr2=0x7f02100d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.267+0000 7f0217181640 1 -- 172.21.15.132:0/649722291 shutdown_connections 2024-03-16T17:48:39.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.267+0000 7f0217181640 1 -- 172.21.15.132:0/649722291 wait complete. 2024-03-16T17:48:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.268+0000 7f0217181640 1 Processor -- start 2024-03-16T17:48:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.268+0000 7f0217181640 1 -- start start 2024-03-16T17:48:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0217181640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02100b2f50 0x7f02101f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0217181640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02100c6d50 0x7f02100b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0217181640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f021015be40 0x7f021015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0217181640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c9140 con 0x7f02100b2f50 2024-03-16T17:48:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0217181640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c9420 con 0x7f02100c6d50 2024-03-16T17:48:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0217181640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100c9700 con 0x7f021015be40 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0214f1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02100b2f50 0x7f02101f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0214f1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02100b2f50 0x7f02101f1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56308/0 (socket says 172.21.15.132:56308) 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0214f1d640 1 -- 172.21.15.132:0/441266984 learned_addr learned my addr 172.21.15.132:0/441266984 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f021571e640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f021015be40 0x7f021015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f020ffff640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02100c6d50 0x7f02100b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0214f1d640 1 -- 172.21.15.132:0/441266984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f021015be40 msgr2=0x7f021015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0214f1d640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f021015be40 0x7f021015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0214f1d640 1 -- 172.21.15.132:0/441266984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02100c6d50 msgr2=0x7f02100b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.269+0000 7f0214f1d640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02100c6d50 0x7f02100b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.270+0000 7f0214f1d640 1 -- 172.21.15.132:0/441266984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02000094d0 con 0x7f02100b2f50 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.270+0000 7f020ffff640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02100c6d50 0x7f02100b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.270+0000 7f0214f1d640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02100b2f50 0x7f02101f1de0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f020002b9e0 tx=0x7f0200004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:39.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.270+0000 7f020d7fa640 1 -- 172.21.15.132:0/441266984 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200039b60 con 0x7f02100b2f50 2024-03-16T17:48:39.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.270+0000 7f020d7fa640 1 -- 172.21.15.132:0/441266984 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200039ce0 con 0x7f02100b2f50 2024-03-16T17:48:39.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.270+0000 7f0217181640 1 -- 172.21.15.132:0/441266984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02100c99e0 con 0x7f02100b2f50 2024-03-16T17:48:39.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.270+0000 7f020d7fa640 1 -- 172.21.15.132:0/441266984 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0200043650 con 0x7f02100b2f50 2024-03-16T17:48:39.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.270+0000 7f0217181640 1 -- 172.21.15.132:0/441266984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021015dda0 con 0x7f02100b2f50 2024-03-16T17:48:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.271+0000 7f0217181640 1 -- 172.21.15.132:0/441266984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02100c9f00 con 0x7f02100b2f50 2024-03-16T17:48:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.271+0000 7f020d7fa640 1 -- 172.21.15.132:0/441266984 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f020004c3b0 con 0x7f02100b2f50 2024-03-16T17:48:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.272+0000 7f020d7fa640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01fc06b3b0 0x7f01fc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.272+0000 7f020d7fa640 1 -- 172.21.15.132:0/441266984 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f02000abd60 con 0x7f02100b2f50 2024-03-16T17:48:39.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.272+0000 7f020ffff640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01fc06b3b0 0x7f01fc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:39.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.272+0000 7f020ffff640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01fc06b3b0 0x7f01fc06d870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f021015b850 tx=0x7f0204009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.276+0000 7f020d7fa640 1 -- 172.21.15.132:0/441266984 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f02100c9f00 con 0x7f02100b2f50 2024-03-16T17:48:39.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:39.457+0000 7f0217181640 1 -- 172.21.15.132:0/441266984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f02100c9f00 con 0x7f02100b2f50 2024-03-16T17:48:41.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.149+0000 7f020d7fa640 1 -- 172.21.15.132:0/441266984 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f02100c9f00 con 0x7f02100b2f50 2024-03-16T17:48:41.153 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2024-03-16T17:48:41.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 -- 172.21.15.132:0/441266984 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01fc06b3b0 msgr2=0x7f01fc06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01fc06b3b0 0x7f01fc06d870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f021015b850 tx=0x7f0204009040 comp rx=0 tx=0).stop 2024-03-16T17:48:41.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 -- 172.21.15.132:0/441266984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02100b2f50 msgr2=0x7f02101f1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02100b2f50 0x7f02101f1de0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f020002b9e0 tx=0x7f0200004730 comp rx=0 tx=0).stop 2024-03-16T17:48:41.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 -- 172.21.15.132:0/441266984 shutdown_connections 2024-03-16T17:48:41.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01fc06b3b0 0x7f01fc06d870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f021015be40 0x7f021015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02100c6d50 0x7f02100b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 --2- 172.21.15.132:0/441266984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f02100b2f50 0x7f02101f1de0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 -- 172.21.15.132:0/441266984 >> 172.21.15.132:0/441266984 conn(0x7f02100d1db0 msgr2=0x7f02100cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:41.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 -- 172.21.15.132:0/441266984 shutdown_connections 2024-03-16T17:48:41.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.152+0000 7f0217181640 1 -- 172.21.15.132:0/441266984 wait complete. 2024-03-16T17:48:41.170 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-16T17:48:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.272+0000 7f5868afb640 1 Processor -- start 2024-03-16T17:48:41.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.272+0000 7f5868afb640 1 -- start start 2024-03-16T17:48:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f5868afb640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f58640aeee0 0x7f58640af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f5868afb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f586415e5b0 0x7f58640ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f5868afb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586415bf20 con 0x7f5864161ac0 2024-03-16T17:48:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f5868afb640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58640af800 con 0x7f58640aeee0 2024-03-16T17:48:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f5868afb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58640ae1e0 con 0x7f586415e5b0 2024-03-16T17:48:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f5862d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5864161ac0 0x7f5864161f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55930/0 (socket says 172.21.15.132:55930) 2024-03-16T17:48:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f5862d9d640 1 -- 172.21.15.132:0/1897034376 learned_addr learned my addr 172.21.15.132:0/1897034376 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584737646 0 0) 0x7f586415bf20 con 0x7f5864161ac0 2024-03-16T17:48:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f584c003520 con 0x7f5864161ac0 2024-03-16T17:48:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f5861d9b640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f586415e5b0 0x7f58640ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.273+0000 7f586259c640 1 --2- 172.21.15.132:0/1897034376 >> v2:172.21.15.194:3300/0 conn(0x7f58640aeee0 0x7f58640af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3956646733 0 0) 0x7f584c003520 con 0x7f5864161ac0 2024-03-16T17:48:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f586415e5b0 msgr2=0x7f58640ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f586415e5b0 0x7f58640ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 >> v2:172.21.15.194:3300/0 conn(0x7f58640aeee0 msgr2=0x7f58640af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 --2- 172.21.15.132:0/1897034376 >> v2:172.21.15.194:3300/0 conn(0x7f58640aeee0 0x7f58640af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58640ae4c0 con 0x7f5864161ac0 2024-03-16T17:48:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f585c001670 con 0x7f5864161ac0 2024-03-16T17:48:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f5861d9b640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f586415e5b0 0x7f58640ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 >> v1:172.21.15.132:6789/0 conn(0x7f5864161ac0 legacy=0x7f5864161f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f586415e5b0 0x7f584c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f584c003eb0 0x7f584c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f584c004d00 0x7f584c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58640af800 con 0x7f584c003eb0 2024-03-16T17:48:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58640ae1e0 con 0x7f584c004d00 2024-03-16T17:48:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c00b9b0 con 0x7f586415e5b0 2024-03-16T17:48:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f5861d9b640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f584c003eb0 0x7f584c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f586259c640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f586415e5b0 0x7f584c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f5862d9d640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f584c004d00 0x7f584c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f5861d9b640 1 -- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f586415e5b0 msgr2=0x7f584c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f5861d9b640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f586415e5b0 0x7f584c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f5861d9b640 1 -- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f584c004d00 msgr2=0x7f584c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f5861d9b640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f584c004d00 0x7f584c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f5861d9b640 1 -- 172.21.15.132:0/1897034376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c003520 con 0x7f584c003eb0 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.274+0000 7f5862d9d640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f584c004d00 0x7f584c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.275+0000 7f5861d9b640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f584c003eb0 0x7f584c0047c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f586415e9f0 tx=0x7f584c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b05924f497c6ddb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.275+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858004030 con 0x7f584c003eb0 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.275+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858004190 con 0x7f584c003eb0 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.275+0000 7f586159a640 1 -- 172.21.15.132:0/1897034376 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858003610 con 0x7f584c003eb0 2024-03-16T17:48:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.276+0000 7f5868afb640 1 -- 172.21.15.132:0/1897034376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f584c003eb0 msgr2=0x7f584c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.276+0000 7f5868afb640 1 --2- 172.21.15.132:0/1897034376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f584c003eb0 0x7f584c0047c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f586415e9f0 tx=0x7f584c0057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.276+0000 7f5862d9d640 1 -- 172.21.15.132:0/1897034376 reap_dead start 2024-03-16T17:48:41.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.276+0000 7f5868afb640 1 -- 172.21.15.132:0/1897034376 shutdown_connections 2024-03-16T17:48:41.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.276+0000 7f5868afb640 1 -- 172.21.15.132:0/1897034376 >> 172.21.15.132:0/1897034376 conn(0x7f5864072370 msgr2=0x7f586406aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:41.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.276+0000 7f5868afb640 1 -- 172.21.15.132:0/1897034376 shutdown_connections 2024-03-16T17:48:41.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.276+0000 7f5868afb640 1 -- 172.21.15.132:0/1897034376 wait complete. 2024-03-16T17:48:41.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.277+0000 7f5868afb640 1 Processor -- start 2024-03-16T17:48:41.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.277+0000 7f5868afb640 1 -- start start 2024-03-16T17:48:41.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5868afb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584c003eb0 0x7f58640c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5868afb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58641473f0 0x7f5864147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5868afb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5864159360 0x7f58641597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5868afb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864147db0 con 0x7f58641473f0 2024-03-16T17:48:41.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5868afb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864159d20 con 0x7f5864159360 2024-03-16T17:48:41.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5868afb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5864159fe0 con 0x7f584c003eb0 2024-03-16T17:48:41.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5861d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58641473f0 0x7f5864147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5861d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58641473f0 0x7f5864147870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56332/0 (socket says 172.21.15.132:56332) 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5861d9b640 1 -- 172.21.15.132:0/1528801812 learned_addr learned my addr 172.21.15.132:0/1528801812 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f586259c640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584c003eb0 0x7f58640c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5862d9d640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5864159360 0x7f58641597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5861d9b640 1 -- 172.21.15.132:0/1528801812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584c003eb0 msgr2=0x7f58640c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5861d9b640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584c003eb0 0x7f58640c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5861d9b640 1 -- 172.21.15.132:0/1528801812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5864159360 msgr2=0x7f58641597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5861d9b640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5864159360 0x7f58641597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5861d9b640 1 -- 172.21.15.132:0/1528801812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586415a2c0 con 0x7f58641473f0 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5861d9b640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58641473f0 0x7f5864147870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5858009990 tx=0x7f5858004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.278+0000 7f5852ffd640 1 -- 172.21.15.132:0/1528801812 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858030600 con 0x7f58641473f0 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.279+0000 7f5852ffd640 1 -- 172.21.15.132:0/1528801812 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585803e040 con 0x7f58641473f0 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.279+0000 7f5852ffd640 1 -- 172.21.15.132:0/1528801812 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58580309c0 con 0x7f58641473f0 2024-03-16T17:48:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.279+0000 7f5868afb640 1 -- 172.21.15.132:0/1528801812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58641480e0 con 0x7f58641473f0 2024-03-16T17:48:41.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.279+0000 7f5868afb640 1 -- 172.21.15.132:0/1528801812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58641486a0 con 0x7f58641473f0 2024-03-16T17:48:41.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.279+0000 7f5868afb640 1 -- 172.21.15.132:0/1528801812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5864069090 con 0x7f58641473f0 2024-03-16T17:48:41.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.280+0000 7f5852ffd640 1 -- 172.21.15.132:0/1528801812 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f5858030b20 con 0x7f58641473f0 2024-03-16T17:48:41.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.280+0000 7f5852ffd640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f584406b3b0 0x7f584406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.280+0000 7f5852ffd640 1 -- 172.21.15.132:0/1528801812 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f58580ab9d0 con 0x7f58641473f0 2024-03-16T17:48:41.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.280+0000 7f586259c640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f584406b3b0 0x7f584406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.281+0000 7f586259c640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f584406b3b0 0x7f584406d870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5854014510 tx=0x7f585400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:41.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.285+0000 7f5852ffd640 1 -- 172.21.15.132:0/1528801812 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f58580769a0 con 0x7f58641473f0 2024-03-16T17:48:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.521+0000 7f5868afb640 1 -- 172.21.15.132:0/1528801812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5864147db0 con 0x7f58641473f0 2024-03-16T17:48:41.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.521+0000 7f5852ffd640 1 -- 172.21.15.132:0/1528801812 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f585802d030 con 0x7f58641473f0 2024-03-16T17:48:41.525 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:41.525 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-03-16T17:48:41.525 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2024-03-16T17:48:41.525 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAG2/Vl4CMuMhAA9NdmGeYftVEVAbhCUJEidQ==", 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAH2/Vl9pbpAhAAa6NQnLmbmJIvZPf4jn1sLg==", 2024-03-16T17:48:41.526 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAG2/VllOKCORAAagGjMzQ38qanc7gww2ypjA==", 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.527 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAH2/Vlr9pWChAAqXDm8Tb9n2kZ/Dg/OzN3CQ==", 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2024-03-16T17:48:41.528 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAK2/VlkXDDLRAAZsQioGChlGJYXuY89ZhxgQ==", 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAN2/Vl456ILBAA5SLwljrQp+Hge43FsLw4YQ==", 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-03-16T17:48:41.529 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAQ2/VltJY0KhAATV2W2h7iHcLZzGl+nbhmQg==", 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.530 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAT2/VlV0KzKBAAYzKEfhcEEtzwjsGllQpH9w==", 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAZ2/VlcJBaMRAAAdupT2n2z53jLy+zmzaJ6Q==", 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-03-16T17:48:41.531 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAc2/Vla03nLxAAMgPqF1hNrj9lwVDvG2IbAA==", 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2024-03-16T17:48:41.532 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAf2/VlVtT8LRAA7RAWt4BbJMSu+hJzHG/X2w==", 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAi2/VlnSwlLBAAn1wtfnD32HpNiEnauLgsqg==", 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAH2/VlI+SXDhAAVkJdiLaLBWETaZXg7PjHcA==", 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAH2/Vl2EzeFxAA7n8FBuJF7nyUn+tUcScuVA==", 2024-03-16T17:48:41.534 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAH2/VlGStpFBAAMVVAIc0oS3PA+J8JDjOrHQ==", 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2024-03-16T17:48:41.535 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAH2/VlKz3HHRAAwpGVMTcNVWyLF7Ns40dIZQ==", 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2024-03-16T17:48:41.536 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA==", 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-mds", 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAt2/Vln/VDJxAATCjbgajUsrzQggSObqRfrg==", 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-mds" 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-mgr", 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAt2/VlZ/1DJxAAV+F7UfKhl5KtfdEXkMHZlg==", 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-osd", 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAt2/VlUQREJxAAkEoZrCvLy2oReqpX/tnokQ==", 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-osd" 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rbd", 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAt2/Vl9ApEJxAAIwmwRbdyA2yeYoXPe42liA==", 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAt2/VlmBREJxAAPBvzG6qJ0dB/HUtmR+oOJw==", 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.540 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rgw", 2024-03-16T17:48:41.540 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAt2/VlrBtEJxAAyGS9DFSrwNekAVTO7PFuxg==", 2024-03-16T17:48:41.540 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.540 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-16T17:48:41.540 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.540 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2024-03-16T17:48:41.540 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAG2/VldSPJLhAAjCTDFBzvptOviE7g+oKXyw==", 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAG2/Vl3wfpKhAACbfV/dKzpQddP7WTLy72NQ==", 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2024-03-16T17:48:41.541 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2024-03-16T17:48:41.542 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2024-03-16T17:48:41.542 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2024-03-16T17:48:41.542 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.542 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:41.542 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-03-16T17:48:41.542 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-03-16T17:48:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.523+0000 7f5868afb640 1 -- 172.21.15.132:0/1528801812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f584406b3b0 msgr2=0x7f584406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.523+0000 7f5868afb640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f584406b3b0 0x7f584406d870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5854014510 tx=0x7f585400b040 comp rx=0 tx=0).stop 2024-03-16T17:48:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.523+0000 7f5868afb640 1 -- 172.21.15.132:0/1528801812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58641473f0 msgr2=0x7f5864147870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.523+0000 7f5868afb640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58641473f0 0x7f5864147870 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5858009990 tx=0x7f5858004730 comp rx=0 tx=0).stop 2024-03-16T17:48:41.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.523+0000 7f5868afb640 1 -- 172.21.15.132:0/1528801812 shutdown_connections 2024-03-16T17:48:41.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.523+0000 7f5868afb640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f584406b3b0 0x7f584406d870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.523+0000 7f5868afb640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5864159360 0x7f58641597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.523+0000 7f5868afb640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58641473f0 0x7f5864147870 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.523+0000 7f5868afb640 1 --2- 172.21.15.132:0/1528801812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f584c003eb0 0x7f58640c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.523+0000 7f5868afb640 1 -- 172.21.15.132:0/1528801812 >> 172.21.15.132:0/1528801812 conn(0x7f5864072370 msgr2=0x7f586415c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.524+0000 7f5868afb640 1 -- 172.21.15.132:0/1528801812 shutdown_connections 2024-03-16T17:48:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.524+0000 7f5868afb640 1 -- 172.21.15.132:0/1528801812 wait complete. 2024-03-16T17:48:41.547 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-16T17:48:41.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.645+0000 7f09b0e8f640 1 Processor -- start 2024-03-16T17:48:41.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.645+0000 7f09b0e8f640 1 -- start start 2024-03-16T17:48:41.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09b0e8f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09ac0b3d70 0x7f09ac06e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09b0e8f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ac072970 con 0x7f09ac15b220 2024-03-16T17:48:41.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09b0e8f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ac06cfa0 con 0x7f09ac1627a0 2024-03-16T17:48:41.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09b0e8f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ac06eae0 con 0x7f09ac0b3d70 2024-03-16T17:48:41.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09a9d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09ac0b3d70 0x7f09ac06e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09aa59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f09ac15b220 0x7f09ac15b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55936/0 (socket says 172.21.15.132:55936) 2024-03-16T17:48:41.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09aa59c640 1 -- 172.21.15.132:0/499239015 learned_addr learned my addr 172.21.15.132:0/499239015 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:41.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09a9d9b640 1 -- 172.21.15.132:0/499239015 >> v1:172.21.15.194:6789/0 conn(0x7f09ac1627a0 legacy=0x7f09ac164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09a9d9b640 1 -- 172.21.15.132:0/499239015 >> v1:172.21.15.132:6789/0 conn(0x7f09ac15b220 legacy=0x7f09ac15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09a959a640 1 -- 172.21.15.132:0/499239015 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445648870 0 0) 0x7f09ac072970 con 0x7f09ac15b220 2024-03-16T17:48:41.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.646+0000 7f09a9d9b640 1 -- 172.21.15.132:0/499239015 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac072320 con 0x7f09ac0b3d70 2024-03-16T17:48:41.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.647+0000 7f09a9d9b640 1 --2- 172.21.15.132:0/499239015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 0x7f09ac06e5a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f09a00097a0 tx=0x7f09a002dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f098988da2dc1b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:41.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.647+0000 7f09a959a640 1 -- 172.21.15.132:0/499239015 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a002f8a0 con 0x7f09ac0b3d70 2024-03-16T17:48:41.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.647+0000 7f09a959a640 1 -- 172.21.15.132:0/499239015 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a002fa00 con 0x7f09ac0b3d70 2024-03-16T17:48:41.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.647+0000 7f09a959a640 1 -- 172.21.15.132:0/499239015 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a002fd90 con 0x7f09ac0b3d70 2024-03-16T17:48:41.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.648+0000 7f09b0e8f640 1 -- 172.21.15.132:0/499239015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 msgr2=0x7f09ac06e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.648+0000 7f09b0e8f640 1 --2- 172.21.15.132:0/499239015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 0x7f09ac06e5a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f09a00097a0 tx=0x7f09a002dae0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.648+0000 7f09b0e8f640 1 -- 172.21.15.132:0/499239015 shutdown_connections 2024-03-16T17:48:41.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.648+0000 7f09b0e8f640 1 --2- 172.21.15.132:0/499239015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 0x7f09ac06e5a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.648+0000 7f09b0e8f640 1 -- 172.21.15.132:0/499239015 >> 172.21.15.132:0/499239015 conn(0x7f09ac06aee0 msgr2=0x7f09ac06b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:41.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.648+0000 7f09b0e8f640 1 -- 172.21.15.132:0/499239015 shutdown_connections 2024-03-16T17:48:41.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.648+0000 7f09b0e8f640 1 -- 172.21.15.132:0/499239015 wait complete. 2024-03-16T17:48:41.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.649+0000 7f09b0e8f640 1 Processor -- start 2024-03-16T17:48:41.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.649+0000 7f09b0e8f640 1 -- start start 2024-03-16T17:48:41.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09b0e8f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 0x7f09ac138e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09b0e8f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09ac15b220 0x7f09ac13de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09b0e8f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09ac1627a0 0x7f09ac06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09b0e8f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac13ce40 con 0x7f09ac0b3d70 2024-03-16T17:48:41.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09b0e8f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac13e350 con 0x7f09ac15b220 2024-03-16T17:48:41.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09b0e8f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac13c230 con 0x7f09ac1627a0 2024-03-16T17:48:41.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09aa59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 0x7f09ac138e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09aa59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 0x7f09ac138e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56350/0 (socket says 172.21.15.132:56350) 2024-03-16T17:48:41.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09aa59c640 1 -- 172.21.15.132:0/4254075189 learned_addr learned my addr 172.21.15.132:0/4254075189 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:41.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09a9d9b640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09ac15b220 0x7f09ac13de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09aad9d640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09ac1627a0 0x7f09ac06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09aa59c640 1 -- 172.21.15.132:0/4254075189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09ac1627a0 msgr2=0x7f09ac06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09aa59c640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09ac1627a0 0x7f09ac06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09aa59c640 1 -- 172.21.15.132:0/4254075189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09ac15b220 msgr2=0x7f09ac13de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09aa59c640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09ac15b220 0x7f09ac13de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09aa59c640 1 -- 172.21.15.132:0/4254075189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0009400 con 0x7f09ac0b3d70 2024-03-16T17:48:41.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f09aa59c640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 0x7f09ac138e40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f099c00c780 tx=0x7f099c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.650+0000 7f099affd640 1 -- 172.21.15.132:0/4254075189 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00ce90 con 0x7f09ac0b3d70 2024-03-16T17:48:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.651+0000 7f099affd640 1 -- 172.21.15.132:0/4254075189 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c00a640 con 0x7f09ac0b3d70 2024-03-16T17:48:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.651+0000 7f09b0e8f640 1 -- 172.21.15.132:0/4254075189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac13c510 con 0x7f09ac0b3d70 2024-03-16T17:48:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.651+0000 7f099affd640 1 -- 172.21.15.132:0/4254075189 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00aa70 con 0x7f09ac0b3d70 2024-03-16T17:48:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.651+0000 7f09b0e8f640 1 -- 172.21.15.132:0/4254075189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ac13cad0 con 0x7f09ac0b3d70 2024-03-16T17:48:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.652+0000 7f09b0e8f640 1 -- 172.21.15.132:0/4254075189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ac06cb80 con 0x7f09ac0b3d70 2024-03-16T17:48:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.652+0000 7f099affd640 1 -- 172.21.15.132:0/4254075189 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f099c00abd0 con 0x7f09ac0b3d70 2024-03-16T17:48:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.653+0000 7f099affd640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f098c06b3b0 0x7f098c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:41.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.653+0000 7f09a9d9b640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f098c06b3b0 0x7f098c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:41.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.653+0000 7f099affd640 1 -- 172.21.15.132:0/4254075189 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f099c089210 con 0x7f09ac0b3d70 2024-03-16T17:48:41.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.653+0000 7f09a9d9b640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f098c06b3b0 0x7f098c06d870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f09a0038000 tx=0x7f09a0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:41.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.658+0000 7f099affd640 1 -- 172.21.15.132:0/4254075189 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f099c054130 con 0x7f09ac0b3d70 2024-03-16T17:48:41.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.891+0000 7f09b0e8f640 1 -- 172.21.15.132:0/4254075189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f09ac0735f0 con 0x7f09ac0b3d70 2024-03-16T17:48:41.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.893+0000 7f099affd640 1 -- 172.21.15.132:0/4254075189 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f099c0180a0 con 0x7f09ac0b3d70 2024-03-16T17:48:41.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 -- 172.21.15.132:0/4254075189 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f098c06b3b0 msgr2=0x7f098c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f098c06b3b0 0x7f098c06d870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f09a0038000 tx=0x7f09a0008030 comp rx=0 tx=0).stop 2024-03-16T17:48:41.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 -- 172.21.15.132:0/4254075189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 msgr2=0x7f09ac138e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:41.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 0x7f09ac138e40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f099c00c780 tx=0x7f099c00cc40 comp rx=0 tx=0).stop 2024-03-16T17:48:41.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 -- 172.21.15.132:0/4254075189 shutdown_connections 2024-03-16T17:48:41.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f098c06b3b0 0x7f098c06d870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09ac1627a0 0x7f09ac06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09ac15b220 0x7f09ac13de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 --2- 172.21.15.132:0/4254075189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09ac0b3d70 0x7f09ac138e40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:41.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 -- 172.21.15.132:0/4254075189 >> 172.21.15.132:0/4254075189 conn(0x7f09ac06aee0 msgr2=0x7f09ac0ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:41.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 -- 172.21.15.132:0/4254075189 shutdown_connections 2024-03-16T17:48:41.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:41.896+0000 7f09b0e8f640 1 -- 172.21.15.132:0/4254075189 wait complete. 2024-03-16T17:48:41.910 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-16T17:48:42.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.008+0000 7f34e111e640 1 Processor -- start 2024-03-16T17:48:42.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.008+0000 7f34e111e640 1 -- start start 2024-03-16T17:48:42.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.008+0000 7f34e111e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f34dc154b80 0x7f34dc072a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.008+0000 7f34e111e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34dc06dba0 0x7f34dc070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.008+0000 7f34e111e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34dc15aa80 con 0x7f34dc0b2bb0 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.008+0000 7f34e111e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc15b700 con 0x7f34dc06dba0 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.008+0000 7f34e111e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc15ad60 con 0x7f34dc154b80 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.009+0000 7f34db59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34dc06dba0 0x7f34dc070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.009+0000 7f34db59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34dc06dba0 0x7f34dc070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56352/0 (socket says 172.21.15.132:56352) 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.009+0000 7f34db59e640 1 -- 172.21.15.132:0/469827812 learned_addr learned my addr 172.21.15.132:0/469827812 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.009+0000 7f34dad9d640 1 --2- 172.21.15.132:0/469827812 >> v2:172.21.15.194:3300/0 conn(0x7f34dc154b80 0x7f34dc072a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.009+0000 7f34db59e640 1 -- 172.21.15.132:0/469827812 >> v2:172.21.15.194:3300/0 conn(0x7f34dc154b80 msgr2=0x7f34dc072a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.009+0000 7f34db59e640 1 --2- 172.21.15.132:0/469827812 >> v2:172.21.15.194:3300/0 conn(0x7f34dc154b80 0x7f34dc072a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.009+0000 7f34db59e640 1 -- 172.21.15.132:0/469827812 >> v1:172.21.15.194:6789/0 conn(0x7f34dc0b2bb0 legacy=0x7f34dc06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.009+0000 7f34db59e640 1 -- 172.21.15.132:0/469827812 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc15b040 con 0x7f34dc06dba0 2024-03-16T17:48:42.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34db59e640 1 --2- 172.21.15.132:0/469827812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 0x7f34dc070ff0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f34dc068760 tx=0x7f34d402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f997c4094f335967 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:42.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34da59c640 1 -- 172.21.15.132:0/469827812 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d402cb20 con 0x7f34dc06dba0 2024-03-16T17:48:42.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34da59c640 1 -- 172.21.15.132:0/469827812 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d402cc80 con 0x7f34dc06dba0 2024-03-16T17:48:42.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34da59c640 1 -- 172.21.15.132:0/469827812 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d40343f0 con 0x7f34dc06dba0 2024-03-16T17:48:42.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34e111e640 1 -- 172.21.15.132:0/469827812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 msgr2=0x7f34dc070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34e111e640 1 --2- 172.21.15.132:0/469827812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 0x7f34dc070ff0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f34dc068760 tx=0x7f34d402bf80 comp rx=0 tx=0).stop 2024-03-16T17:48:42.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34e111e640 1 -- 172.21.15.132:0/469827812 shutdown_connections 2024-03-16T17:48:42.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34e111e640 1 --2- 172.21.15.132:0/469827812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 0x7f34dc070ff0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34e111e640 1 --2- 172.21.15.132:0/469827812 >> v2:172.21.15.194:3300/0 conn(0x7f34dc154b80 0x7f34dc072a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34e111e640 1 -- 172.21.15.132:0/469827812 >> 172.21.15.132:0/469827812 conn(0x7f34dc06aee0 msgr2=0x7f34dc06b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:42.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34e111e640 1 -- 172.21.15.132:0/469827812 shutdown_connections 2024-03-16T17:48:42.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.010+0000 7f34e111e640 1 -- 172.21.15.132:0/469827812 wait complete. 2024-03-16T17:48:42.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34e111e640 1 Processor -- start 2024-03-16T17:48:42.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34e111e640 1 -- start start 2024-03-16T17:48:42.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34e111e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 0x7f34dc150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34e111e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34dc0b2bb0 0x7f34dc152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34e111e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34dc154b80 0x7f34dc1452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34e111e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc151f20 con 0x7f34dc06dba0 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34e111e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc14ed30 con 0x7f34dc0b2bb0 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34e111e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc152880 con 0x7f34dc154b80 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34dad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 0x7f34dc150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34dad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 0x7f34dc150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56368/0 (socket says 172.21.15.132:56368) 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.012+0000 7f34dad9d640 1 -- 172.21.15.132:0/1565119523 learned_addr learned my addr 172.21.15.132:0/1565119523 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34db59e640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34dc154b80 0x7f34dc1452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34d3fff640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34dc0b2bb0 0x7f34dc152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34dad9d640 1 -- 172.21.15.132:0/1565119523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34dc154b80 msgr2=0x7f34dc1452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34dad9d640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34dc154b80 0x7f34dc1452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34dad9d640 1 -- 172.21.15.132:0/1565119523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34dc0b2bb0 msgr2=0x7f34dc152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34dad9d640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34dc0b2bb0 0x7f34dc152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34dad9d640 1 -- 172.21.15.132:0/1565119523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d4009b30 con 0x7f34dc06dba0 2024-03-16T17:48:42.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34db59e640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34dc154b80 0x7f34dc1452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:42.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34d3fff640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34dc0b2bb0 0x7f34dc152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:42.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34dad9d640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 0x7f34dc150ba0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00d5f0 tx=0x7f34cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:42.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34d37fe640 1 -- 172.21.15.132:0/1565119523 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0125f0 con 0x7f34dc06dba0 2024-03-16T17:48:42.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34d37fe640 1 -- 172.21.15.132:0/1565119523 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc012750 con 0x7f34dc06dba0 2024-03-16T17:48:42.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34e111e640 1 -- 172.21.15.132:0/1565119523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc1512a0 con 0x7f34dc06dba0 2024-03-16T17:48:42.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34d37fe640 1 -- 172.21.15.132:0/1565119523 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc012b00 con 0x7f34dc06dba0 2024-03-16T17:48:42.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.013+0000 7f34e111e640 1 -- 172.21.15.132:0/1565119523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc151860 con 0x7f34dc06dba0 2024-03-16T17:48:42.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.014+0000 7f34e111e640 1 -- 172.21.15.132:0/1565119523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc0735f0 con 0x7f34dc06dba0 2024-03-16T17:48:42.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.015+0000 7f34d37fe640 1 -- 172.21.15.132:0/1565119523 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f34cc012c60 con 0x7f34dc06dba0 2024-03-16T17:48:42.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.015+0000 7f34d37fe640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f34bc06b3b0 0x7f34bc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.015+0000 7f34d3fff640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f34bc06b3b0 0x7f34bc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.015+0000 7f34d37fe640 1 -- 172.21.15.132:0/1565119523 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34cc089cc0 con 0x7f34dc06dba0 2024-03-16T17:48:42.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.015+0000 7f34d3fff640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f34bc06b3b0 0x7f34bc06d870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f34dc1f3370 tx=0x7f34c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:42.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.019+0000 7f34d37fe640 1 -- 172.21.15.132:0/1565119523 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f34cc054d00 con 0x7f34dc06dba0 2024-03-16T17:48:42.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.259+0000 7f34e111e640 1 -- 172.21.15.132:0/1565119523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f34dc152190 con 0x7f34dc06dba0 2024-03-16T17:48:42.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.261+0000 7f34d37fe640 1 -- 172.21.15.132:0/1565119523 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f34cc0583c0 con 0x7f34dc06dba0 2024-03-16T17:48:42.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.263+0000 7f34e111e640 1 -- 172.21.15.132:0/1565119523 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f34bc06b3b0 msgr2=0x7f34bc06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.263+0000 7f34e111e640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f34bc06b3b0 0x7f34bc06d870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f34dc1f3370 tx=0x7f34c4009040 comp rx=0 tx=0).stop 2024-03-16T17:48:42.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.263+0000 7f34e111e640 1 -- 172.21.15.132:0/1565119523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 msgr2=0x7f34dc150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.263+0000 7f34e111e640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 0x7f34dc150ba0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00d5f0 tx=0x7f34cc00dab0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.263+0000 7f34e111e640 1 -- 172.21.15.132:0/1565119523 shutdown_connections 2024-03-16T17:48:42.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.263+0000 7f34e111e640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f34bc06b3b0 0x7f34bc06d870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.263+0000 7f34e111e640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34dc154b80 0x7f34dc1452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.263+0000 7f34e111e640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34dc0b2bb0 0x7f34dc152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.263+0000 7f34e111e640 1 --2- 172.21.15.132:0/1565119523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34dc06dba0 0x7f34dc150ba0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.263+0000 7f34e111e640 1 -- 172.21.15.132:0/1565119523 >> 172.21.15.132:0/1565119523 conn(0x7f34dc06aee0 msgr2=0x7f34dc15b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:42.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.264+0000 7f34e111e640 1 -- 172.21.15.132:0/1565119523 shutdown_connections 2024-03-16T17:48:42.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.264+0000 7f34e111e640 1 -- 172.21.15.132:0/1565119523 wait complete. 2024-03-16T17:48:42.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-16T17:48:42.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a689d0640 1 Processor -- start 2024-03-16T17:48:42.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a689d0640 1 -- start start 2024-03-16T17:48:42.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a689d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a6406bef0 0x7f7a6406c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a689d0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a640aede0 0x7f7a640af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a689d0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a640ae950 con 0x7f7a64158770 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a689d0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6406c8b0 con 0x7f7a640aede0 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a689d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a640ae360 con 0x7f7a6406bef0 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a62d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a640aede0 0x7f7a640af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a62d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a640aede0 0x7f7a640af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56378/0 (socket says 172.21.15.132:56378) 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a62d9d640 1 -- 172.21.15.132:0/3918954301 learned_addr learned my addr 172.21.15.132:0/3918954301 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a6259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7a64158770 0x7f7a6415e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55952/0 (socket says 172.21.15.132:55952) 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a5bfff640 1 --2- 172.21.15.132:0/3918954301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a6406bef0 0x7f7a6406c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a62d9d640 1 -- 172.21.15.132:0/3918954301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a6406bef0 msgr2=0x7f7a6406c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a62d9d640 1 --2- 172.21.15.132:0/3918954301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a6406bef0 0x7f7a6406c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a62d9d640 1 -- 172.21.15.132:0/3918954301 >> v1:172.21.15.132:6789/0 conn(0x7f7a64158770 legacy=0x7f7a6415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a61d9b640 1 -- 172.21.15.132:0/3918954301 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560201896 0 0) 0x7f7a640ae950 con 0x7f7a64158770 2024-03-16T17:48:42.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a62d9d640 1 -- 172.21.15.132:0/3918954301 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6415f030 con 0x7f7a640aede0 2024-03-16T17:48:42.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.377+0000 7f7a5bfff640 1 --2- 172.21.15.132:0/3918954301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a6406bef0 0x7f7a6406c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:42.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.378+0000 7f7a62d9d640 1 --2- 172.21.15.132:0/3918954301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a640aede0 0x7f7a640af270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009e50 tx=0x7f7a5c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1860e05a1ecf8452 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:42.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.378+0000 7f7a61d9b640 1 -- 172.21.15.132:0/3918954301 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c02cb00 con 0x7f7a640aede0 2024-03-16T17:48:42.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.378+0000 7f7a61d9b640 1 -- 172.21.15.132:0/3918954301 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c02cc60 con 0x7f7a640aede0 2024-03-16T17:48:42.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.378+0000 7f7a61d9b640 1 -- 172.21.15.132:0/3918954301 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0343f0 con 0x7f7a640aede0 2024-03-16T17:48:42.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.379+0000 7f7a689d0640 1 -- 172.21.15.132:0/3918954301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a640aede0 msgr2=0x7f7a640af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.379+0000 7f7a689d0640 1 --2- 172.21.15.132:0/3918954301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a640aede0 0x7f7a640af270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009e50 tx=0x7f7a5c02bf60 comp rx=0 tx=0).stop 2024-03-16T17:48:42.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.379+0000 7f7a689d0640 1 -- 172.21.15.132:0/3918954301 shutdown_connections 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.379+0000 7f7a689d0640 1 --2- 172.21.15.132:0/3918954301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a640aede0 0x7f7a640af270 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.379+0000 7f7a689d0640 1 --2- 172.21.15.132:0/3918954301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a6406bef0 0x7f7a6406c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.379+0000 7f7a689d0640 1 -- 172.21.15.132:0/3918954301 >> 172.21.15.132:0/3918954301 conn(0x7f7a64071470 msgr2=0x7f7a64071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.379+0000 7f7a689d0640 1 -- 172.21.15.132:0/3918954301 shutdown_connections 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.379+0000 7f7a689d0640 1 -- 172.21.15.132:0/3918954301 wait complete. 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.380+0000 7f7a689d0640 1 Processor -- start 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.380+0000 7f7a689d0640 1 -- start start 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a689d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406bef0 0x7f7a640b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a689d0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a640aede0 0x7f7a640b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a689d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a64158770 0x7f7a641f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a689d0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a64148240 con 0x7f7a6406bef0 2024-03-16T17:48:42.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a689d0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a641f6f90 con 0x7f7a640aede0 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a689d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a641f7270 con 0x7f7a64158770 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a6259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406bef0 0x7f7a640b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a6259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406bef0 0x7f7a640b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56390/0 (socket says 172.21.15.132:56390) 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a6259c640 1 -- 172.21.15.132:0/2544834853 learned_addr learned my addr 172.21.15.132:0/2544834853 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a62d9d640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a64158770 0x7f7a641f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a5bfff640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a640aede0 0x7f7a640b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a6259c640 1 -- 172.21.15.132:0/2544834853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a64158770 msgr2=0x7f7a641f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a6259c640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a64158770 0x7f7a641f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a6259c640 1 -- 172.21.15.132:0/2544834853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a640aede0 msgr2=0x7f7a640b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a6259c640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a640aede0 0x7f7a640b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a6259c640 1 -- 172.21.15.132:0/2544834853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c009b30 con 0x7f7a6406bef0 2024-03-16T17:48:42.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a62d9d640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a64158770 0x7f7a641f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a6259c640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406bef0 0x7f7a640b4510 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400c4d0 tx=0x7f7a5400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a5affd640 1 -- 172.21.15.132:0/2544834853 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a540074e0 con 0x7f7a6406bef0 2024-03-16T17:48:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a5affd640 1 -- 172.21.15.132:0/2544834853 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a54007660 con 0x7f7a6406bef0 2024-03-16T17:48:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a689d0640 1 -- 172.21.15.132:0/2544834853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a641f7550 con 0x7f7a6406bef0 2024-03-16T17:48:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a5affd640 1 -- 172.21.15.132:0/2544834853 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54004a20 con 0x7f7a6406bef0 2024-03-16T17:48:42.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.381+0000 7f7a689d0640 1 -- 172.21.15.132:0/2544834853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a641f7c50 con 0x7f7a6406bef0 2024-03-16T17:48:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.382+0000 7f7a689d0640 1 -- 172.21.15.132:0/2544834853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a64068450 con 0x7f7a6406bef0 2024-03-16T17:48:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.383+0000 7f7a5affd640 1 -- 172.21.15.132:0/2544834853 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f7a54004b80 con 0x7f7a6406bef0 2024-03-16T17:48:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.383+0000 7f7a5affd640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7a4406b3b0 0x7f7a4406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.383+0000 7f7a5bfff640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7a4406b3b0 0x7f7a4406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.383+0000 7f7a5affd640 1 -- 172.21.15.132:0/2544834853 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a54088d40 con 0x7f7a6406bef0 2024-03-16T17:48:42.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.384+0000 7f7a5bfff640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7a4406b3b0 0x7f7a4406d870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a640cc4e0 tx=0x7f7a4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:42.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.388+0000 7f7a5affd640 1 -- 172.21.15.132:0/2544834853 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7a54053d80 con 0x7f7a6406bef0 2024-03-16T17:48:42.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-03-16T17:48:42.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.624+0000 7f7a689d0640 1 -- 172.21.15.132:0/2544834853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f7a64072e00 con 0x7f7a6406bef0 2024-03-16T17:48:42.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.626+0000 7f7a5affd640 1 -- 172.21.15.132:0/2544834853 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7a54057440 con 0x7f7a6406bef0 2024-03-16T17:48:42.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 -- 172.21.15.132:0/2544834853 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7a4406b3b0 msgr2=0x7f7a4406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7a4406b3b0 0x7f7a4406d870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a640cc4e0 tx=0x7f7a4c008040 comp rx=0 tx=0).stop 2024-03-16T17:48:42.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 -- 172.21.15.132:0/2544834853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406bef0 msgr2=0x7f7a640b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406bef0 0x7f7a640b4510 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400c4d0 tx=0x7f7a5400c990 comp rx=0 tx=0).stop 2024-03-16T17:48:42.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 -- 172.21.15.132:0/2544834853 shutdown_connections 2024-03-16T17:48:42.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7a4406b3b0 0x7f7a4406d870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a64158770 0x7f7a641f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a640aede0 0x7f7a640b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 --2- 172.21.15.132:0/2544834853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a6406bef0 0x7f7a640b4510 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 -- 172.21.15.132:0/2544834853 >> 172.21.15.132:0/2544834853 conn(0x7f7a64071470 msgr2=0x7f7a64071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:42.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 -- 172.21.15.132:0/2544834853 shutdown_connections 2024-03-16T17:48:42.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.628+0000 7f7a689d0640 1 -- 172.21.15.132:0/2544834853 wait complete. 2024-03-16T17:48:42.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-16T17:48:42.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.739+0000 7fb797edf640 1 Processor -- start 2024-03-16T17:48:42.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.739+0000 7fb797edf640 1 -- start start 2024-03-16T17:48:42.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb797edf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb79006aee0 0x7fb790072760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb797edf640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb79015e280 0x7fb79015e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb797edf640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7900b5cb0 con 0x7fb7900b3b50 2024-03-16T17:48:42.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb797edf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb790073020 con 0x7fb79006aee0 2024-03-16T17:48:42.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb797edf640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7900b53c0 con 0x7fb79015e280 2024-03-16T17:48:42.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb795c7b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb79006aee0 0x7fb790072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb795c7b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb79006aee0 0x7fb790072760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56398/0 (socket says 172.21.15.132:56398) 2024-03-16T17:48:42.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb795c7b640 1 -- 172.21.15.132:0/662106861 learned_addr learned my addr 172.21.15.132:0/662106861 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb795c7b640 1 -- 172.21.15.132:0/662106861 >> v2:172.21.15.194:3300/0 conn(0x7fb79015e280 msgr2=0x7fb79015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb79647c640 1 --2- 172.21.15.132:0/662106861 >> v2:172.21.15.194:3300/0 conn(0x7fb79015e280 0x7fb79015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb795c7b640 1 --2- 172.21.15.132:0/662106861 >> v2:172.21.15.194:3300/0 conn(0x7fb79015e280 0x7fb79015e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb795c7b640 1 -- 172.21.15.132:0/662106861 >> v1:172.21.15.194:6789/0 conn(0x7fb7900b3b50 legacy=0x7fb79006b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.740+0000 7fb795c7b640 1 -- 172.21.15.132:0/662106861 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb790072d40 con 0x7fb79006aee0 2024-03-16T17:48:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.741+0000 7fb795c7b640 1 --2- 172.21.15.132:0/662106861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb79006aee0 0x7fb790072760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb79006bc30 tx=0x7fb78c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c4cb90fd11cbd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.741+0000 7fb794c79640 1 -- 172.21.15.132:0/662106861 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c031870 con 0x7fb79006aee0 2024-03-16T17:48:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.741+0000 7fb794c79640 1 -- 172.21.15.132:0/662106861 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c0319d0 con 0x7fb79006aee0 2024-03-16T17:48:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.741+0000 7fb794c79640 1 -- 172.21.15.132:0/662106861 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c031d60 con 0x7fb79006aee0 2024-03-16T17:48:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.742+0000 7fb797edf640 1 -- 172.21.15.132:0/662106861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb79006aee0 msgr2=0x7fb790072760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.742+0000 7fb797edf640 1 --2- 172.21.15.132:0/662106861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb79006aee0 0x7fb790072760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb79006bc30 tx=0x7fb78c02b910 comp rx=0 tx=0).stop 2024-03-16T17:48:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.742+0000 7fb797edf640 1 -- 172.21.15.132:0/662106861 shutdown_connections 2024-03-16T17:48:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.742+0000 7fb797edf640 1 --2- 172.21.15.132:0/662106861 >> v2:172.21.15.194:3300/0 conn(0x7fb79015e280 0x7fb79015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.742+0000 7fb797edf640 1 --2- 172.21.15.132:0/662106861 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb79006aee0 0x7fb790072760 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.742+0000 7fb797edf640 1 -- 172.21.15.132:0/662106861 >> 172.21.15.132:0/662106861 conn(0x7fb7900b2850 msgr2=0x7fb7900b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.742+0000 7fb797edf640 1 -- 172.21.15.132:0/662106861 shutdown_connections 2024-03-16T17:48:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.742+0000 7fb797edf640 1 -- 172.21.15.132:0/662106861 wait complete. 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.743+0000 7fb797edf640 1 Processor -- start 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.743+0000 7fb797edf640 1 -- start start 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb797edf640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb79006aee0 0x7fb79014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb797edf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7900b3b50 0x7fb790159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb797edf640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb79015e280 0x7fb79015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb797edf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901593b0 con 0x7fb7900b3b50 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb797edf640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79014caf0 con 0x7fb79006aee0 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb797edf640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901587a0 con 0x7fb79015e280 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb79547a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7900b3b50 0x7fb790159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb79547a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7900b3b50 0x7fb790159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56410/0 (socket says 172.21.15.132:56410) 2024-03-16T17:48:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb79547a640 1 -- 172.21.15.132:0/977046166 learned_addr learned my addr 172.21.15.132:0/977046166 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb79547a640 1 -- 172.21.15.132:0/977046166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb79015e280 msgr2=0x7fb79015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb79547a640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb79015e280 0x7fb79015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb79547a640 1 -- 172.21.15.132:0/977046166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb79006aee0 msgr2=0x7fb79014c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb79547a640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb79006aee0 0x7fb79014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb79547a640 1 -- 172.21.15.132:0/977046166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c0094d0 con 0x7fb7900b3b50 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.744+0000 7fb79547a640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7900b3b50 0x7fb790159c60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c400 tx=0x7fb78000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.745+0000 7fb7867fc640 1 -- 172.21.15.132:0/977046166 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780011790 con 0x7fb7900b3b50 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.745+0000 7fb7867fc640 1 -- 172.21.15.132:0/977046166 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb780011930 con 0x7fb7900b3b50 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.745+0000 7fb797edf640 1 -- 172.21.15.132:0/977046166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb790158a80 con 0x7fb7900b3b50 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.745+0000 7fb7867fc640 1 -- 172.21.15.132:0/977046166 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780011ce0 con 0x7fb7900b3b50 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.745+0000 7fb797edf640 1 -- 172.21.15.132:0/977046166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb790159040 con 0x7fb7900b3b50 2024-03-16T17:48:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.746+0000 7fb797edf640 1 -- 172.21.15.132:0/977046166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7900735f0 con 0x7fb7900b3b50 2024-03-16T17:48:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.746+0000 7fb7867fc640 1 -- 172.21.15.132:0/977046166 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fb78001c460 con 0x7fb7900b3b50 2024-03-16T17:48:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.746+0000 7fb7867fc640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb77406b3b0 0x7fb77406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.746+0000 7fb7867fc640 1 -- 172.21.15.132:0/977046166 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb780089870 con 0x7fb7900b3b50 2024-03-16T17:48:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.746+0000 7fb795c7b640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb77406b3b0 0x7fb77406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.747+0000 7fb795c7b640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb77406b3b0 0x7fb77406d870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb78c036000 tx=0x7fb78c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:42.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.751+0000 7fb7867fc640 1 -- 172.21.15.132:0/977046166 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb780054820 con 0x7fb7900b3b50 2024-03-16T17:48:42.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.989+0000 7fb797edf640 1 -- 172.21.15.132:0/977046166 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb790071f30 con 0x7fb7900b3b50 2024-03-16T17:48:42.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.991+0000 7fb7867fc640 1 -- 172.21.15.132:0/977046166 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb780057ee0 con 0x7fb7900b3b50 2024-03-16T17:48:42.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 -- 172.21.15.132:0/977046166 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb77406b3b0 msgr2=0x7fb77406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb77406b3b0 0x7fb77406d870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb78c036000 tx=0x7fb78c030000 comp rx=0 tx=0).stop 2024-03-16T17:48:42.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 -- 172.21.15.132:0/977046166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7900b3b50 msgr2=0x7fb790159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:42.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7900b3b50 0x7fb790159c60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c400 tx=0x7fb78000c8c0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 -- 172.21.15.132:0/977046166 shutdown_connections 2024-03-16T17:48:42.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fb77406b3b0 0x7fb77406d870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb79015e280 0x7fb79015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7900b3b50 0x7fb790159c60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 --2- 172.21.15.132:0/977046166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb79006aee0 0x7fb79014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:42.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 -- 172.21.15.132:0/977046166 >> 172.21.15.132:0/977046166 conn(0x7fb7900b2850 msgr2=0x7fb7900b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:42.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 -- 172.21.15.132:0/977046166 shutdown_connections 2024-03-16T17:48:42.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:42.994+0000 7fb797edf640 1 -- 172.21.15.132:0/977046166 wait complete. 2024-03-16T17:48:43.008 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-16T17:48:43.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.107+0000 7f01fb983640 1 Processor -- start 2024-03-16T17:48:43.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.108+0000 7f01fb983640 1 -- start start 2024-03-16T17:48:43.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.108+0000 7f01fb983640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f4161710 0x7f01f40d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.108+0000 7f01fb983640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f01f40d4a10 0x7f01f40d2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.108+0000 7f01fb983640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f40d2bb0 con 0x7f01f40b3720 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.108+0000 7f01fb983640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40d0ce0 con 0x7f01f40d4a10 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.108+0000 7f01fb983640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40d2e90 con 0x7f01f4161710 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.108+0000 7f01f9f20640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f01f40b3720 0x7f01f40b3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55962/0 (socket says 172.21.15.132:55962) 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.108+0000 7f01f9f20640 1 -- 172.21.15.132:0/2628512191 learned_addr learned my addr 172.21.15.132:0/2628512191 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01f971f640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f4161710 0x7f01f40d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01f8f1e640 1 --2- 172.21.15.132:0/2628512191 >> v2:172.21.15.194:3300/0 conn(0x7f01f40d4a10 0x7f01f40d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587242586 0 0) 0x7f01f40d2bb0 con 0x7f01f40b3720 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e0003520 con 0x7f01f40b3720 2024-03-16T17:48:43.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2814479973 0 0) 0x7f01e0003520 con 0x7f01f40b3720 2024-03-16T17:48:43.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f4161710 msgr2=0x7f01f40d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:43.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f4161710 0x7f01f40d1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 >> v2:172.21.15.194:3300/0 conn(0x7f01f40d4a10 msgr2=0x7f01f40d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:43.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 --2- 172.21.15.132:0/2628512191 >> v2:172.21.15.194:3300/0 conn(0x7f01f40d4a10 0x7f01f40d2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40d0ed0 con 0x7f01f40b3720 2024-03-16T17:48:43.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f01ec001670 con 0x7f01f40b3720 2024-03-16T17:48:43.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 >> v1:172.21.15.132:6789/0 conn(0x7f01f40b3720 legacy=0x7f01f40b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01e0003970 0x7f01e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f4161710 0x7f01e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01e0004d00 0x7f01e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f40d2e90 con 0x7f01e0004d00 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e000b980 con 0x7f01e0003970 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e000bac0 con 0x7f01f4161710 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01f9f20640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01e0004d00 0x7f01e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01f971f640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01e0003970 0x7f01e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01f8f1e640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f4161710 0x7f01e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01f9f20640 1 -- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f4161710 msgr2=0x7f01e00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01f9f20640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01f4161710 0x7f01e00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.109+0000 7f01f9f20640 1 -- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01e0003970 msgr2=0x7f01e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.110+0000 7f01f9f20640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01e0003970 0x7f01e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.110+0000 7f01f9f20640 1 -- 172.21.15.132:0/2628512191 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e0003520 con 0x7f01e0004d00 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.110+0000 7f01f9f20640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01e0004d00 0x7f01e0005180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00c290 tx=0x7f01e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8a51c0d3d27633 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:43.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.110+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec005ad0 con 0x7f01e0004d00 2024-03-16T17:48:43.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.110+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec005c30 con 0x7f01e0004d00 2024-03-16T17:48:43.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.110+0000 7f01ebfff640 1 -- 172.21.15.132:0/2628512191 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec02c8d0 con 0x7f01e0004d00 2024-03-16T17:48:43.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.111+0000 7f01fb983640 1 -- 172.21.15.132:0/2628512191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01e0004d00 msgr2=0x7f01e0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.111+0000 7f01fb983640 1 --2- 172.21.15.132:0/2628512191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01e0004d00 0x7f01e0005180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00c290 tx=0x7f01e00057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.111+0000 7f01f9f20640 1 -- 172.21.15.132:0/2628512191 reap_dead start 2024-03-16T17:48:43.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.111+0000 7f01fb983640 1 -- 172.21.15.132:0/2628512191 shutdown_connections 2024-03-16T17:48:43.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.111+0000 7f01fb983640 1 -- 172.21.15.132:0/2628512191 >> 172.21.15.132:0/2628512191 conn(0x7f01f40d3e10 msgr2=0x7f01f40d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:43.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.111+0000 7f01fb983640 1 -- 172.21.15.132:0/2628512191 shutdown_connections 2024-03-16T17:48:43.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.111+0000 7f01fb983640 1 -- 172.21.15.132:0/2628512191 wait complete. 2024-03-16T17:48:43.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.112+0000 7f01fb983640 1 Processor -- start 2024-03-16T17:48:43.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.112+0000 7f01fb983640 1 -- start start 2024-03-16T17:48:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01fb983640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01e0004d00 0x7f01f41544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01fb983640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01f40ca490 0x7f01f40cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01fb983640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f41f3b30 0x7f01f415f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01fb983640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f41f44d0 con 0x7f01f40ca490 2024-03-16T17:48:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01fb983640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f41f47b0 con 0x7f01f41f3b30 2024-03-16T17:48:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01fb983640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f41f4a90 con 0x7f01e0004d00 2024-03-16T17:48:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f8f1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01f40ca490 0x7f01f40cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f8f1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01f40ca490 0x7f01f40cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56416/0 (socket says 172.21.15.132:56416) 2024-03-16T17:48:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f8f1e640 1 -- 172.21.15.132:0/1470791081 learned_addr learned my addr 172.21.15.132:0/1470791081 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f9f20640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f41f3b30 0x7f01f415f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f971f640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01e0004d00 0x7f01f41544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f8f1e640 1 -- 172.21.15.132:0/1470791081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01e0004d00 msgr2=0x7f01f41544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f8f1e640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01e0004d00 0x7f01f41544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f8f1e640 1 -- 172.21.15.132:0/1470791081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f41f3b30 msgr2=0x7f01f415f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f8f1e640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f41f3b30 0x7f01f415f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f8f1e640 1 -- 172.21.15.132:0/1470791081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40caf80 con 0x7f01f40ca490 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f9f20640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f41f3b30 0x7f01f415f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f971f640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01e0004d00 0x7f01f41544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.113+0000 7f01f8f1e640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01f40ca490 0x7f01f40cb780 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f01e4011980 tx=0x7f01e4011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.114+0000 7f01e9ffb640 1 -- 172.21.15.132:0/1470791081 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4004240 con 0x7f01f40ca490 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.114+0000 7f01e9ffb640 1 -- 172.21.15.132:0/1470791081 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e40043a0 con 0x7f01f40ca490 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.114+0000 7f01e9ffb640 1 -- 172.21.15.132:0/1470791081 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400fae0 con 0x7f01f40ca490 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.114+0000 7f01fb983640 1 -- 172.21.15.132:0/1470791081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f40cb260 con 0x7f01f40ca490 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.114+0000 7f01fb983640 1 -- 172.21.15.132:0/1470791081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f40cbea0 con 0x7f01f40ca490 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.115+0000 7f01fb983640 1 -- 172.21.15.132:0/1470791081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f4068450 con 0x7f01f40ca490 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.115+0000 7f01e9ffb640 1 -- 172.21.15.132:0/1470791081 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f01e400fc40 con 0x7f01f40ca490 2024-03-16T17:48:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.116+0000 7f01e9ffb640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01d806b3e0 0x7f01d806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.116+0000 7f01e9ffb640 1 -- 172.21.15.132:0/1470791081 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01e408a000 con 0x7f01f40ca490 2024-03-16T17:48:43.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.116+0000 7f01f971f640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01d806b3e0 0x7f01d806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.116+0000 7f01f971f640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01d806b3e0 0x7f01d806d8a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01f0007440 tx=0x7f01f000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:43.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.120+0000 7f01e9ffb640 1 -- 172.21.15.132:0/1470791081 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f01e4054fb0 con 0x7f01f40ca490 2024-03-16T17:48:43.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.355+0000 7f01fb983640 1 -- 172.21.15.132:0/1470791081 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f01f40a1de0 con 0x7f01f40ca490 2024-03-16T17:48:43.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.357+0000 7f01e9ffb640 1 -- 172.21.15.132:0/1470791081 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f01e4058670 con 0x7f01f40ca490 2024-03-16T17:48:43.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 -- 172.21.15.132:0/1470791081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01d806b3e0 msgr2=0x7f01d806d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01d806b3e0 0x7f01d806d8a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01f0007440 tx=0x7f01f000b040 comp rx=0 tx=0).stop 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 -- 172.21.15.132:0/1470791081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01f40ca490 msgr2=0x7f01f40cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01f40ca490 0x7f01f40cb780 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f01e4011980 tx=0x7f01e4011e40 comp rx=0 tx=0).stop 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 -- 172.21.15.132:0/1470791081 shutdown_connections 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f01d806b3e0 0x7f01d806d8a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01f41f3b30 0x7f01f415f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01f40ca490 0x7f01f40cb780 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 --2- 172.21.15.132:0/1470791081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f01e0004d00 0x7f01f41544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 -- 172.21.15.132:0/1470791081 >> 172.21.15.132:0/1470791081 conn(0x7f01f40d3e10 msgr2=0x7f01f40d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 -- 172.21.15.132:0/1470791081 shutdown_connections 2024-03-16T17:48:43.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.359+0000 7f01fb983640 1 -- 172.21.15.132:0/1470791081 wait complete. 2024-03-16T17:48:43.373 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-16T17:48:43.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.470+0000 7fdb65c2a640 1 Processor -- start 2024-03-16T17:48:43.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.470+0000 7fdb65c2a640 1 -- start start 2024-03-16T17:48:43.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb65c2a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb60158770 0x7fdb6015e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb65c2a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 0x7fdb6006bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb65c2a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdb6006c430 0x7fdb60161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb65c2a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6006c8c0 con 0x7fdb60158770 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb65c2a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb600ae950 con 0x7fdb6006c430 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb65c2a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600ae360 con 0x7fdb6015ea50 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb5f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb60158770 0x7fdb6015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb5f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdb60158770 0x7fdb6015e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56422/0 (socket says 172.21.15.132:56422) 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb5f7fe640 1 -- 172.21.15.132:0/655218718 learned_addr learned my addr 172.21.15.132:0/655218718 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb5ffff640 1 --2- 172.21.15.132:0/655218718 >> v2:172.21.15.194:3300/0 conn(0x7fdb6006c430 0x7fdb60161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb5effd640 1 --2- 172.21.15.132:0/655218718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 0x7fdb6006bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb5f7fe640 1 -- 172.21.15.132:0/655218718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 msgr2=0x7fdb6006bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb5f7fe640 1 --2- 172.21.15.132:0/655218718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 0x7fdb6006bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb5f7fe640 1 -- 172.21.15.132:0/655218718 >> v2:172.21.15.194:3300/0 conn(0x7fdb6006c430 msgr2=0x7fdb60161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:43.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb5f7fe640 1 --2- 172.21.15.132:0/655218718 >> v2:172.21.15.194:3300/0 conn(0x7fdb6006c430 0x7fdb60161b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.471+0000 7fdb5f7fe640 1 -- 172.21.15.132:0/655218718 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6015f030 con 0x7fdb60158770 2024-03-16T17:48:43.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.472+0000 7fdb5f7fe640 1 --2- 172.21.15.132:0/655218718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 0x7fdb6015e510 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdb600b0050 tx=0x7fdb5002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7064d5be1687be74 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:43.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.472+0000 7fdb5e7fc640 1 -- 172.21.15.132:0/655218718 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50031870 con 0x7fdb60158770 2024-03-16T17:48:43.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.472+0000 7fdb5e7fc640 1 -- 172.21.15.132:0/655218718 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb500319d0 con 0x7fdb60158770 2024-03-16T17:48:43.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.472+0000 7fdb5e7fc640 1 -- 172.21.15.132:0/655218718 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50031d60 con 0x7fdb60158770 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.473+0000 7fdb65c2a640 1 -- 172.21.15.132:0/655218718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 msgr2=0x7fdb6015e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.473+0000 7fdb65c2a640 1 --2- 172.21.15.132:0/655218718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 0x7fdb6015e510 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdb600b0050 tx=0x7fdb5002b910 comp rx=0 tx=0).stop 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.473+0000 7fdb65c2a640 1 -- 172.21.15.132:0/655218718 shutdown_connections 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.473+0000 7fdb65c2a640 1 --2- 172.21.15.132:0/655218718 >> v2:172.21.15.194:3300/0 conn(0x7fdb6006c430 0x7fdb60161b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.473+0000 7fdb65c2a640 1 --2- 172.21.15.132:0/655218718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 0x7fdb6006bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.473+0000 7fdb65c2a640 1 --2- 172.21.15.132:0/655218718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 0x7fdb6015e510 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.473+0000 7fdb65c2a640 1 -- 172.21.15.132:0/655218718 >> 172.21.15.132:0/655218718 conn(0x7fdb60071470 msgr2=0x7fdb60071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.473+0000 7fdb65c2a640 1 -- 172.21.15.132:0/655218718 shutdown_connections 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.473+0000 7fdb65c2a640 1 -- 172.21.15.132:0/655218718 wait complete. 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.474+0000 7fdb65c2a640 1 Processor -- start 2024-03-16T17:48:43.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.474+0000 7fdb65c2a640 1 -- start start 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb65c2a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb6006c430 0x7fdb60144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb65c2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 0x7fdb600cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb65c2a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 0x7fdb6014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb65c2a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6015dd30 con 0x7fdb60158770 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb65c2a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6014b990 con 0x7fdb6006c430 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb65c2a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6015d490 con 0x7fdb6015ea50 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 0x7fdb600cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 0x7fdb600cefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56434/0 (socket says 172.21.15.132:56434) 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5effd640 1 -- 172.21.15.132:0/4223141272 learned_addr learned my addr 172.21.15.132:0/4223141272 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5ffff640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 0x7fdb6014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5f7fe640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb6006c430 0x7fdb60144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5effd640 1 -- 172.21.15.132:0/4223141272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 msgr2=0x7fdb6014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5effd640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 0x7fdb6014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5effd640 1 -- 172.21.15.132:0/4223141272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb6006c430 msgr2=0x7fdb60144e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5effd640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb6006c430 0x7fdb60144e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5effd640 1 -- 172.21.15.132:0/4223141272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb500094d0 con 0x7fdb60158770 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5ffff640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 0x7fdb6014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5f7fe640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb6006c430 0x7fdb60144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb5effd640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 0x7fdb600cefd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400d5f0 tx=0x7fdb5400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb47fff640 1 -- 172.21.15.132:0/4223141272 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540125f0 con 0x7fdb60158770 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb47fff640 1 -- 172.21.15.132:0/4223141272 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54012750 con 0x7fdb60158770 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb65c2a640 1 -- 172.21.15.132:0/4223141272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6015d770 con 0x7fdb60158770 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb47fff640 1 -- 172.21.15.132:0/4223141272 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54012b00 con 0x7fdb60158770 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.475+0000 7fdb65c2a640 1 -- 172.21.15.132:0/4223141272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6015a730 con 0x7fdb60158770 2024-03-16T17:48:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.476+0000 7fdb65c2a640 1 -- 172.21.15.132:0/4223141272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb60068450 con 0x7fdb60158770 2024-03-16T17:48:43.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.477+0000 7fdb47fff640 1 -- 172.21.15.132:0/4223141272 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fdb54012c60 con 0x7fdb60158770 2024-03-16T17:48:43.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.477+0000 7fdb47fff640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdb4c06b3b0 0x7fdb4c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.477+0000 7fdb47fff640 1 -- 172.21.15.132:0/4223141272 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdb54089cf0 con 0x7fdb60158770 2024-03-16T17:48:43.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.477+0000 7fdb5f7fe640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdb4c06b3b0 0x7fdb4c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.478+0000 7fdb5f7fe640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdb4c06b3b0 0x7fdb4c06d870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdb50036000 tx=0x7fdb5003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:43.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.481+0000 7fdb47fff640 1 -- 172.21.15.132:0/4223141272 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdb5408e070 con 0x7fdb60158770 2024-03-16T17:48:43.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.719+0000 7fdb65c2a640 1 -- 172.21.15.132:0/4223141272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fdb60072e00 con 0x7fdb60158770 2024-03-16T17:48:43.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.721+0000 7fdb47fff640 1 -- 172.21.15.132:0/4223141272 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdb54054d30 con 0x7fdb60158770 2024-03-16T17:48:43.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 -- 172.21.15.132:0/4223141272 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdb4c06b3b0 msgr2=0x7fdb4c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdb4c06b3b0 0x7fdb4c06d870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdb50036000 tx=0x7fdb5003c040 comp rx=0 tx=0).stop 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 -- 172.21.15.132:0/4223141272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 msgr2=0x7fdb600cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 0x7fdb600cefd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400d5f0 tx=0x7fdb5400dab0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 -- 172.21.15.132:0/4223141272 shutdown_connections 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdb4c06b3b0 0x7fdb4c06d870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb6015ea50 0x7fdb6014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb60158770 0x7fdb600cefd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 --2- 172.21.15.132:0/4223141272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb6006c430 0x7fdb60144e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 -- 172.21.15.132:0/4223141272 >> 172.21.15.132:0/4223141272 conn(0x7fdb60071470 msgr2=0x7fdb6015fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 -- 172.21.15.132:0/4223141272 shutdown_connections 2024-03-16T17:48:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.724+0000 7fdb65c2a640 1 -- 172.21.15.132:0/4223141272 wait complete. 2024-03-16T17:48:43.738 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.834+0000 7fd9d775c640 1 Processor -- start 2024-03-16T17:48:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.835+0000 7fd9d775c640 1 -- start start 2024-03-16T17:48:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.835+0000 7fd9d775c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d2990 0x7fd9d0169060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.835+0000 7fd9d775c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d00d0680 con 0x7fd9d0161540 2024-03-16T17:48:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.835+0000 7fd9d775c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d00d08d0 con 0x7fd9d00b3560 2024-03-16T17:48:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.835+0000 7fd9d775c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00b4f30 con 0x7fd9d00d2990 2024-03-16T17:48:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.835+0000 7fd9d54f8640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd9d0161540 0x7fd9d00cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55974/0 (socket says 172.21.15.132:55974) 2024-03-16T17:48:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9d54f8640 1 -- 172.21.15.132:0/861502555 learned_addr learned my addr 172.21.15.132:0/861502555 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823403166 0 0) 0x7fd9d00d0680 con 0x7fd9d0161540 2024-03-16T17:48:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9bc003520 con 0x7fd9d0161540 2024-03-16T17:48:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9d5cf9640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d2990 0x7fd9d0169060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4144245560 0 0) 0x7fd9bc003520 con 0x7fd9d0161540 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d2990 msgr2=0x7fd9d0169060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d2990 0x7fd9d0169060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 >> v1:172.21.15.194:6789/0 conn(0x7fd9d00b3560 legacy=0x7fd9d00cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00d0bb0 con 0x7fd9d0161540 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7fd9cc001670 con 0x7fd9d0161540 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 >> v1:172.21.15.132:6789/0 conn(0x7fd9d0161540 legacy=0x7fd9d00cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc0039a0 0x7fd9bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9bc0047c0 0x7fd9bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d2990 0x7fd9bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00b4f30 con 0x7fd9bc0039a0 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc00ba30 con 0x7fd9bc0047c0 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc00bbf0 con 0x7fd9d00d2990 2024-03-16T17:48:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9d54f8640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc0039a0 0x7fd9bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9d4cf7640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9bc0047c0 0x7fd9bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9d5cf9640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d2990 0x7fd9bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9d54f8640 1 -- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d2990 msgr2=0x7fd9bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9d54f8640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d2990 0x7fd9bc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9d54f8640 1 -- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9bc0047c0 msgr2=0x7fd9bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9d54f8640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9bc0047c0 0x7fd9bc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.836+0000 7fd9d54f8640 1 -- 172.21.15.132:0/861502555 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9bc003520 con 0x7fd9bc0039a0 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.837+0000 7fd9d54f8640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc0039a0 0x7fd9bc003dc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00c210 tx=0x7fd9bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b76aa28498befb server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.837+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc005ad0 con 0x7fd9bc0039a0 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.837+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc005c30 con 0x7fd9bc0039a0 2024-03-16T17:48:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.837+0000 7fd9c7fff640 1 -- 172.21.15.132:0/861502555 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc02c870 con 0x7fd9bc0039a0 2024-03-16T17:48:43.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.838+0000 7fd9d775c640 1 -- 172.21.15.132:0/861502555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc0039a0 msgr2=0x7fd9bc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.838+0000 7fd9d775c640 1 --2- 172.21.15.132:0/861502555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc0039a0 0x7fd9bc003dc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00c210 tx=0x7fd9bc0057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.838+0000 7fd9d5cf9640 1 -- 172.21.15.132:0/861502555 reap_dead start 2024-03-16T17:48:43.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.838+0000 7fd9d775c640 1 -- 172.21.15.132:0/861502555 shutdown_connections 2024-03-16T17:48:43.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.838+0000 7fd9d775c640 1 -- 172.21.15.132:0/861502555 >> 172.21.15.132:0/861502555 conn(0x7fd9d009d120 msgr2=0x7fd9d00d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.838+0000 7fd9d775c640 1 -- 172.21.15.132:0/861502555 shutdown_connections 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.838+0000 7fd9d775c640 1 -- 172.21.15.132:0/861502555 wait complete. 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.839+0000 7fd9d775c640 1 Processor -- start 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.839+0000 7fd9d775c640 1 -- start start 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d775c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9bc0039a0 0x7fd9d01f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d775c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9d00b9480 0x7fd9d0155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d775c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d3db0 0x7fd9d00d4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d775c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00b98e0 con 0x7fd9d00b9480 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d775c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00d4770 con 0x7fd9bc0039a0 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d775c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d01f7e20 con 0x7fd9d00d3db0 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d4cf7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9d00b9480 0x7fd9d0155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d4cf7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9d00b9480 0x7fd9d0155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56452/0 (socket says 172.21.15.132:56452) 2024-03-16T17:48:43.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d4cf7640 1 -- 172.21.15.132:0/137749971 learned_addr learned my addr 172.21.15.132:0/137749971 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d4cf7640 1 -- 172.21.15.132:0/137749971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d3db0 msgr2=0x7fd9d00d4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d4cf7640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d3db0 0x7fd9d00d4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d4cf7640 1 -- 172.21.15.132:0/137749971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9bc0039a0 msgr2=0x7fd9d01f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d54f8640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9bc0039a0 0x7fd9d01f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d4cf7640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9bc0039a0 0x7fd9d01f6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d4cf7640 1 -- 172.21.15.132:0/137749971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d01f7580 con 0x7fd9d00b9480 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d4cf7640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9d00b9480 0x7fd9d0155130 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000e450 tx=0x7fd9c000e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9c5ffb640 1 -- 172.21.15.132:0/137749971 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c00052e0 con 0x7fd9d00b9480 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9c5ffb640 1 -- 172.21.15.132:0/137749971 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c0005440 con 0x7fd9d00b9480 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9c5ffb640 1 -- 172.21.15.132:0/137749971 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0003810 con 0x7fd9d00b9480 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.840+0000 7fd9d775c640 1 -- 172.21.15.132:0/137749971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d01f7860 con 0x7fd9d00b9480 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.841+0000 7fd9d775c640 1 -- 172.21.15.132:0/137749971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d00cc7d0 con 0x7fd9d00b9480 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.842+0000 7fd9d775c640 1 -- 172.21.15.132:0/137749971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d00cc960 con 0x7fd9d00b9480 2024-03-16T17:48:43.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.842+0000 7fd9c5ffb640 1 -- 172.21.15.132:0/137749971 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fd9c0003970 con 0x7fd9d00b9480 2024-03-16T17:48:43.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.842+0000 7fd9c5ffb640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd9b406b3b0 0x7fd9b406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:43.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.842+0000 7fd9c5ffb640 1 -- 172.21.15.132:0/137749971 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd9c00894f0 con 0x7fd9d00b9480 2024-03-16T17:48:43.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.842+0000 7fd9d54f8640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd9b406b3b0 0x7fd9b406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:43.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.843+0000 7fd9d54f8640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd9b406b3b0 0x7fd9b406d870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc034000 tx=0x7fd9cc009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:43.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:43.847+0000 7fd9c5ffb640 1 -- 172.21.15.132:0/137749971 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd9c0054530 con 0x7fd9d00b9480 2024-03-16T17:48:44.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.017+0000 7fd9d775c640 1 -- 172.21.15.132:0/137749971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9d00683c0 con 0x7fd9d00b9480 2024-03-16T17:48:44.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.018+0000 7fd9c5ffb640 1 -- 172.21.15.132:0/137749971 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12927 (secure 0 0 0) 0x7fd9c0057bf0 con 0x7fd9d00b9480 2024-03-16T17:48:44.022 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:44.022 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":29,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:48:41.148568+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:44.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.020+0000 7fd9d775c640 1 -- 172.21.15.132:0/137749971 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd9b406b3b0 msgr2=0x7fd9b406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.020+0000 7fd9d775c640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd9b406b3b0 0x7fd9b406d870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc034000 tx=0x7fd9cc009030 comp rx=0 tx=0).stop 2024-03-16T17:48:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.020+0000 7fd9d775c640 1 -- 172.21.15.132:0/137749971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9d00b9480 msgr2=0x7fd9d0155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.020+0000 7fd9d775c640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9d00b9480 0x7fd9d0155130 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000e450 tx=0x7fd9c000e910 comp rx=0 tx=0).stop 2024-03-16T17:48:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.020+0000 7fd9d775c640 1 -- 172.21.15.132:0/137749971 shutdown_connections 2024-03-16T17:48:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.020+0000 7fd9d775c640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd9b406b3b0 0x7fd9b406d870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.020+0000 7fd9d775c640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d00d3db0 0x7fd9d00d4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.020+0000 7fd9d775c640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9d00b9480 0x7fd9d0155130 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.020+0000 7fd9d775c640 1 --2- 172.21.15.132:0/137749971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9bc0039a0 0x7fd9d01f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.021+0000 7fd9d775c640 1 -- 172.21.15.132:0/137749971 >> 172.21.15.132:0/137749971 conn(0x7fd9d009d120 msgr2=0x7fd9d006d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.021+0000 7fd9d775c640 1 -- 172.21.15.132:0/137749971 shutdown_connections 2024-03-16T17:48:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.021+0000 7fd9d775c640 1 -- 172.21.15.132:0/137749971 wait complete. 2024-03-16T17:48:44.035 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-16T17:47:37.885510+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-16T17:48:44.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-16T17:48:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.134+0000 7fa1e446f640 1 Processor -- start 2024-03-16T17:48:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.134+0000 7fa1e446f640 1 -- start start 2024-03-16T17:48:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.135+0000 7fa1e446f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa1dc15c4f0 0x7fa1dc0d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.135+0000 7fa1e446f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1dc0b30d0 0x7fa1dc0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.135+0000 7fa1e446f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc0cf550 0x7fa1dc15d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.135+0000 7fa1e446f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc0ce2e0 con 0x7fa1dc0b30d0 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.135+0000 7fa1e446f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc0ceb80 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.135+0000 7fa1e446f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0d2610 con 0x7fa1dc0cf550 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.135+0000 7fa1e1a0a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1dc0b30d0 0x7fa1dc0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.135+0000 7fa1e1a0a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1dc0b30d0 0x7fa1dc0cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56462/0 (socket says 172.21.15.132:56462) 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.135+0000 7fa1e1a0a640 1 -- 172.21.15.132:0/1489962731 learned_addr learned my addr 172.21.15.132:0/1489962731 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.136+0000 7fa1e220b640 1 --2- 172.21.15.132:0/1489962731 >> v2:172.21.15.194:3300/0 conn(0x7fa1dc15c4f0 0x7fa1dc0d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.136+0000 7fa1e2a0c640 1 --2- 172.21.15.132:0/1489962731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc0cf550 0x7fa1dc15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.136+0000 7fa1e1a0a640 1 -- 172.21.15.132:0/1489962731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc0cf550 msgr2=0x7fa1dc15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.136+0000 7fa1e1a0a640 1 --2- 172.21.15.132:0/1489962731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc0cf550 0x7fa1dc15d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.136+0000 7fa1e1a0a640 1 -- 172.21.15.132:0/1489962731 >> v2:172.21.15.194:3300/0 conn(0x7fa1dc15c4f0 msgr2=0x7fa1dc0d1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.136+0000 7fa1e1a0a640 1 --2- 172.21.15.132:0/1489962731 >> v2:172.21.15.194:3300/0 conn(0x7fa1dc15c4f0 0x7fa1dc0d1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.136+0000 7fa1e1a0a640 1 -- 172.21.15.132:0/1489962731 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0ce530 con 0x7fa1dc0b30d0 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.136+0000 7fa1e1a0a640 1 --2- 172.21.15.132:0/1489962731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc0b30d0 0x7fa1dc0cf010 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc074db0 tx=0x7fa1cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae226289ee6707e server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e1209640 1 -- 172.21.15.132:0/1489962731 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc031870 con 0x7fa1dc0b30d0 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e1209640 1 -- 172.21.15.132:0/1489962731 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0319d0 con 0x7fa1dc0b30d0 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e1209640 1 -- 172.21.15.132:0/1489962731 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc031d60 con 0x7fa1dc0b30d0 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e446f640 1 -- 172.21.15.132:0/1489962731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc0b30d0 msgr2=0x7fa1dc0cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e446f640 1 --2- 172.21.15.132:0/1489962731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc0b30d0 0x7fa1dc0cf010 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc074db0 tx=0x7fa1cc02b910 comp rx=0 tx=0).stop 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e446f640 1 -- 172.21.15.132:0/1489962731 shutdown_connections 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e446f640 1 --2- 172.21.15.132:0/1489962731 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc0cf550 0x7fa1dc15d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e446f640 1 --2- 172.21.15.132:0/1489962731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc0b30d0 0x7fa1dc0cf010 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e446f640 1 --2- 172.21.15.132:0/1489962731 >> v2:172.21.15.194:3300/0 conn(0x7fa1dc15c4f0 0x7fa1dc0d1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e446f640 1 -- 172.21.15.132:0/1489962731 >> 172.21.15.132:0/1489962731 conn(0x7fa1dc073220 msgr2=0x7fa1dc09aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e446f640 1 -- 172.21.15.132:0/1489962731 shutdown_connections 2024-03-16T17:48:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.137+0000 7fa1e446f640 1 -- 172.21.15.132:0/1489962731 wait complete. 2024-03-16T17:48:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.138+0000 7fa1e446f640 1 Processor -- start 2024-03-16T17:48:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.138+0000 7fa1e446f640 1 -- start start 2024-03-16T17:48:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e446f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc0b30d0 0x7fa1dc14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e446f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc15c4f0 0x7fa1dc150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e446f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc150750 0x7fa1dc1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e446f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc150be0 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e446f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc152d40 con 0x7fa1dc150750 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e446f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc153020 con 0x7fa1dc0b30d0 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e1a0a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc15c4f0 0x7fa1dc150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e1a0a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc15c4f0 0x7fa1dc150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56474/0 (socket says 172.21.15.132:56474) 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e1a0a640 1 -- 172.21.15.132:0/4042025275 learned_addr learned my addr 172.21.15.132:0/4042025275 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e1a0a640 1 -- 172.21.15.132:0/4042025275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc0b30d0 msgr2=0x7fa1dc14cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e1a0a640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc0b30d0 0x7fa1dc14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e1a0a640 1 -- 172.21.15.132:0/4042025275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc150750 msgr2=0x7fa1dc1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e1a0a640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc150750 0x7fa1dc1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.139+0000 7fa1e1a0a640 1 -- 172.21.15.132:0/4042025275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc0094d0 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.140+0000 7fa1e1a0a640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc15c4f0 0x7fa1dc150210 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc02b950 tx=0x7fa1cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.140+0000 7fa1d2ffd640 1 -- 172.21.15.132:0/4042025275 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc03ad30 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.140+0000 7fa1d2ffd640 1 -- 172.21.15.132:0/4042025275 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0443f0 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.140+0000 7fa1e446f640 1 -- 172.21.15.132:0/4042025275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc153300 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.140+0000 7fa1d2ffd640 1 -- 172.21.15.132:0/4042025275 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0447a0 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.140+0000 7fa1e446f640 1 -- 172.21.15.132:0/4042025275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc157730 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.141+0000 7fa1e446f640 1 -- 172.21.15.132:0/4042025275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc153820 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.141+0000 7fa1d2ffd640 1 -- 172.21.15.132:0/4042025275 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fa1cc04d450 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.141+0000 7fa1d2ffd640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa1c006b3b0 0x7fa1c006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.142+0000 7fa1d2ffd640 1 -- 172.21.15.132:0/4042025275 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa1cc02d040 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.142+0000 7fa1e220b640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa1c006b3b0 0x7fa1c006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.142+0000 7fa1e220b640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa1c006b3b0 0x7fa1c006d870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8006fd0 tx=0x7fa1d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:44.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.146+0000 7fa1d2ffd640 1 -- 172.21.15.132:0/4042025275 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa1dc153820 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.317+0000 7fa1e446f640 1 -- 172.21.15.132:0/4042025275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1dc153820 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.318+0000 7fa1d2ffd640 1 -- 172.21.15.132:0/4042025275 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1dc153820 con 0x7fa1dc15c4f0 2024-03-16T17:48:44.321 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-03-16T17:48:44.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.319+0000 7fa1e446f640 1 -- 172.21.15.132:0/4042025275 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa1c006b3b0 msgr2=0x7fa1c006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.319+0000 7fa1e446f640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa1c006b3b0 0x7fa1c006d870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8006fd0 tx=0x7fa1d8008040 comp rx=0 tx=0).stop 2024-03-16T17:48:44.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.319+0000 7fa1e446f640 1 -- 172.21.15.132:0/4042025275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc15c4f0 msgr2=0x7fa1dc150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.319+0000 7fa1e446f640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc15c4f0 0x7fa1dc150210 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc02b950 tx=0x7fa1cc0046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.320+0000 7fa1e446f640 1 -- 172.21.15.132:0/4042025275 shutdown_connections 2024-03-16T17:48:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.320+0000 7fa1e446f640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa1c006b3b0 0x7fa1c006d870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.320+0000 7fa1e446f640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc150750 0x7fa1dc1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.320+0000 7fa1e446f640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1dc15c4f0 0x7fa1dc150210 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.320+0000 7fa1e446f640 1 --2- 172.21.15.132:0/4042025275 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1dc0b30d0 0x7fa1dc14cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.320+0000 7fa1e446f640 1 -- 172.21.15.132:0/4042025275 >> 172.21.15.132:0/4042025275 conn(0x7fa1dc073220 msgr2=0x7fa1dc070520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.320+0000 7fa1e446f640 1 -- 172.21.15.132:0/4042025275 shutdown_connections 2024-03-16T17:48:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.320+0000 7fa1e446f640 1 -- 172.21.15.132:0/4042025275 wait complete. 2024-03-16T17:48:44.334 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-16T17:48:44.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.430+0000 7f0f2a6ae640 1 Processor -- start 2024-03-16T17:48:44.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.430+0000 7f0f2a6ae640 1 -- start start 2024-03-16T17:48:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.431+0000 7f0f2a6ae640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f240b35c0 0x7f0f240724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.431+0000 7f0f2a6ae640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f24072030 con 0x7f0f240cda00 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.431+0000 7f0f2a6ae640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2406d2c0 con 0x7f0f240b3dd0 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.431+0000 7f0f2a6ae640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240717d0 con 0x7f0f240b35c0 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.431+0000 7f0f28c4b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0f240cda00 0x7f0f240cde90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55986/0 (socket says 172.21.15.132:55986) 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.431+0000 7f0f28c4b640 1 -- 172.21.15.132:0/1122512824 learned_addr learned my addr 172.21.15.132:0/1122512824 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579436946 0 0) 0x7f0f24072030 con 0x7f0f240cda00 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f237fe640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f240b35c0 0x7f0f240724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f0c003520 con 0x7f0f240cda00 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944797697 0 0) 0x7f0f0c003520 con 0x7f0f240cda00 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f240b35c0 msgr2=0x7f0f240724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f240b35c0 0x7f0f240724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 >> v1:172.21.15.194:6789/0 conn(0x7f0f240b3dd0 legacy=0x7f0f240b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2406cfe0 con 0x7f0f240cda00 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f0f1c0019f0 con 0x7f0f240cda00 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 >> v1:172.21.15.132:6789/0 conn(0x7f0f240cda00 legacy=0x7f0f240cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f240b35c0 0x7f0f0c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f0c003fd0 0x7f0f0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f0c004d00 0x7f0f0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240717d0 con 0x7f0f0c003fd0 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c00bb40 con 0x7f0f0c004d00 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c00bd00 con 0x7f0f240b35c0 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f237fe640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f0c003fd0 0x7f0f0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f23fff640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f240b35c0 0x7f0f0c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f28c4b640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f0c004d00 0x7f0f0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f237fe640 1 -- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f240b35c0 msgr2=0x7f0f0c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:44.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f237fe640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f240b35c0 0x7f0f0c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f237fe640 1 -- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f0c004d00 msgr2=0x7f0f0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f237fe640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f0c004d00 0x7f0f0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.432+0000 7f0f237fe640 1 -- 172.21.15.132:0/1122512824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c003520 con 0x7f0f0c003fd0 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.433+0000 7f0f237fe640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f0c003fd0 0x7f0f0c0047c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800ba30 tx=0x7f0f0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154d30f1a85c11cf server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.433+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18032640 con 0x7f0f0c003fd0 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.433+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f180327a0 con 0x7f0f0c003fd0 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.433+0000 7f0f22ffd640 1 -- 172.21.15.132:0/1122512824 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18032b30 con 0x7f0f0c003fd0 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.434+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/1122512824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f0c003fd0 msgr2=0x7f0f0c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.434+0000 7f0f2a6ae640 1 --2- 172.21.15.132:0/1122512824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f0c003fd0 0x7f0f0c0047c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800ba30 tx=0x7f0f0c0057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.434+0000 7f0f28c4b640 1 -- 172.21.15.132:0/1122512824 reap_dead start 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.434+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/1122512824 shutdown_connections 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.434+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/1122512824 >> 172.21.15.132:0/1122512824 conn(0x7f0f2406aee0 msgr2=0x7f0f2406b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.434+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/1122512824 shutdown_connections 2024-03-16T17:48:44.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.434+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/1122512824 wait complete. 2024-03-16T17:48:44.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.435+0000 7f0f2a6ae640 1 Processor -- start 2024-03-16T17:48:44.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.435+0000 7f0f2a6ae640 1 -- start start 2024-03-16T17:48:44.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f2a6ae640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c003fd0 0x7f0f240aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f2a6ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f24155740 0x7f0f2413e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f2a6ae640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f2413e540 0x7f0f240a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f2a6ae640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2413e9f0 con 0x7f0f24155740 2024-03-16T17:48:44.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f2a6ae640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f241f1570 con 0x7f0f2413e540 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f2a6ae640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240ab460 con 0x7f0f0c003fd0 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f237fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f24155740 0x7f0f2413e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f237fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f24155740 0x7f0f2413e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56496/0 (socket says 172.21.15.132:56496) 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f237fe640 1 -- 172.21.15.132:0/3152725301 learned_addr learned my addr 172.21.15.132:0/3152725301 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f28c4b640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f2413e540 0x7f0f240a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f23fff640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c003fd0 0x7f0f240aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f237fe640 1 -- 172.21.15.132:0/3152725301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c003fd0 msgr2=0x7f0f240aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f237fe640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c003fd0 0x7f0f240aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f237fe640 1 -- 172.21.15.132:0/3152725301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f2413e540 msgr2=0x7f0f240a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f237fe640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f2413e540 0x7f0f240a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f237fe640 1 -- 172.21.15.132:0/3152725301 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f241f4e60 con 0x7f0f24155740 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f28c4b640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f2413e540 0x7f0f240a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.436+0000 7f0f237fe640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f24155740 0x7f0f2413e000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0f18035040 tx=0x7f0f18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.437+0000 7f0f20ff9640 1 -- 172.21.15.132:0/3152725301 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18004220 con 0x7f0f24155740 2024-03-16T17:48:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.437+0000 7f0f20ff9640 1 -- 172.21.15.132:0/3152725301 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f18004380 con 0x7f0f24155740 2024-03-16T17:48:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.437+0000 7f0f20ff9640 1 -- 172.21.15.132:0/3152725301 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1803ba30 con 0x7f0f24155740 2024-03-16T17:48:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.437+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/3152725301 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f241f5140 con 0x7f0f24155740 2024-03-16T17:48:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.437+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/3152725301 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f241f5700 con 0x7f0f24155740 2024-03-16T17:48:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.438+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/3152725301 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f2404f2c0 con 0x7f0f24155740 2024-03-16T17:48:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.438+0000 7f0f20ff9640 1 -- 172.21.15.132:0/3152725301 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f0f1803bb90 con 0x7f0f24155740 2024-03-16T17:48:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.438+0000 7f0f20ff9640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0f1006b3e0 0x7f0f1006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.438+0000 7f0f20ff9640 1 -- 172.21.15.132:0/3152725301 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0f180ac180 con 0x7f0f24155740 2024-03-16T17:48:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.438+0000 7f0f23fff640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0f1006b3e0 0x7f0f1006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.439+0000 7f0f23fff640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0f1006b3e0 0x7f0f1006d8a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f14000c00 tx=0x7f0f14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:44.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.443+0000 7f0f20ff9640 1 -- 172.21.15.132:0/3152725301 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0f18077140 con 0x7f0f24155740 2024-03-16T17:48:44.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:48:44.480 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.620+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/3152725301 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0f2404f2c0 con 0x7f0f24155740 2024-03-16T17:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.620+0000 7f0f20ff9640 1 -- 172.21.15.132:0/3152725301 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0f1807a800 con 0x7f0f24155740 2024-03-16T17:48:44.624 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:44.624 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2024-03-16T17:48:44.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-03-16T17:48:44.624 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2024-03-16T17:48:44.624 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2024-03-16T17:48:44.624 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-03-16T17:48:44.625 INFO:teuthology.orchestra.run.smithi132.stdout:] 2024-03-16T17:48:44.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.622+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/3152725301 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0f1006b3e0 msgr2=0x7f0f1006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.622+0000 7f0f2a6ae640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0f1006b3e0 0x7f0f1006d8a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f14000c00 tx=0x7f0f14009040 comp rx=0 tx=0).stop 2024-03-16T17:48:44.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.622+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/3152725301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f24155740 msgr2=0x7f0f2413e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.622+0000 7f0f2a6ae640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f24155740 0x7f0f2413e000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0f18035040 tx=0x7f0f18004730 comp rx=0 tx=0).stop 2024-03-16T17:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.622+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/3152725301 shutdown_connections 2024-03-16T17:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.622+0000 7f0f2a6ae640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f0f1006b3e0 0x7f0f1006d8a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.622+0000 7f0f2a6ae640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f2413e540 0x7f0f240a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.622+0000 7f0f2a6ae640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f24155740 0x7f0f2413e000 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.622+0000 7f0f2a6ae640 1 --2- 172.21.15.132:0/3152725301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f0c003fd0 0x7f0f240aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.622+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/3152725301 >> 172.21.15.132:0/3152725301 conn(0x7f0f2406aee0 msgr2=0x7f0f240b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.623+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/3152725301 shutdown_connections 2024-03-16T17:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.623+0000 7f0f2a6ae640 1 -- 172.21.15.132:0/3152725301 wait complete. 2024-03-16T17:48:44.637 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-16T17:48:44.637 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-16T17:48:44.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.738+0000 7f30eb09d640 1 Processor -- start 2024-03-16T17:48:44.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.738+0000 7f30eb09d640 1 -- start start 2024-03-16T17:48:44.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30eb09d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4154b80 0x7f30e4072a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30eb09d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f30e40b2bb0 0x7f30e406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30eb09d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e406de30 con 0x7f30e406d9d0 2024-03-16T17:48:44.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30eb09d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e415b700 con 0x7f30e40b2bb0 2024-03-16T17:48:44.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30eb09d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e415aa80 con 0x7f30e4154b80 2024-03-16T17:48:44.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e963a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f30e406d9d0 0x7f30e415df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55994/0 (socket says 172.21.15.132:55994) 2024-03-16T17:48:44.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e963a640 1 -- 172.21.15.132:0/3523285893 learned_addr learned my addr 172.21.15.132:0/3523285893 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:44.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e3fff640 1 --2- 172.21.15.132:0/3523285893 >> v2:172.21.15.194:3300/0 conn(0x7f30e40b2bb0 0x7f30e406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e8e39640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4154b80 0x7f30e4072a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621515918 0 0) 0x7f30e406de30 con 0x7f30e406d9d0 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30d4003520 con 0x7f30e406d9d0 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3364758272 0 0) 0x7f30d4003520 con 0x7f30e406d9d0 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4154b80 msgr2=0x7f30e4072a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4154b80 0x7f30e4072a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 >> v2:172.21.15.194:3300/0 conn(0x7f30e40b2bb0 msgr2=0x7f30e406d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 --2- 172.21.15.132:0/3523285893 >> v2:172.21.15.194:3300/0 conn(0x7f30e40b2bb0 0x7f30e406d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e415ad60 con 0x7f30e406d9d0 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f30dc0019f0 con 0x7f30e406d9d0 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 >> v1:172.21.15.132:6789/0 conn(0x7f30e406d9d0 legacy=0x7f30e415df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4003970 0x7f30d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30d40047c0 0x7f30d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4154b80 0x7f30d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e415b700 con 0x7f30d40047c0 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.739+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e415aa80 con 0x7f30d4003970 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.740+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d400b980 con 0x7f30e4154b80 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.740+0000 7f30e3fff640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30d40047c0 0x7f30d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.740+0000 7f30e8e39640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4003970 0x7f30d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.740+0000 7f30e963a640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4154b80 0x7f30d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.740+0000 7f30e3fff640 1 -- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4154b80 msgr2=0x7f30d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.740+0000 7f30e3fff640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4154b80 0x7f30d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.740+0000 7f30e3fff640 1 -- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4003970 msgr2=0x7f30d4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.740+0000 7f30e3fff640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4003970 0x7f30d4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.740+0000 7f30e3fff640 1 -- 172.21.15.132:0/3523285893 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d4003520 con 0x7f30d40047c0 2024-03-16T17:48:44.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30e3fff640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30d40047c0 0x7f30d4004c40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009ac0 tx=0x7f30d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c62865c1f3e9832 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:44.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d002c6d0 con 0x7f30d40047c0 2024-03-16T17:48:44.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d002c830 con 0x7f30d40047c0 2024-03-16T17:48:44.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30e37fe640 1 -- 172.21.15.132:0/3523285893 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d002cbc0 con 0x7f30d40047c0 2024-03-16T17:48:44.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30eb09d640 1 -- 172.21.15.132:0/3523285893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30d40047c0 msgr2=0x7f30d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30eb09d640 1 --2- 172.21.15.132:0/3523285893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30d40047c0 0x7f30d4004c40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009ac0 tx=0x7f30d40057f0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30e963a640 1 -- 172.21.15.132:0/3523285893 reap_dead start 2024-03-16T17:48:44.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30eb09d640 1 -- 172.21.15.132:0/3523285893 shutdown_connections 2024-03-16T17:48:44.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30eb09d640 1 -- 172.21.15.132:0/3523285893 >> 172.21.15.132:0/3523285893 conn(0x7f30e406aee0 msgr2=0x7f30e406b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:44.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30eb09d640 1 -- 172.21.15.132:0/3523285893 shutdown_connections 2024-03-16T17:48:44.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.741+0000 7f30eb09d640 1 -- 172.21.15.132:0/3523285893 wait complete. 2024-03-16T17:48:44.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.742+0000 7f30eb09d640 1 Processor -- start 2024-03-16T17:48:44.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.743+0000 7f30eb09d640 1 -- start start 2024-03-16T17:48:44.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.743+0000 7f30eb09d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d40047c0 0x7f30e414c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.743+0000 7f30eb09d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4148970 0x7f30e41470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.743+0000 7f30eb09d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30e41453b0 0x7f30e4149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.743+0000 7f30eb09d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e41484e0 con 0x7f30e41453b0 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.743+0000 7f30eb09d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e41478d0 con 0x7f30d40047c0 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.743+0000 7f30eb09d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e4147bb0 con 0x7f30e4148970 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.743+0000 7f30e963a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30e41453b0 0x7f30e4149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.743+0000 7f30e963a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30e41453b0 0x7f30e4149da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56522/0 (socket says 172.21.15.132:56522) 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.743+0000 7f30e963a640 1 -- 172.21.15.132:0/1786380908 learned_addr learned my addr 172.21.15.132:0/1786380908 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30e963a640 1 -- 172.21.15.132:0/1786380908 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4148970 msgr2=0x7f30e41470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30e963a640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4148970 0x7f30e41470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30e963a640 1 -- 172.21.15.132:0/1786380908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d40047c0 msgr2=0x7f30e414c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30e963a640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d40047c0 0x7f30e414c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30e963a640 1 -- 172.21.15.132:0/1786380908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e4147e90 con 0x7f30e41453b0 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30e963a640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30e41453b0 0x7f30e4149da0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f30e4074be0 tx=0x7f30dc00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30e17fa640 1 -- 172.21.15.132:0/1786380908 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc007af0 con 0x7f30e41453b0 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30e17fa640 1 -- 172.21.15.132:0/1786380908 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc00ae50 con 0x7f30e41453b0 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30eb09d640 1 -- 172.21.15.132:0/1786380908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e4148170 con 0x7f30e41453b0 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30e17fa640 1 -- 172.21.15.132:0/1786380908 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc013610 con 0x7f30e41453b0 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.744+0000 7f30eb09d640 1 -- 172.21.15.132:0/1786380908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e4145840 con 0x7f30e41453b0 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.745+0000 7f30eb09d640 1 -- 172.21.15.132:0/1786380908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e4145a30 con 0x7f30e41453b0 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.745+0000 7f30e17fa640 1 -- 172.21.15.132:0/1786380908 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f30dc013770 con 0x7f30e41453b0 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.746+0000 7f30e17fa640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f30c806b3b0 0x7f30c806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.746+0000 7f30e17fa640 1 -- 172.21.15.132:0/1786380908 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f30dc08a040 con 0x7f30e41453b0 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.746+0000 7f30e8e39640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f30c806b3b0 0x7f30c806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.746+0000 7f30e8e39640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f30c806b3b0 0x7f30c806d870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009960 tx=0x7f30d8009d60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.750+0000 7f30e17fa640 1 -- 172.21.15.132:0/1786380908 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f30dc054ff0 con 0x7f30e41453b0 2024-03-16T17:48:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:44.921+0000 7f30eb09d640 1 -- 172.21.15.132:0/1786380908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f30e40735f0 con 0x7f30e41453b0 2024-03-16T17:48:45.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.724+0000 7f30e17fa640 1 -- 172.21.15.132:0/1786380908 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f30dc0586b0 con 0x7f30e41453b0 2024-03-16T17:48:45.728 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2024-03-16T17:48:45.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.727+0000 7f30eb09d640 1 -- 172.21.15.132:0/1786380908 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f30c806b3b0 msgr2=0x7f30c806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:45.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.727+0000 7f30eb09d640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f30c806b3b0 0x7f30c806d870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009960 tx=0x7f30d8009d60 comp rx=0 tx=0).stop 2024-03-16T17:48:45.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.727+0000 7f30eb09d640 1 -- 172.21.15.132:0/1786380908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30e41453b0 msgr2=0x7f30e4149da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:45.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.727+0000 7f30eb09d640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30e41453b0 0x7f30e4149da0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f30e4074be0 tx=0x7f30dc00a640 comp rx=0 tx=0).stop 2024-03-16T17:48:45.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.727+0000 7f30eb09d640 1 -- 172.21.15.132:0/1786380908 shutdown_connections 2024-03-16T17:48:45.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.727+0000 7f30eb09d640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f30c806b3b0 0x7f30c806d870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.727+0000 7f30eb09d640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30e41453b0 0x7f30e4149da0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.727+0000 7f30eb09d640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30e4148970 0x7f30e41470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.727+0000 7f30eb09d640 1 --2- 172.21.15.132:0/1786380908 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d40047c0 0x7f30e414c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.727+0000 7f30eb09d640 1 -- 172.21.15.132:0/1786380908 >> 172.21.15.132:0/1786380908 conn(0x7f30e406aee0 msgr2=0x7f30e4159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:45.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.728+0000 7f30eb09d640 1 -- 172.21.15.132:0/1786380908 shutdown_connections 2024-03-16T17:48:45.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.728+0000 7f30eb09d640 1 -- 172.21.15.132:0/1786380908 wait complete. 2024-03-16T17:48:45.749 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-16T17:48:45.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.857+0000 7ff49e0eb640 1 Processor -- start 2024-03-16T17:48:45.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.857+0000 7ff49e0eb640 1 -- start start 2024-03-16T17:48:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.857+0000 7ff49e0eb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff498154f90 0x7ff4980ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.857+0000 7ff49e0eb640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff4980b0050 0x7ff49806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.857+0000 7ff49e0eb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4980b04b0 0x7ff49806b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.857+0000 7ff49e0eb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff498155370 con 0x7ff4980b04b0 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.857+0000 7ff49e0eb640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff498161bd0 con 0x7ff4980b0050 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.857+0000 7ff49e0eb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff498161eb0 con 0x7ff498154f90 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.858+0000 7ff497fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4980b04b0 0x7ff49806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.858+0000 7ff497fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4980b04b0 0x7ff49806b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56538/0 (socket says 172.21.15.132:56538) 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.858+0000 7ff497fff640 1 -- 172.21.15.132:0/478046778 learned_addr learned my addr 172.21.15.132:0/478046778 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.858+0000 7ff4977fe640 1 --2- 172.21.15.132:0/478046778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff498154f90 0x7ff4980ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.858+0000 7ff496ffd640 1 --2- 172.21.15.132:0/478046778 >> v2:172.21.15.194:3300/0 conn(0x7ff4980b0050 0x7ff49806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.858+0000 7ff497fff640 1 -- 172.21.15.132:0/478046778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff498154f90 msgr2=0x7ff4980ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.858+0000 7ff497fff640 1 --2- 172.21.15.132:0/478046778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff498154f90 0x7ff4980ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.858+0000 7ff497fff640 1 -- 172.21.15.132:0/478046778 >> v2:172.21.15.194:3300/0 conn(0x7ff4980b0050 msgr2=0x7ff49806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.858+0000 7ff497fff640 1 --2- 172.21.15.132:0/478046778 >> v2:172.21.15.194:3300/0 conn(0x7ff4980b0050 0x7ff49806aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.858+0000 7ff497fff640 1 -- 172.21.15.132:0/478046778 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498162190 con 0x7ff4980b04b0 2024-03-16T17:48:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff497fff640 1 --2- 172.21.15.132:0/478046778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4980b04b0 0x7ff49806b420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff498071110 tx=0x7ff49002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c031b3f97d79c69b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff4967fc640 1 -- 172.21.15.132:0/478046778 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49002ca70 con 0x7ff4980b04b0 2024-03-16T17:48:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff4967fc640 1 -- 172.21.15.132:0/478046778 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49002cbd0 con 0x7ff4980b04b0 2024-03-16T17:48:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff4967fc640 1 -- 172.21.15.132:0/478046778 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4900343f0 con 0x7ff4980b04b0 2024-03-16T17:48:45.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff49e0eb640 1 -- 172.21.15.132:0/478046778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4980b04b0 msgr2=0x7ff49806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:45.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff49e0eb640 1 --2- 172.21.15.132:0/478046778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4980b04b0 0x7ff49806b420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff498071110 tx=0x7ff49002bed0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff49e0eb640 1 -- 172.21.15.132:0/478046778 shutdown_connections 2024-03-16T17:48:45.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff49e0eb640 1 --2- 172.21.15.132:0/478046778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4980b04b0 0x7ff49806b420 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff49e0eb640 1 --2- 172.21.15.132:0/478046778 >> v2:172.21.15.194:3300/0 conn(0x7ff4980b0050 0x7ff49806aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff49e0eb640 1 --2- 172.21.15.132:0/478046778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff498154f90 0x7ff4980ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff49e0eb640 1 -- 172.21.15.132:0/478046778 >> 172.21.15.132:0/478046778 conn(0x7ff49806bff0 msgr2=0x7ff49806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff49e0eb640 1 -- 172.21.15.132:0/478046778 shutdown_connections 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.859+0000 7ff49e0eb640 1 -- 172.21.15.132:0/478046778 wait complete. 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.861+0000 7ff49e0eb640 1 Processor -- start 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.861+0000 7ff49e0eb640 1 -- start start 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.861+0000 7ff49e0eb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4980b0050 0x7ff4980b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.861+0000 7ff49e0eb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4980b04b0 0x7ff4980b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.861+0000 7ff49e0eb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff498154f90 0x7ff4981f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.861+0000 7ff49e0eb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980b0e80 con 0x7ff498154f90 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.861+0000 7ff49e0eb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980b1120 con 0x7ff4980b0050 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.861+0000 7ff49e0eb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4980b1400 con 0x7ff4980b04b0 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff497fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff498154f90 0x7ff4981f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff497fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff498154f90 0x7ff4981f39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56544/0 (socket says 172.21.15.132:56544) 2024-03-16T17:48:45.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff497fff640 1 -- 172.21.15.132:0/341308812 learned_addr learned my addr 172.21.15.132:0/341308812 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff496ffd640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4980b04b0 0x7ff4980b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff4977fe640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4980b0050 0x7ff4980b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff497fff640 1 -- 172.21.15.132:0/341308812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4980b04b0 msgr2=0x7ff4980b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff497fff640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4980b04b0 0x7ff4980b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff497fff640 1 -- 172.21.15.132:0/341308812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4980b0050 msgr2=0x7ff4980b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff497fff640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4980b0050 0x7ff4980b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff497fff640 1 -- 172.21.15.132:0/341308812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490009b30 con 0x7ff498154f90 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff497fff640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff498154f90 0x7ff4981f39e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff490036040 tx=0x7ff490004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff47ffff640 1 -- 172.21.15.132:0/341308812 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490009510 con 0x7ff498154f90 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff47ffff640 1 -- 172.21.15.132:0/341308812 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49003e450 con 0x7ff498154f90 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff47ffff640 1 -- 172.21.15.132:0/341308812 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49003e7e0 con 0x7ff498154f90 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff49e0eb640 1 -- 172.21.15.132:0/341308812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4980b16e0 con 0x7ff498154f90 2024-03-16T17:48:45.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.862+0000 7ff49e0eb640 1 -- 172.21.15.132:0/341308812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4980b1ca0 con 0x7ff498154f90 2024-03-16T17:48:45.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.863+0000 7ff49e0eb640 1 -- 172.21.15.132:0/341308812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff498068450 con 0x7ff498154f90 2024-03-16T17:48:45.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.864+0000 7ff47ffff640 1 -- 172.21.15.132:0/341308812 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7ff49003e940 con 0x7ff498154f90 2024-03-16T17:48:45.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.864+0000 7ff47ffff640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff48406b3b0 0x7ff48406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:45.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.864+0000 7ff4977fe640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff48406b3b0 0x7ff48406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:45.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.864+0000 7ff47ffff640 1 -- 172.21.15.132:0/341308812 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff4900ac550 con 0x7ff498154f90 2024-03-16T17:48:45.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.865+0000 7ff4977fe640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff48406b3b0 0x7ff48406d870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff488009aa0 tx=0x7ff488009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:45.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:45.869+0000 7ff47ffff640 1 -- 172.21.15.132:0/341308812 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff490077440 con 0x7ff498154f90 2024-03-16T17:48:46.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.040+0000 7ff49e0eb640 1 -- 172.21.15.132:0/341308812 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff49804f2c0 con 0x7ff498154f90 2024-03-16T17:48:46.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.733+0000 7ff47ffff640 1 -- 172.21.15.132:0/341308812 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff49007ab00 con 0x7ff498154f90 2024-03-16T17:48:46.736 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2024-03-16T17:48:46.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 -- 172.21.15.132:0/341308812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff48406b3b0 msgr2=0x7ff48406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff48406b3b0 0x7ff48406d870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff488009aa0 tx=0x7ff488009190 comp rx=0 tx=0).stop 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 -- 172.21.15.132:0/341308812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff498154f90 msgr2=0x7ff4981f39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff498154f90 0x7ff4981f39e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff490036040 tx=0x7ff490004a40 comp rx=0 tx=0).stop 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 -- 172.21.15.132:0/341308812 shutdown_connections 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff48406b3b0 0x7ff48406d870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff498154f90 0x7ff4981f39e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4980b04b0 0x7ff4980b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 --2- 172.21.15.132:0/341308812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4980b0050 0x7ff4980b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 -- 172.21.15.132:0/341308812 >> 172.21.15.132:0/341308812 conn(0x7ff49806bff0 msgr2=0x7ff498160050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 -- 172.21.15.132:0/341308812 shutdown_connections 2024-03-16T17:48:46.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.736+0000 7ff49e0eb640 1 -- 172.21.15.132:0/341308812 wait complete. 2024-03-16T17:48:46.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-16T17:48:46.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.864+0000 7f7c0cf1e640 1 Processor -- start 2024-03-16T17:48:46.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.864+0000 7f7c0cf1e640 1 -- start start 2024-03-16T17:48:46.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c0cf1e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7c080d4a10 0x7f7c080d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:46.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c0cf1e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c080d26f0 0x7f7c080b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:46.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c0cf1e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c080d16a0 con 0x7f7c0815e220 2024-03-16T17:48:46.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c0cf1e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c080d4e70 con 0x7f7c080d26f0 2024-03-16T17:48:46.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c0cf1e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c080d2b60 con 0x7f7c080d4a10 2024-03-16T17:48:46.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c06d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c080d26f0 0x7f7c080b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:46.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c0659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7c0815e220 0x7f7c080d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47646/0 (socket says 172.21.15.132:47646) 2024-03-16T17:48:46.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c0659c640 1 -- 172.21.15.132:0/1332566880 learned_addr learned my addr 172.21.15.132:0/1332566880 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:46.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c05d9b640 1 --2- 172.21.15.132:0/1332566880 >> v2:172.21.15.194:3300/0 conn(0x7f7c080d4a10 0x7f7c080d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:46.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c06d9d640 1 -- 172.21.15.132:0/1332566880 >> v2:172.21.15.194:3300/0 conn(0x7f7c080d4a10 msgr2=0x7f7c080d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:46.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c06d9d640 1 --2- 172.21.15.132:0/1332566880 >> v2:172.21.15.194:3300/0 conn(0x7f7c080d4a10 0x7f7c080d21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:46.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c0559a640 1 -- 172.21.15.132:0/1332566880 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421994321 0 0) 0x7f7c080d16a0 con 0x7f7c0815e220 2024-03-16T17:48:46.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c06d9d640 1 -- 172.21.15.132:0/1332566880 >> v1:172.21.15.132:6789/0 conn(0x7f7c0815e220 legacy=0x7f7c080d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:46.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.865+0000 7f7c06d9d640 1 -- 172.21.15.132:0/1332566880 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c080b32f0 con 0x7f7c080d26f0 2024-03-16T17:48:46.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.866+0000 7f7c06d9d640 1 --2- 172.21.15.132:0/1332566880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c080d26f0 0x7f7c080b40b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7c08161d30 tx=0x7f7c0002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98236ca99ada8d18 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:46.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.866+0000 7f7c0559a640 1 -- 172.21.15.132:0/1332566880 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0002cc60 con 0x7f7c080d26f0 2024-03-16T17:48:46.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.866+0000 7f7c0559a640 1 -- 172.21.15.132:0/1332566880 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0002cdc0 con 0x7f7c080d26f0 2024-03-16T17:48:46.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.866+0000 7f7c0559a640 1 -- 172.21.15.132:0/1332566880 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00034660 con 0x7f7c080d26f0 2024-03-16T17:48:46.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.867+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/1332566880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c080d26f0 msgr2=0x7f7c080b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:46.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.867+0000 7f7c0cf1e640 1 --2- 172.21.15.132:0/1332566880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c080d26f0 0x7f7c080b40b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7c08161d30 tx=0x7f7c0002beb0 comp rx=0 tx=0).stop 2024-03-16T17:48:46.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.867+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/1332566880 shutdown_connections 2024-03-16T17:48:46.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.867+0000 7f7c0cf1e640 1 --2- 172.21.15.132:0/1332566880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c080d26f0 0x7f7c080b40b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:46.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.867+0000 7f7c0cf1e640 1 --2- 172.21.15.132:0/1332566880 >> v2:172.21.15.194:3300/0 conn(0x7f7c080d4a10 0x7f7c080d21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:46.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.867+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/1332566880 >> 172.21.15.132:0/1332566880 conn(0x7f7c080d3e80 msgr2=0x7f7c080d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:46.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.867+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/1332566880 shutdown_connections 2024-03-16T17:48:46.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.867+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/1332566880 wait complete. 2024-03-16T17:48:46.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.868+0000 7f7c0cf1e640 1 Processor -- start 2024-03-16T17:48:46.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.868+0000 7f7c0cf1e640 1 -- start start 2024-03-16T17:48:46.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c0cf1e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080d26f0 0x7f7c0815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c0cf1e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c080d4a10 0x7f7c0815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c0cf1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c0815e220 0x7f7c081f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c0cf1e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c081f4fe0 con 0x7f7c0815e220 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c0cf1e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c081f52c0 con 0x7f7c080d26f0 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c0cf1e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c081f55a0 con 0x7f7c080d4a10 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c06d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c0815e220 0x7f7c081f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c06d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c0815e220 0x7f7c081f08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37738/0 (socket says 172.21.15.132:37738) 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c06d9d640 1 -- 172.21.15.132:0/3847831942 learned_addr learned my addr 172.21.15.132:0/3847831942 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c0659c640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080d26f0 0x7f7c0815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c05d9b640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c080d4a10 0x7f7c0815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:46.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c06d9d640 1 -- 172.21.15.132:0/3847831942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c080d4a10 msgr2=0x7f7c0815edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c06d9d640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c080d4a10 0x7f7c0815edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c06d9d640 1 -- 172.21.15.132:0/3847831942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080d26f0 msgr2=0x7f7c0815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c06d9d640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080d26f0 0x7f7c0815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.869+0000 7f7c06d9d640 1 -- 172.21.15.132:0/3847831942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00009a70 con 0x7f7c0815e220 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.870+0000 7f7c06d9d640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c0815e220 0x7f7c081f08c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009d90 tx=0x7f7c00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.870+0000 7f7bf6ffd640 1 -- 172.21.15.132:0/3847831942 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00040650 con 0x7f7c0815e220 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.870+0000 7f7bf6ffd640 1 -- 172.21.15.132:0/3847831942 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c000407d0 con 0x7f7c0815e220 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.870+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/3847831942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c081f5880 con 0x7f7c0815e220 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.870+0000 7f7bf6ffd640 1 -- 172.21.15.132:0/3847831942 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00040b80 con 0x7f7c0815e220 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.870+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/3847831942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c08152080 con 0x7f7c0815e220 2024-03-16T17:48:46.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.871+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/3847831942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c08068450 con 0x7f7c0815e220 2024-03-16T17:48:46.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.871+0000 7f7bf6ffd640 1 -- 172.21.15.132:0/3847831942 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f7c00040ce0 con 0x7f7c0815e220 2024-03-16T17:48:46.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.872+0000 7f7bf6ffd640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7be806b3b0 0x7f7be806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:46.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.872+0000 7f7c0659c640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7be806b3b0 0x7f7be806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:46.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.872+0000 7f7bf6ffd640 1 -- 172.21.15.132:0/3847831942 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7c000ac950 con 0x7f7c0815e220 2024-03-16T17:48:46.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.872+0000 7f7c0659c640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7be806b3b0 0x7f7be806d870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8000f60 tx=0x7f7bf8007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:46.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:46.876+0000 7f7bf6ffd640 1 -- 172.21.15.132:0/3847831942 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7c000777e0 con 0x7f7c0815e220 2024-03-16T17:48:47.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.085+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/3847831942 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7c081f5da0 con 0x7f7c0815e220 2024-03-16T17:48:47.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.734+0000 7f7bf6ffd640 1 -- 172.21.15.132:0/3847831942 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7c0007aea0 con 0x7f7c0815e220 2024-03-16T17:48:47.738 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 4 and data pool 5 2024-03-16T17:48:47.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/3847831942 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7be806b3b0 msgr2=0x7f7be806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:47.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7be806b3b0 0x7f7be806d870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8000f60 tx=0x7f7bf8007d50 comp rx=0 tx=0).stop 2024-03-16T17:48:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/3847831942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c0815e220 msgr2=0x7f7c081f08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c0815e220 0x7f7c081f08c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009d90 tx=0x7f7c00004a40 comp rx=0 tx=0).stop 2024-03-16T17:48:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/3847831942 shutdown_connections 2024-03-16T17:48:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f7be806b3b0 0x7f7be806d870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c0815e220 0x7f7c081f08c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c080d4a10 0x7f7c0815edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 --2- 172.21.15.132:0/3847831942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c080d26f0 0x7f7c0815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/3847831942 >> 172.21.15.132:0/3847831942 conn(0x7f7c080d3e80 msgr2=0x7f7c0815d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/3847831942 shutdown_connections 2024-03-16T17:48:47.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.739+0000 7f7c0cf1e640 1 -- 172.21.15.132:0/3847831942 wait complete. 2024-03-16T17:48:47.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.868+0000 7fbbdd756640 1 Processor -- start 2024-03-16T17:48:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.868+0000 7fbbdd756640 1 -- start start 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbdd756640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbd815be30 0x7fbbd80b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbdd756640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbd80cfff0 0x7fbbd80d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbdd756640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd815c550 con 0x7fbbd806aee0 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbdd756640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd80d0990 con 0x7fbbd80cfff0 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbdd756640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd815c830 con 0x7fbbd815be30 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbd67fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbd80cfff0 0x7fbbd80d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbd67fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbd80cfff0 0x7fbbd80d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37752/0 (socket says 172.21.15.132:37752) 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbd67fc640 1 -- 172.21.15.132:0/1097141298 learned_addr learned my addr 172.21.15.132:0/1097141298 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbd6ffd640 1 --2- 172.21.15.132:0/1097141298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbd815be30 0x7fbbd80b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbd67fc640 1 -- 172.21.15.132:0/1097141298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbd815be30 msgr2=0x7fbbd80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbd67fc640 1 --2- 172.21.15.132:0/1097141298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbd815be30 0x7fbbd80b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbd67fc640 1 -- 172.21.15.132:0/1097141298 >> v1:172.21.15.194:6789/0 conn(0x7fbbd806aee0 legacy=0x7fbbd815faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.869+0000 7fbbd67fc640 1 -- 172.21.15.132:0/1097141298 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd815cb10 con 0x7fbbd80cfff0 2024-03-16T17:48:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.870+0000 7fbbd67fc640 1 --2- 172.21.15.132:0/1097141298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 0x7fbbd80d0450 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009870 tx=0x7fbbcc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65da55b32af90f76 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.870+0000 7fbbd5ffb640 1 -- 172.21.15.132:0/1097141298 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc031640 con 0x7fbbd80cfff0 2024-03-16T17:48:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.870+0000 7fbbd5ffb640 1 -- 172.21.15.132:0/1097141298 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc0317a0 con 0x7fbbd80cfff0 2024-03-16T17:48:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.870+0000 7fbbd5ffb640 1 -- 172.21.15.132:0/1097141298 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc031b30 con 0x7fbbd80cfff0 2024-03-16T17:48:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.871+0000 7fbbdd756640 1 -- 172.21.15.132:0/1097141298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 msgr2=0x7fbbd80d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.871+0000 7fbbdd756640 1 --2- 172.21.15.132:0/1097141298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 0x7fbbd80d0450 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009870 tx=0x7fbbcc02b8f0 comp rx=0 tx=0).stop 2024-03-16T17:48:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.871+0000 7fbbdd756640 1 -- 172.21.15.132:0/1097141298 shutdown_connections 2024-03-16T17:48:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.871+0000 7fbbdd756640 1 --2- 172.21.15.132:0/1097141298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 0x7fbbd80d0450 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.871+0000 7fbbdd756640 1 --2- 172.21.15.132:0/1097141298 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbd815be30 0x7fbbd80b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.871+0000 7fbbdd756640 1 -- 172.21.15.132:0/1097141298 >> 172.21.15.132:0/1097141298 conn(0x7fbbd806bff0 msgr2=0x7fbbd806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.871+0000 7fbbdd756640 1 -- 172.21.15.132:0/1097141298 shutdown_connections 2024-03-16T17:48:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.871+0000 7fbbdd756640 1 -- 172.21.15.132:0/1097141298 wait complete. 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.872+0000 7fbbdd756640 1 Processor -- start 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.872+0000 7fbbdd756640 1 -- start start 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbdd756640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbd806aee0 0x7fbbd81f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbdd756640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 0x7fbbd8152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbdd756640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbd815be30 0x7fbbd81534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbdd756640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8156370 con 0x7fbbd80cfff0 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbdd756640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8157190 con 0x7fbbd806aee0 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbdd756640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd81f4700 con 0x7fbbd815be30 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 0x7fbbd8152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 0x7fbbd8152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37762/0 (socket says 172.21.15.132:37762) 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd67fc640 1 -- 172.21.15.132:0/2605244798 learned_addr learned my addr 172.21.15.132:0/2605244798 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd6ffd640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbd806aee0 0x7fbbd81f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd77fe640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbd815be30 0x7fbbd81534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd67fc640 1 -- 172.21.15.132:0/2605244798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbd815be30 msgr2=0x7fbbd81534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd67fc640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbd815be30 0x7fbbd81534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd67fc640 1 -- 172.21.15.132:0/2605244798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbd806aee0 msgr2=0x7fbbd81f41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd67fc640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbd806aee0 0x7fbbd81f41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd67fc640 1 -- 172.21.15.132:0/2605244798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc0094d0 con 0x7fbbd80cfff0 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.873+0000 7fbbd67fc640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 0x7fbbd8152f80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc000c00 tx=0x7fbbcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.874+0000 7fbbbf7fe640 1 -- 172.21.15.132:0/2605244798 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc03a930 con 0x7fbbd80cfff0 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.874+0000 7fbbbf7fe640 1 -- 172.21.15.132:0/2605244798 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc03aa90 con 0x7fbbd80cfff0 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.874+0000 7fbbdd756640 1 -- 172.21.15.132:0/2605244798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd8156580 con 0x7fbbd80cfff0 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.874+0000 7fbbbf7fe640 1 -- 172.21.15.132:0/2605244798 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc03ae40 con 0x7fbbd80cfff0 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.874+0000 7fbbdd756640 1 -- 172.21.15.132:0/2605244798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd8156b40 con 0x7fbbd80cfff0 2024-03-16T17:48:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.875+0000 7fbbdd756640 1 -- 172.21.15.132:0/2605244798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd8157320 con 0x7fbbd80cfff0 2024-03-16T17:48:47.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.875+0000 7fbbbf7fe640 1 -- 172.21.15.132:0/2605244798 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fbbcc02f050 con 0x7fbbd80cfff0 2024-03-16T17:48:47.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.875+0000 7fbbbf7fe640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbbc406b3b0 0x7fbbc406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:47.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.875+0000 7fbbbf7fe640 1 -- 172.21.15.132:0/2605244798 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbcc0ab900 con 0x7fbbd80cfff0 2024-03-16T17:48:47.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.875+0000 7fbbd6ffd640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbbc406b3b0 0x7fbbc406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:47.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.876+0000 7fbbd6ffd640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbbc406b3b0 0x7fbbc406d870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8011340 tx=0x7fbbc800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:47.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:47.880+0000 7fbbbf7fe640 1 -- 172.21.15.132:0/2605244798 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbbcc076610 con 0x7fbbd80cfff0 2024-03-16T17:48:48.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.049+0000 7fbbdd756640 1 -- 172.21.15.132:0/2605244798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbd804f2c0 con 0x7fbbd80cfff0 2024-03-16T17:48:48.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.051+0000 7fbbbf7fe640 1 -- 172.21.15.132:0/2605244798 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16718 (secure 0 0 0) 0x7fbbcc079cd0 con 0x7fbbd80cfff0 2024-03-16T17:48:48.055 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:48.055 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:48:47.087123+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:48:44.940400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T17:48:46.059151+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:48.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.052+0000 7fbbdd756640 1 -- 172.21.15.132:0/2605244798 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbbc406b3b0 msgr2=0x7fbbc406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbbc406b3b0 0x7fbbc406d870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8011340 tx=0x7fbbc800b040 comp rx=0 tx=0).stop 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 -- 172.21.15.132:0/2605244798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 msgr2=0x7fbbd8152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 0x7fbbd8152f80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc000c00 tx=0x7fbbcc0046c0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 -- 172.21.15.132:0/2605244798 shutdown_connections 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fbbc406b3b0 0x7fbbc406d870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbd815be30 0x7fbbd81534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cfff0 0x7fbbd8152f80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 --2- 172.21.15.132:0/2605244798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbd806aee0 0x7fbbd81f41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 -- 172.21.15.132:0/2605244798 >> 172.21.15.132:0/2605244798 conn(0x7fbbd806bff0 msgr2=0x7fbbd80adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 -- 172.21.15.132:0/2605244798 shutdown_connections 2024-03-16T17:48:48.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.053+0000 7fbbdd756640 1 -- 172.21.15.132:0/2605244798 wait complete. 2024-03-16T17:48:48.068 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:48.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.164+0000 7fa9e6864640 1 Processor -- start 2024-03-16T17:48:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.164+0000 7fa9e6864640 1 -- start start 2024-03-16T17:48:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9e6864640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa9e015ce50 0x7fa9e0141520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9e6864640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 0x7fa9e00ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9e6864640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e0070d40 con 0x7fa9e013ef90 2024-03-16T17:48:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9e6864640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e015d480 con 0x7fa9e015ce50 2024-03-16T17:48:48.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9e6864640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0141ef0 con 0x7fa9e0141a60 2024-03-16T17:48:48.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9dffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa9e013ef90 0x7fa9e0072890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47656/0 (socket says 172.21.15.132:47656) 2024-03-16T17:48:48.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9dffff640 1 -- 172.21.15.132:0/2273555066 learned_addr learned my addr 172.21.15.132:0/2273555066 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:48.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9df7fe640 1 --2- 172.21.15.132:0/2273555066 >> v2:172.21.15.194:3300/0 conn(0x7fa9e015ce50 0x7fa9e0141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9e4e01640 1 --2- 172.21.15.132:0/2273555066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 0x7fa9e00ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9deffd640 1 -- 172.21.15.132:0/2273555066 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336922381 0 0) 0x7fa9e0070d40 con 0x7fa9e013ef90 2024-03-16T17:48:48.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.165+0000 7fa9deffd640 1 -- 172.21.15.132:0/2273555066 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9c8003520 con 0x7fa9e013ef90 2024-03-16T17:48:48.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.166+0000 7fa9deffd640 1 -- 172.21.15.132:0/2273555066 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 316055205 0 0) 0x7fa9c8003520 con 0x7fa9e013ef90 2024-03-16T17:48:48.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.166+0000 7fa9e4e01640 1 -- 172.21.15.132:0/2273555066 >> v2:172.21.15.194:3300/0 conn(0x7fa9e015ce50 msgr2=0x7fa9e0141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:48.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.166+0000 7fa9e4e01640 1 --2- 172.21.15.132:0/2273555066 >> v2:172.21.15.194:3300/0 conn(0x7fa9e015ce50 0x7fa9e0141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.166+0000 7fa9e4e01640 1 -- 172.21.15.132:0/2273555066 >> v1:172.21.15.132:6789/0 conn(0x7fa9e013ef90 legacy=0x7fa9e0072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.166+0000 7fa9e4e01640 1 -- 172.21.15.132:0/2273555066 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0071020 con 0x7fa9e0141a60 2024-03-16T17:48:48.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.166+0000 7fa9df7fe640 1 --2- 172.21.15.132:0/2273555066 >> v2:172.21.15.194:3300/0 conn(0x7fa9e015ce50 0x7fa9e0141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:48.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.166+0000 7fa9e4e01640 1 --2- 172.21.15.132:0/2273555066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 0x7fa9e00ae520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009d90 tx=0x7fa9d802bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d7418b66c35eeb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:48.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9deffd640 1 -- 172.21.15.132:0/2273555066 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0001670 con 0x7fa9e0141a60 2024-03-16T17:48:48.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9deffd640 1 -- 172.21.15.132:0/2273555066 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d802c8a0 con 0x7fa9e0141a60 2024-03-16T17:48:48.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9deffd640 1 -- 172.21.15.132:0/2273555066 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d802cc10 con 0x7fa9e0141a60 2024-03-16T17:48:48.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9e6864640 1 -- 172.21.15.132:0/2273555066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 msgr2=0x7fa9e00ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9e6864640 1 --2- 172.21.15.132:0/2273555066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 0x7fa9e00ae520 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009d90 tx=0x7fa9d802bd70 comp rx=0 tx=0).stop 2024-03-16T17:48:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9e6864640 1 -- 172.21.15.132:0/2273555066 shutdown_connections 2024-03-16T17:48:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9e6864640 1 --2- 172.21.15.132:0/2273555066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 0x7fa9e00ae520 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9e6864640 1 --2- 172.21.15.132:0/2273555066 >> v2:172.21.15.194:3300/0 conn(0x7fa9e015ce50 0x7fa9e0141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9e6864640 1 -- 172.21.15.132:0/2273555066 >> 172.21.15.132:0/2273555066 conn(0x7fa9e006aee0 msgr2=0x7fa9e006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9e6864640 1 -- 172.21.15.132:0/2273555066 shutdown_connections 2024-03-16T17:48:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.167+0000 7fa9e6864640 1 -- 172.21.15.132:0/2273555066 wait complete. 2024-03-16T17:48:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.168+0000 7fa9e6864640 1 Processor -- start 2024-03-16T17:48:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.169+0000 7fa9e6864640 1 -- start start 2024-03-16T17:48:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.169+0000 7fa9e6864640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e013ef90 0x7fa9e013c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.169+0000 7fa9e6864640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 0x7fa9e00ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.169+0000 7fa9e6864640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9e015ce50 0x7fa9e00ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.169+0000 7fa9e6864640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0140d50 con 0x7fa9e015ce50 2024-03-16T17:48:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.169+0000 7fa9e6864640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e00a9df0 con 0x7fa9e013ef90 2024-03-16T17:48:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.169+0000 7fa9e6864640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e013cc80 con 0x7fa9e0141a60 2024-03-16T17:48:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.169+0000 7fa9e4e01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9e015ce50 0x7fa9e00ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.169+0000 7fa9e4e01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9e015ce50 0x7fa9e00ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37764/0 (socket says 172.21.15.132:37764) 2024-03-16T17:48:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.169+0000 7fa9e4e01640 1 -- 172.21.15.132:0/3568837352 learned_addr learned my addr 172.21.15.132:0/3568837352 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9df7fe640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 0x7fa9e00ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9dffff640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e013ef90 0x7fa9e013c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9e4e01640 1 -- 172.21.15.132:0/3568837352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 msgr2=0x7fa9e00ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9e4e01640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 0x7fa9e00ac3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9e4e01640 1 -- 172.21.15.132:0/3568837352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e013ef90 msgr2=0x7fa9e013c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9e4e01640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e013ef90 0x7fa9e013c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9e4e01640 1 -- 172.21.15.132:0/3568837352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4009400 con 0x7fa9e015ce50 2024-03-16T17:48:48.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9dffff640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e013ef90 0x7fa9e013c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:48.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9e4e01640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9e015ce50 0x7fa9e00ac930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009d90 tx=0x7fa9d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:48.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9dcff9640 1 -- 172.21.15.132:0/3568837352 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8009450 con 0x7fa9e015ce50 2024-03-16T17:48:48.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9dcff9640 1 -- 172.21.15.132:0/3568837352 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d8004250 con 0x7fa9e015ce50 2024-03-16T17:48:48.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9e6864640 1 -- 172.21.15.132:0/3568837352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d8009a70 con 0x7fa9e015ce50 2024-03-16T17:48:48.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9dcff9640 1 -- 172.21.15.132:0/3568837352 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8004620 con 0x7fa9e015ce50 2024-03-16T17:48:48.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.170+0000 7fa9e6864640 1 -- 172.21.15.132:0/3568837352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e00aa090 con 0x7fa9e015ce50 2024-03-16T17:48:48.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.171+0000 7fa9e6864640 1 -- 172.21.15.132:0/3568837352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e00a9c30 con 0x7fa9e015ce50 2024-03-16T17:48:48.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.172+0000 7fa9dcff9640 1 -- 172.21.15.132:0/3568837352 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fa9d8040450 con 0x7fa9e015ce50 2024-03-16T17:48:48.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.172+0000 7fa9dcff9640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa9cc06b3b0 0x7fa9cc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.172+0000 7fa9dffff640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa9cc06b3b0 0x7fa9cc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.172+0000 7fa9dcff9640 1 -- 172.21.15.132:0/3568837352 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9d80ac2b0 con 0x7fa9e015ce50 2024-03-16T17:48:48.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.172+0000 7fa9dffff640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa9cc06b3b0 0x7fa9cc06d870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00a99f0 tx=0x7fa9d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:48.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.176+0000 7fa9dcff9640 1 -- 172.21.15.132:0/3568837352 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa9d80770c0 con 0x7fa9e015ce50 2024-03-16T17:48:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.349+0000 7fa9e6864640 1 -- 172.21.15.132:0/3568837352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9e004f2c0 con 0x7fa9e015ce50 2024-03-16T17:48:48.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.350+0000 7fa9dcff9640 1 -- 172.21.15.132:0/3568837352 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16718 (secure 0 0 0) 0x7fa9d807a780 con 0x7fa9e015ce50 2024-03-16T17:48:48.354 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:48.355 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:48:47.087123+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:48:44.940400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T17:48:46.059151+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 -- 172.21.15.132:0/3568837352 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa9cc06b3b0 msgr2=0x7fa9cc06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa9cc06b3b0 0x7fa9cc06d870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00a99f0 tx=0x7fa9d0009040 comp rx=0 tx=0).stop 2024-03-16T17:48:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 -- 172.21.15.132:0/3568837352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9e015ce50 msgr2=0x7fa9e00ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9e015ce50 0x7fa9e00ac930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009d90 tx=0x7fa9d8004a40 comp rx=0 tx=0).stop 2024-03-16T17:48:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 -- 172.21.15.132:0/3568837352 shutdown_connections 2024-03-16T17:48:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fa9cc06b3b0 0x7fa9cc06d870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9e015ce50 0x7fa9e00ac930 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9e0141a60 0x7fa9e00ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 --2- 172.21.15.132:0/3568837352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e013ef90 0x7fa9e013c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 -- 172.21.15.132:0/3568837352 >> 172.21.15.132:0/3568837352 conn(0x7fa9e006aee0 msgr2=0x7fa9e006b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.352+0000 7fa9e6864640 1 -- 172.21.15.132:0/3568837352 shutdown_connections 2024-03-16T17:48:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.353+0000 7fa9e6864640 1 -- 172.21.15.132:0/3568837352 wait complete. 2024-03-16T17:48:48.368 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-16T17:48:48.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.468+0000 7f5a4efc7640 1 Processor -- start 2024-03-16T17:48:48.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.468+0000 7f5a4efc7640 1 -- start start 2024-03-16T17:48:48.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a4efc7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a4806dba0 0x7f5a48072a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a4efc7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4815aa80 con 0x7f5a480b2bb0 2024-03-16T17:48:48.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a4efc7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4815ad60 con 0x7f5a48154b80 2024-03-16T17:48:48.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a4efc7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815b700 con 0x7f5a4806dba0 2024-03-16T17:48:48.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a4d564640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5a480b2bb0 0x7f5a48070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47666/0 (socket says 172.21.15.132:47666) 2024-03-16T17:48:48.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a4d564640 1 -- 172.21.15.132:0/2999137476 learned_addr learned my addr 172.21.15.132:0/2999137476 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:48.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a47fff640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a4806dba0 0x7f5a48072a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982328526 0 0) 0x7f5a4815aa80 con 0x7f5a480b2bb0 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a38005730 con 0x7f5a480b2bb0 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2789101654 0 0) 0x7f5a38005730 con 0x7f5a480b2bb0 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a4806dba0 msgr2=0x7f5a48072a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a4806dba0 0x7f5a48072a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 >> v1:172.21.15.194:6789/0 conn(0x7f5a48154b80 legacy=0x7f5a4806d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4815b040 con 0x7f5a480b2bb0 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f5a400019f0 con 0x7f5a480b2bb0 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 >> v1:172.21.15.132:6789/0 conn(0x7f5a480b2bb0 legacy=0x7f5a48070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a38005bb0 0x7f5a38005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 0x7f5a38006a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a4806dba0 0x7f5a38007290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815b700 con 0x7f5a38006560 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3800db90 con 0x7f5a38005bb0 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.469+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3800dd50 con 0x7f5a4806dba0 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.470+0000 7f5a47fff640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 0x7f5a38006a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.470+0000 7f5a4cd63640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a38005bb0 0x7f5a38005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.470+0000 7f5a4d564640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a4806dba0 0x7f5a38007290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.470+0000 7f5a47fff640 1 -- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a4806dba0 msgr2=0x7f5a38007290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.470+0000 7f5a47fff640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a4806dba0 0x7f5a38007290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.470+0000 7f5a47fff640 1 -- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a38005bb0 msgr2=0x7f5a38005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.470+0000 7f5a47fff640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a38005bb0 0x7f5a38005f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.470+0000 7f5a47fff640 1 -- 172.21.15.132:0/2999137476 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a38005730 con 0x7f5a38006560 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a47fff640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 0x7f5a38006a30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009ac0 tx=0x7f5a38007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695438410b233a13 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3402c6b0 con 0x7f5a38006560 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3402c810 con 0x7f5a38006560 2024-03-16T17:48:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a477fe640 1 -- 172.21.15.132:0/2999137476 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3402cba0 con 0x7f5a38006560 2024-03-16T17:48:48.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a4efc7640 1 -- 172.21.15.132:0/2999137476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 msgr2=0x7f5a38006a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a4efc7640 1 --2- 172.21.15.132:0/2999137476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 0x7f5a38006a30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009ac0 tx=0x7f5a38007a00 comp rx=0 tx=0).stop 2024-03-16T17:48:48.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a4d564640 1 -- 172.21.15.132:0/2999137476 reap_dead start 2024-03-16T17:48:48.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a4efc7640 1 -- 172.21.15.132:0/2999137476 shutdown_connections 2024-03-16T17:48:48.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a4efc7640 1 -- 172.21.15.132:0/2999137476 >> 172.21.15.132:0/2999137476 conn(0x7f5a4806aee0 msgr2=0x7f5a4806b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:48.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a4efc7640 1 -- 172.21.15.132:0/2999137476 shutdown_connections 2024-03-16T17:48:48.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.471+0000 7f5a4efc7640 1 -- 172.21.15.132:0/2999137476 wait complete. 2024-03-16T17:48:48.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.472+0000 7f5a4efc7640 1 Processor -- start 2024-03-16T17:48:48.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.472+0000 7f5a4efc7640 1 -- start start 2024-03-16T17:48:48.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.473+0000 7f5a4efc7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 0x7f5a481445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.473+0000 7f5a4efc7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a48150fd0 0x7f5a48155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.473+0000 7f5a4efc7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a48155b70 0x7f5a4815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.473+0000 7f5a4efc7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815d420 con 0x7f5a38006560 2024-03-16T17:48:48.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.473+0000 7f5a4efc7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48156020 con 0x7f5a48150fd0 2024-03-16T17:48:48.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.473+0000 7f5a4efc7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815d140 con 0x7f5a48155b70 2024-03-16T17:48:48.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.473+0000 7f5a4cd63640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 0x7f5a481445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.473+0000 7f5a4cd63640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 0x7f5a481445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37784/0 (socket says 172.21.15.132:37784) 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.473+0000 7f5a4cd63640 1 -- 172.21.15.132:0/701253926 learned_addr learned my addr 172.21.15.132:0/701253926 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.473+0000 7f5a47fff640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a48150fd0 0x7f5a48155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a4d564640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a48155b70 0x7f5a4815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a4cd63640 1 -- 172.21.15.132:0/701253926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a48155b70 msgr2=0x7f5a4815c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a4cd63640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a48155b70 0x7f5a4815c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a4cd63640 1 -- 172.21.15.132:0/701253926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a48150fd0 msgr2=0x7f5a48155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a4cd63640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a48150fd0 0x7f5a48155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a4cd63640 1 -- 172.21.15.132:0/701253926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4814df50 con 0x7f5a38006560 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a4d564640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a48155b70 0x7f5a4815c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a4cd63640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 0x7f5a481445c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00f7c0 tx=0x7f5a3c00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a457fa640 1 -- 172.21.15.132:0/701253926 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00fe70 con 0x7f5a38006560 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a457fa640 1 -- 172.21.15.132:0/701253926 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c0052e0 con 0x7f5a38006560 2024-03-16T17:48:48.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a4efc7640 1 -- 172.21.15.132:0/701253926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4814e230 con 0x7f5a38006560 2024-03-16T17:48:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a457fa640 1 -- 172.21.15.132:0/701253926 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00d970 con 0x7f5a38006560 2024-03-16T17:48:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.474+0000 7f5a4efc7640 1 -- 172.21.15.132:0/701253926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a48144b00 con 0x7f5a38006560 2024-03-16T17:48:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.475+0000 7f5a4efc7640 1 -- 172.21.15.132:0/701253926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4814ddb0 con 0x7f5a38006560 2024-03-16T17:48:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.475+0000 7f5a457fa640 1 -- 172.21.15.132:0/701253926 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f5a3c00dad0 con 0x7f5a38006560 2024-03-16T17:48:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.476+0000 7f5a457fa640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a2c06b3b0 0x7f5a2c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.476+0000 7f5a457fa640 1 -- 172.21.15.132:0/701253926 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a3c089c40 con 0x7f5a38006560 2024-03-16T17:48:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.476+0000 7f5a47fff640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a2c06b3b0 0x7f5a2c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.476+0000 7f5a47fff640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a2c06b3b0 0x7f5a2c06d870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009ac0 tx=0x7f5a34030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.480+0000 7f5a457fa640 1 -- 172.21.15.132:0/701253926 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5a4814ddb0 con 0x7f5a38006560 2024-03-16T17:48:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.687+0000 7f5a4efc7640 1 -- 172.21.15.132:0/701253926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5a4814e750 con 0x7f5a38006560 2024-03-16T17:48:48.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.749+0000 7f5a457fa640 1 -- 172.21.15.132:0/701253926 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5a4814e750 con 0x7f5a38006560 2024-03-16T17:48:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 -- 172.21.15.132:0/701253926 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a2c06b3b0 msgr2=0x7f5a2c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a2c06b3b0 0x7f5a2c06d870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009ac0 tx=0x7f5a34030000 comp rx=0 tx=0).stop 2024-03-16T17:48:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 -- 172.21.15.132:0/701253926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 msgr2=0x7f5a481445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 0x7f5a481445c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00f7c0 tx=0x7f5a3c00fc80 comp rx=0 tx=0).stop 2024-03-16T17:48:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 -- 172.21.15.132:0/701253926 shutdown_connections 2024-03-16T17:48:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f5a2c06b3b0 0x7f5a2c06d870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a48155b70 0x7f5a4815c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a48150fd0 0x7f5a48155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 --2- 172.21.15.132:0/701253926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a38006560 0x7f5a481445c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 -- 172.21.15.132:0/701253926 >> 172.21.15.132:0/701253926 conn(0x7f5a4806aee0 msgr2=0x7f5a48146490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 -- 172.21.15.132:0/701253926 shutdown_connections 2024-03-16T17:48:48.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.752+0000 7f5a4efc7640 1 -- 172.21.15.132:0/701253926 wait complete. 2024-03-16T17:48:48.767 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-16T17:48:48.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-16T17:48:48.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.868+0000 7fdcaa79a640 1 Processor -- start 2024-03-16T17:48:48.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.868+0000 7fdcaa79a640 1 -- start start 2024-03-16T17:48:48.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.868+0000 7fdcaa79a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdca4159b50 0x7fdca4160330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.868+0000 7fdcaa79a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdca406b5f0 0x7fdca40cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.868+0000 7fdcaa79a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca40cd800 con 0x7fdca40b57c0 2024-03-16T17:48:48.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.868+0000 7fdcaa79a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca415c2e0 con 0x7fdca406b5f0 2024-03-16T17:48:48.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.868+0000 7fdcaa79a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca4160870 con 0x7fdca4159b50 2024-03-16T17:48:48.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.869+0000 7fdca8d37640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdca406b5f0 0x7fdca40cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.869+0000 7fdca37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdca40b57c0 0x7fdca406aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47674/0 (socket says 172.21.15.132:47674) 2024-03-16T17:48:48.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.869+0000 7fdca37fe640 1 -- 172.21.15.132:0/843707241 learned_addr learned my addr 172.21.15.132:0/843707241 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:48.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.869+0000 7fdca3fff640 1 --2- 172.21.15.132:0/843707241 >> v2:172.21.15.194:3300/0 conn(0x7fdca4159b50 0x7fdca4160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.869+0000 7fdca8d37640 1 -- 172.21.15.132:0/843707241 >> v2:172.21.15.194:3300/0 conn(0x7fdca4159b50 msgr2=0x7fdca4160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:48.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.869+0000 7fdca8d37640 1 --2- 172.21.15.132:0/843707241 >> v2:172.21.15.194:3300/0 conn(0x7fdca4159b50 0x7fdca4160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.869+0000 7fdca8d37640 1 -- 172.21.15.132:0/843707241 >> v1:172.21.15.132:6789/0 conn(0x7fdca40b57c0 legacy=0x7fdca406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.869+0000 7fdca8d37640 1 -- 172.21.15.132:0/843707241 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40b5f60 con 0x7fdca406b5f0 2024-03-16T17:48:48.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.869+0000 7fdca2ffd640 1 -- 172.21.15.132:0/843707241 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641126083 0 0) 0x7fdca40cd800 con 0x7fdca40b57c0 2024-03-16T17:48:48.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.870+0000 7fdca8d37640 1 --2- 172.21.15.132:0/843707241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca406b5f0 0x7fdca40cef50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdca4071ce0 tx=0x7fdc9c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f136de1ecdad80b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.870+0000 7fdca2ffd640 1 -- 172.21.15.132:0/843707241 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c02cc80 con 0x7fdca406b5f0 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.870+0000 7fdca2ffd640 1 -- 172.21.15.132:0/843707241 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c02cde0 con 0x7fdca406b5f0 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.870+0000 7fdca2ffd640 1 -- 172.21.15.132:0/843707241 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c034660 con 0x7fdca406b5f0 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.871+0000 7fdcaa79a640 1 -- 172.21.15.132:0/843707241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca406b5f0 msgr2=0x7fdca40cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.871+0000 7fdcaa79a640 1 --2- 172.21.15.132:0/843707241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca406b5f0 0x7fdca40cef50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdca4071ce0 tx=0x7fdc9c02bed0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.871+0000 7fdcaa79a640 1 -- 172.21.15.132:0/843707241 shutdown_connections 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.871+0000 7fdcaa79a640 1 --2- 172.21.15.132:0/843707241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca406b5f0 0x7fdca40cef50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.871+0000 7fdcaa79a640 1 --2- 172.21.15.132:0/843707241 >> v2:172.21.15.194:3300/0 conn(0x7fdca4159b50 0x7fdca4160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.871+0000 7fdcaa79a640 1 -- 172.21.15.132:0/843707241 >> 172.21.15.132:0/843707241 conn(0x7fdca406bff0 msgr2=0x7fdca406c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.871+0000 7fdcaa79a640 1 -- 172.21.15.132:0/843707241 shutdown_connections 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.871+0000 7fdcaa79a640 1 -- 172.21.15.132:0/843707241 wait complete. 2024-03-16T17:48:48.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.872+0000 7fdcaa79a640 1 Processor -- start 2024-03-16T17:48:48.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.872+0000 7fdcaa79a640 1 -- start start 2024-03-16T17:48:48.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdcaa79a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca406b5f0 0x7fdca406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdcaa79a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdca40b57c0 0x7fdca40ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdcaa79a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca4159b50 0x7fdca41462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdcaa79a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40afd30 con 0x7fdca4159b50 2024-03-16T17:48:48.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdcaa79a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41537a0 con 0x7fdca406b5f0 2024-03-16T17:48:48.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdcaa79a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4153a80 con 0x7fdca40b57c0 2024-03-16T17:48:48.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca8d37640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca4159b50 0x7fdca41462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca8d37640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca4159b50 0x7fdca41462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37806/0 (socket says 172.21.15.132:37806) 2024-03-16T17:48:48.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca8d37640 1 -- 172.21.15.132:0/2973943360 learned_addr learned my addr 172.21.15.132:0/2973943360 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:48.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca37fe640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdca40b57c0 0x7fdca40ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca3fff640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca406b5f0 0x7fdca406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca8d37640 1 -- 172.21.15.132:0/2973943360 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdca40b57c0 msgr2=0x7fdca40ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca8d37640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdca40b57c0 0x7fdca40ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca8d37640 1 -- 172.21.15.132:0/2973943360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca406b5f0 msgr2=0x7fdca406eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:48.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca8d37640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca406b5f0 0x7fdca406eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:48.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca8d37640 1 -- 172.21.15.132:0/2973943360 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c009a70 con 0x7fdca4159b50 2024-03-16T17:48:48.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.873+0000 7fdca8d37640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca4159b50 0x7fdca41462a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c037040 tx=0x7fdc9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:48.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.874+0000 7fdca0ff9640 1 -- 172.21.15.132:0/2973943360 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c040650 con 0x7fdca4159b50 2024-03-16T17:48:48.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.874+0000 7fdca0ff9640 1 -- 172.21.15.132:0/2973943360 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c0407b0 con 0x7fdca4159b50 2024-03-16T17:48:48.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.874+0000 7fdcaa79a640 1 -- 172.21.15.132:0/2973943360 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca4153d60 con 0x7fdca4159b50 2024-03-16T17:48:48.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.874+0000 7fdca0ff9640 1 -- 172.21.15.132:0/2973943360 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c040b60 con 0x7fdca4159b50 2024-03-16T17:48:48.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.874+0000 7fdcaa79a640 1 -- 172.21.15.132:0/2973943360 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca4154320 con 0x7fdca4159b50 2024-03-16T17:48:48.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.875+0000 7fdcaa79a640 1 -- 172.21.15.132:0/2973943360 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca4154510 con 0x7fdca4159b50 2024-03-16T17:48:48.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.875+0000 7fdca0ff9640 1 -- 172.21.15.132:0/2973943360 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fdc9c040cc0 con 0x7fdca4159b50 2024-03-16T17:48:48.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.876+0000 7fdca0ff9640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdc9006b3b0 0x7fdc9006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:48.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.876+0000 7fdca3fff640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdc9006b3b0 0x7fdc9006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:48.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.876+0000 7fdca0ff9640 1 -- 172.21.15.132:0/2973943360 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc9c0ac9e0 con 0x7fdca4159b50 2024-03-16T17:48:48.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.876+0000 7fdca3fff640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdc9006b3b0 0x7fdc9006d870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdc94006fd0 tx=0x7fdc94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:48.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:48.880+0000 7fdca0ff9640 1 -- 172.21.15.132:0/2973943360 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdc9c077650 con 0x7fdca4159b50 2024-03-16T17:48:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.095+0000 7fdcaa79a640 1 -- 172.21.15.132:0/2973943360 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdca40734e0 con 0x7fdca4159b50 2024-03-16T17:48:49.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.751+0000 7fdca0ff9640 1 -- 172.21.15.132:0/2973943360 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc9c009450 con 0x7fdca4159b50 2024-03-16T17:48:49.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 -- 172.21.15.132:0/2973943360 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdc9006b3b0 msgr2=0x7fdc9006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:49.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdc9006b3b0 0x7fdc9006d870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdc94006fd0 tx=0x7fdc94008040 comp rx=0 tx=0).stop 2024-03-16T17:48:49.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 -- 172.21.15.132:0/2973943360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca4159b50 msgr2=0x7fdca41462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca4159b50 0x7fdca41462a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c037040 tx=0x7fdc9c004a40 comp rx=0 tx=0).stop 2024-03-16T17:48:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 -- 172.21.15.132:0/2973943360 shutdown_connections 2024-03-16T17:48:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fdc9006b3b0 0x7fdc9006d870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdca4159b50 0x7fdca41462a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdca40b57c0 0x7fdca40ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 --2- 172.21.15.132:0/2973943360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdca406b5f0 0x7fdca406eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 -- 172.21.15.132:0/2973943360 >> 172.21.15.132:0/2973943360 conn(0x7fdca406bff0 msgr2=0x7fdca406aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 -- 172.21.15.132:0/2973943360 shutdown_connections 2024-03-16T17:48:49.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.754+0000 7fdcaa79a640 1 -- 172.21.15.132:0/2973943360 wait complete. 2024-03-16T17:48:49.769 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-16T17:48:49.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:48:49.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.866+0000 7f389f55c640 1 Processor -- start 2024-03-16T17:48:49.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.867+0000 7f389f55c640 1 -- start start 2024-03-16T17:48:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.867+0000 7f389f55c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3898161540 0x7f38980b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.867+0000 7f389f55c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980d0680 con 0x7f38980cf080 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.867+0000 7f389f55c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980d08d0 con 0x7f38980d1980 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.867+0000 7f389f55c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38980b4f30 con 0x7f3898161540 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.868+0000 7f389d2f8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3898161540 0x7f38980b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.868+0000 7f389d2f8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3898161540 0x7f38980b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37812/0 (socket says 172.21.15.132:37812) 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.868+0000 7f389d2f8640 1 -- 172.21.15.132:0/1415755370 learned_addr learned my addr 172.21.15.132:0/1415755370 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.868+0000 7f389caf7640 1 --1- 172.21.15.132:0/1415755370 >> v1:172.21.15.132:6789/0 conn(0x7f38980cf080 0x7f38980cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47678/0 (socket says 172.21.15.132:47678) 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.868+0000 7f389d2f8640 1 -- 172.21.15.132:0/1415755370 >> v1:172.21.15.194:6789/0 conn(0x7f38980d1980 legacy=0x7f38980d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.868+0000 7f389d2f8640 1 -- 172.21.15.132:0/1415755370 >> v1:172.21.15.132:6789/0 conn(0x7f38980cf080 legacy=0x7f38980cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.868+0000 7f389d2f8640 1 -- 172.21.15.132:0/1415755370 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980d0bb0 con 0x7f3898161540 2024-03-16T17:48:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.868+0000 7f388ffff640 1 -- 172.21.15.132:0/1415755370 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734258488 0 0) 0x7f38980d0680 con 0x7f38980cf080 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.869+0000 7f389d2f8640 1 --2- 172.21.15.132:0/1415755370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3898161540 0x7f38980b3560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3894009870 tx=0x7f389402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda3067efd76518b server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.869+0000 7f388ffff640 1 -- 172.21.15.132:0/1415755370 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894030860 con 0x7f3898161540 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.869+0000 7f388ffff640 1 -- 172.21.15.132:0/1415755370 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38940309c0 con 0x7f3898161540 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.869+0000 7f388ffff640 1 -- 172.21.15.132:0/1415755370 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894030d50 con 0x7f3898161540 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.869+0000 7f389f55c640 1 -- 172.21.15.132:0/1415755370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3898161540 msgr2=0x7f38980b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.869+0000 7f389f55c640 1 --2- 172.21.15.132:0/1415755370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3898161540 0x7f38980b3560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3894009870 tx=0x7f389402b9a0 comp rx=0 tx=0).stop 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.869+0000 7f389f55c640 1 -- 172.21.15.132:0/1415755370 shutdown_connections 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.869+0000 7f389f55c640 1 --2- 172.21.15.132:0/1415755370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3898161540 0x7f38980b3560 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.869+0000 7f389f55c640 1 -- 172.21.15.132:0/1415755370 >> 172.21.15.132:0/1415755370 conn(0x7f389809d120 msgr2=0x7f38980d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.870+0000 7f389f55c640 1 -- 172.21.15.132:0/1415755370 shutdown_connections 2024-03-16T17:48:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.870+0000 7f389f55c640 1 -- 172.21.15.132:0/1415755370 wait complete. 2024-03-16T17:48:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.871+0000 7f389f55c640 1 Processor -- start 2024-03-16T17:48:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.871+0000 7f389f55c640 1 -- start start 2024-03-16T17:48:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.871+0000 7f389f55c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38980cf080 0x7f3898152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.871+0000 7f389f55c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38980d1980 0x7f3898161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.871+0000 7f389f55c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3898161540 0x7f3898161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.871+0000 7f389f55c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980cdca0 con 0x7f38980cf080 2024-03-16T17:48:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.871+0000 7f389f55c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980b9930 con 0x7f3898161540 2024-03-16T17:48:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.871+0000 7f389f55c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980ccc00 con 0x7f38980d1980 2024-03-16T17:48:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.871+0000 7f389d2f8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38980cf080 0x7f3898152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389d2f8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38980cf080 0x7f3898152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37816/0 (socket says 172.21.15.132:37816) 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389d2f8640 1 -- 172.21.15.132:0/2426098304 learned_addr learned my addr 172.21.15.132:0/2426098304 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389caf7640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38980d1980 0x7f3898161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389daf9640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3898161540 0x7f3898161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389d2f8640 1 -- 172.21.15.132:0/2426098304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38980d1980 msgr2=0x7f3898161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389d2f8640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38980d1980 0x7f3898161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389d2f8640 1 -- 172.21.15.132:0/2426098304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3898161540 msgr2=0x7f3898161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389d2f8640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3898161540 0x7f3898161e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389d2f8640 1 -- 172.21.15.132:0/2426098304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940094d0 con 0x7f38980cf080 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389d2f8640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38980cf080 0x7f3898152230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3894009870 tx=0x7f3894004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f388dffb640 1 -- 172.21.15.132:0/2426098304 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894030810 con 0x7f38980cf080 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f388dffb640 1 -- 172.21.15.132:0/2426098304 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3894039d90 con 0x7f38980cf080 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389f55c640 1 -- 172.21.15.132:0/2426098304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38980ccee0 con 0x7f38980cf080 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f388dffb640 1 -- 172.21.15.132:0/2426098304 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894043630 con 0x7f38980cf080 2024-03-16T17:48:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.872+0000 7f389f55c640 1 -- 172.21.15.132:0/2426098304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38980cd4a0 con 0x7f38980cf080 2024-03-16T17:48:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.873+0000 7f389f55c640 1 -- 172.21.15.132:0/2426098304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38980cc950 con 0x7f38980cf080 2024-03-16T17:48:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.874+0000 7f388dffb640 1 -- 172.21.15.132:0/2426098304 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f389404c3b0 con 0x7f38980cf080 2024-03-16T17:48:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.874+0000 7f388dffb640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f387c06b3b0 0x7f387c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.874+0000 7f388dffb640 1 -- 172.21.15.132:0/2426098304 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38940ac320 con 0x7f38980cf080 2024-03-16T17:48:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.874+0000 7f389caf7640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f387c06b3b0 0x7f387c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.875+0000 7f389caf7640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f387c06b3b0 0x7f387c06d870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3888007fd0 tx=0x7f3888009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:49.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:49.882+0000 7f388dffb640 1 -- 172.21.15.132:0/2426098304 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3894076f80 con 0x7f38980cf080 2024-03-16T17:48:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.095+0000 7f389f55c640 1 -- 172.21.15.132:0/2426098304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f389804f2c0 con 0x7f38980cf080 2024-03-16T17:48:50.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.096+0000 7f388dffb640 1 -- 172.21.15.132:0/2426098304 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4979 (secure 0 0 0) 0x7f389407a640 con 0x7f38980cf080 2024-03-16T17:48:50.100 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:50.100 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/113905029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":113905029},{"type":"v1","addr":"172.21.15.194:6835","nonce":113905029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/951306128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":951306128},{"type":"v1","addr":"172.21.15.194:6834","nonce":951306128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5055,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/913030001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":913030001},{"type":"v1","addr":"172.21.15.132:6835","nonce":913030001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T17:48:47.087430+0000","modified":"2024-03-16T17:48:49.097247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6837/4278287334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4278287334},{"type":"v1","addr":"172.21.15.132:6837","nonce":4278287334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5073,"qdb_cluster":[5073]},"id":2}]} 2024-03-16T17:48:50.100 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 14 2024-03-16T17:48:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 -- 172.21.15.132:0/2426098304 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f387c06b3b0 msgr2=0x7f387c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f387c06b3b0 0x7f387c06d870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3888007fd0 tx=0x7f3888009040 comp rx=0 tx=0).stop 2024-03-16T17:48:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 -- 172.21.15.132:0/2426098304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38980cf080 msgr2=0x7f3898152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38980cf080 0x7f3898152230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3894009870 tx=0x7f3894004730 comp rx=0 tx=0).stop 2024-03-16T17:48:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 -- 172.21.15.132:0/2426098304 shutdown_connections 2024-03-16T17:48:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f387c06b3b0 0x7f387c06d870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3898161540 0x7f3898161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38980d1980 0x7f3898161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 --2- 172.21.15.132:0/2426098304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38980cf080 0x7f3898152230 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 -- 172.21.15.132:0/2426098304 >> 172.21.15.132:0/2426098304 conn(0x7f389809d120 msgr2=0x7f389806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 -- 172.21.15.132:0/2426098304 shutdown_connections 2024-03-16T17:48:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.098+0000 7f389f55c640 1 -- 172.21.15.132:0/2426098304 wait complete. 2024-03-16T17:48:50.113 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-16T17:48:50.161 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T17:48:50.157+0000 7f761d810640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-16T17:48:50.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.209+0000 7f2e1f89d640 1 Processor -- start 2024-03-16T17:48:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.209+0000 7f2e1f89d640 1 -- start start 2024-03-16T17:48:50.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1f89d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e18151470 0x7f2e180729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1f89d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e180b2bb0 0x7f2e1806d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1f89d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1815b670 con 0x7f2e1806d9d0 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1f89d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1806de60 con 0x7f2e18151470 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1f89d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180b2ff0 con 0x7f2e180b2bb0 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1d639640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e18151470 0x7f2e180729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1d639640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e18151470 0x7f2e180729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37828/0 (socket says 172.21.15.132:37828) 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1d639640 1 -- 172.21.15.132:0/3073275382 learned_addr learned my addr 172.21.15.132:0/3073275382 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1ce38640 1 --2- 172.21.15.132:0/3073275382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e180b2bb0 0x7f2e1806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1d639640 1 -- 172.21.15.132:0/3073275382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e180b2bb0 msgr2=0x7f2e1806d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1d639640 1 --2- 172.21.15.132:0/3073275382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e180b2bb0 0x7f2e1806d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1d639640 1 -- 172.21.15.132:0/3073275382 >> v1:172.21.15.194:6789/0 conn(0x7f2e1806d9d0 legacy=0x7f2e1815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.210+0000 7f2e1d639640 1 -- 172.21.15.132:0/3073275382 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1815ad40 con 0x7f2e18151470 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.211+0000 7f2e1d639640 1 --2- 172.21.15.132:0/3073275382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 0x7f2e180729d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009870 tx=0x7f2e0802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef44cdbd5f2f38d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.211+0000 7f2e0ffff640 1 -- 172.21.15.132:0/3073275382 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08030840 con 0x7f2e18151470 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.211+0000 7f2e0ffff640 1 -- 172.21.15.132:0/3073275382 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e080309a0 con 0x7f2e18151470 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.211+0000 7f2e0ffff640 1 -- 172.21.15.132:0/3073275382 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08030d30 con 0x7f2e18151470 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.212+0000 7f2e1f89d640 1 -- 172.21.15.132:0/3073275382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 msgr2=0x7f2e180729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.212+0000 7f2e1f89d640 1 --2- 172.21.15.132:0/3073275382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 0x7f2e180729d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009870 tx=0x7f2e0802b980 comp rx=0 tx=0).stop 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.212+0000 7f2e1f89d640 1 -- 172.21.15.132:0/3073275382 shutdown_connections 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.212+0000 7f2e1f89d640 1 --2- 172.21.15.132:0/3073275382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e180b2bb0 0x7f2e1806d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.212+0000 7f2e1f89d640 1 --2- 172.21.15.132:0/3073275382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 0x7f2e180729d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.212+0000 7f2e1f89d640 1 -- 172.21.15.132:0/3073275382 >> 172.21.15.132:0/3073275382 conn(0x7f2e1806aee0 msgr2=0x7f2e1806b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.212+0000 7f2e1f89d640 1 -- 172.21.15.132:0/3073275382 shutdown_connections 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.212+0000 7f2e1f89d640 1 -- 172.21.15.132:0/3073275382 wait complete. 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.213+0000 7f2e1f89d640 1 Processor -- start 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.213+0000 7f2e1f89d640 1 -- start start 2024-03-16T17:48:50.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.213+0000 7f2e1f89d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e1806d9d0 0x7f2e18130250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.213+0000 7f2e1f89d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e180b2bb0 0x7f2e181f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.213+0000 7f2e1f89d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 0x7f2e18148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.213+0000 7f2e1f89d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18131240 con 0x7f2e18151470 2024-03-16T17:48:50.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1f89d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18130790 con 0x7f2e180b2bb0 2024-03-16T17:48:50.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1f89d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e181f27b0 con 0x7f2e1806d9d0 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1de3a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 0x7f2e18148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1de3a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 0x7f2e18148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37840/0 (socket says 172.21.15.132:37840) 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1de3a640 1 -- 172.21.15.132:0/1929546874 learned_addr learned my addr 172.21.15.132:0/1929546874 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1d639640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e1806d9d0 0x7f2e18130250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1ce38640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e180b2bb0 0x7f2e181f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1de3a640 1 -- 172.21.15.132:0/1929546874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e1806d9d0 msgr2=0x7f2e18130250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1de3a640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e1806d9d0 0x7f2e18130250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1de3a640 1 -- 172.21.15.132:0/1929546874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e180b2bb0 msgr2=0x7f2e181f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1de3a640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e180b2bb0 0x7f2e181f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1de3a640 1 -- 172.21.15.132:0/1929546874 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e080094d0 con 0x7f2e18151470 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1d639640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e1806d9d0 0x7f2e18130250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1ce38640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e180b2bb0 0x7f2e181f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1de3a640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 0x7f2e18148570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c7a0 tx=0x7f2e1000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:50.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e0dffb640 1 -- 172.21.15.132:0/1929546874 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10003b70 con 0x7f2e18151470 2024-03-16T17:48:50.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e0dffb640 1 -- 172.21.15.132:0/1929546874 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e10003cf0 con 0x7f2e18151470 2024-03-16T17:48:50.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1f89d640 1 -- 172.21.15.132:0/1929546874 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e181309a0 con 0x7f2e18151470 2024-03-16T17:48:50.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e0dffb640 1 -- 172.21.15.132:0/1929546874 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10003ea0 con 0x7f2e18151470 2024-03-16T17:48:50.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.214+0000 7f2e1f89d640 1 -- 172.21.15.132:0/1929546874 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e18130f60 con 0x7f2e18151470 2024-03-16T17:48:50.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.216+0000 7f2e1f89d640 1 -- 172.21.15.132:0/1929546874 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1804f2c0 con 0x7f2e18151470 2024-03-16T17:48:50.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.216+0000 7f2e0dffb640 1 -- 172.21.15.132:0/1929546874 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f2e1000aa90 con 0x7f2e18151470 2024-03-16T17:48:50.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.216+0000 7f2e0dffb640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2dfc06b3b0 0x7f2dfc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.216+0000 7f2e0dffb640 1 -- 172.21.15.132:0/1929546874 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e10089a80 con 0x7f2e18151470 2024-03-16T17:48:50.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.216+0000 7f2e1d639640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2dfc06b3b0 0x7f2dfc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.217+0000 7f2e1d639640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2dfc06b3b0 0x7f2dfc06d870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2e08036000 tx=0x7f2e0803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:50.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.220+0000 7f2e0dffb640 1 -- 172.21.15.132:0/1929546874 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2e100546e0 con 0x7f2e18151470 2024-03-16T17:48:50.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.398+0000 7f2e1f89d640 1 -- 172.21.15.132:0/1929546874 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e18167290 con 0x7f2e18151470 2024-03-16T17:48:50.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.399+0000 7f2e0dffb640 1 -- 172.21.15.132:0/1929546874 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16705 (secure 0 0 0) 0x7f2e10057da0 con 0x7f2e18151470 2024-03-16T17:48:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:50.403 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":33,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","created":"2024-03-16T17:47:25.658243+0000","modified":"2024-03-16T17:48:48.744708+0000","last_up_change":"2024-03-16T17:47:36.881904+0000","last_in_change":"2024-03-16T17:47:27.888004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-16T17:47:37.885510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-16T17:48:44.940400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-16T17:48:46.059151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dc3dbe63-eadb-4a7b-bb62-4659f908734c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6809","nonce":2901901742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6811","nonce":2901901742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6815","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6817","nonce":2901901742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2901901742},{"type":"v1","addr":"172.21.15.132:6813","nonce":2901901742}]},"public_addr":"172.21.15.132:6809/2901901742","cluster_addr":"172.21.15.132:6811/2901901742","heartbeat_back_addr":"172.21.15.132:6817/2901901742","heartbeat_front_addr":"172.21.15.132:6813/2901901742","state":["exists","up"]},{"osd":1,"uuid":"e9e236e1-da95-470c-862f-21ec1b3a2cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6816","nonce":3891166784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6819","nonce":3891166784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6823","nonce":3891166784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":3891166784},{"type":"v1","addr":"172.21.15.132:6821","nonce":3891166784}]},"public_addr":"172.21.15.132:6816/3891166784","cluster_addr":"172.21.15.132:6819/3891166784","heartbeat_back_addr":"172.21.15.132:6823/3891166784","heartbeat_front_addr":"172.21.15.132:6821/3891166784","state":["exists","up"]},{"osd":2,"uuid":"e6420efd-1107-484f-84ff-ab3d44709bf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6801","nonce":119971439}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6803","nonce":119971439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6807","nonce":119971439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":119971439},{"type":"v1","addr":"172.21.15.132:6805","nonce":119971439}]},"public_addr":"172.21.15.132:6801/119971439","cluster_addr":"172.21.15.132:6803/119971439","heartbeat_back_addr":"172.21.15.132:6807/119971439","heartbeat_front_addr":"172.21.15.132:6805/119971439","state":["exists","up"]},{"osd":3,"uuid":"2975ccf1-a247-4348-809d-8314e9f2fe8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6825","nonce":850893211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6827","nonce":850893211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6831","nonce":850893211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":850893211},{"type":"v1","addr":"172.21.15.132:6829","nonce":850893211}]},"public_addr":"172.21.15.132:6825/850893211","cluster_addr":"172.21.15.132:6827/850893211","heartbeat_back_addr":"172.21.15.132:6831/850893211","heartbeat_front_addr":"172.21.15.132:6829/850893211","state":["exists","up"]},{"osd":4,"uuid":"e48a444e-983d-4fe7-9da6-a9a081315525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6801","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6803","nonce":1028694518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6806","nonce":1028694518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6813","nonce":1028694518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1028694518},{"type":"v1","addr":"172.21.15.194:6809","nonce":1028694518}]},"public_addr":"172.21.15.194:6803/1028694518","cluster_addr":"172.21.15.194:6806/1028694518","heartbeat_back_addr":"172.21.15.194:6813/1028694518","heartbeat_front_addr":"172.21.15.194:6809/1028694518","state":["exists","up"]},{"osd":5,"uuid":"ffcf4e7d-62d0-4243-99ff-50559022359a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6802","nonce":2457236308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6807","nonce":2457236308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6815","nonce":2457236308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2457236308},{"type":"v1","addr":"172.21.15.194:6812","nonce":2457236308}]},"public_addr":"172.21.15.194:6802/2457236308","cluster_addr":"172.21.15.194:6807/2457236308","heartbeat_back_addr":"172.21.15.194:6815/2457236308","heartbeat_front_addr":"172.21.15.194:6812/2457236308","state":["exists","up"]},{"osd":6,"uuid":"462fb4ec-dd63-4164-a5a4-68fbb7ab6521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6825","nonce":1729300358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6827","nonce":1729300358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6831","nonce":1729300358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1729300358},{"type":"v1","addr":"172.21.15.194:6829","nonce":1729300358}]},"public_addr":"172.21.15.194:6825/1729300358","cluster_addr":"172.21.15.194:6827/1729300358","heartbeat_back_addr":"172.21.15.194:6831/1729300358","heartbeat_front_addr":"172.21.15.194:6829/1729300358","state":["exists","up"]},{"osd":7,"uuid":"5dc8cefe-aa4b-498b-bddc-2959061dfefa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6817","nonce":2053250559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6819","nonce":2053250559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6823","nonce":2053250559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":2053250559},{"type":"v1","addr":"172.21.15.194:6821","nonce":2053250559}]},"public_addr":"172.21.15.194:6817/2053250559","cluster_addr":"172.21.15.194:6819/2053250559","heartbeat_back_addr":"172.21.15.194:6823/2053250559","heartbeat_front_addr":"172.21.15.194:6821/2053250559","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.095205+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.113800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:32.989579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.030882+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.002357+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.014063+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.068312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-16T17:47:33.005063+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-16T17:48:50.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 -- 172.21.15.132:0/1929546874 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2dfc06b3b0 msgr2=0x7f2dfc06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2dfc06b3b0 0x7f2dfc06d870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2e08036000 tx=0x7f2e0803b040 comp rx=0 tx=0).stop 2024-03-16T17:48:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 -- 172.21.15.132:0/1929546874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 msgr2=0x7f2e18148570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 0x7f2e18148570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000c7a0 tx=0x7f2e1000cc60 comp rx=0 tx=0).stop 2024-03-16T17:48:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 -- 172.21.15.132:0/1929546874 shutdown_connections 2024-03-16T17:48:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f2dfc06b3b0 0x7f2dfc06d870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e18151470 0x7f2e18148570 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e180b2bb0 0x7f2e181f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 --2- 172.21.15.132:0/1929546874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e1806d9d0 0x7f2e18130250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 -- 172.21.15.132:0/1929546874 >> 172.21.15.132:0/1929546874 conn(0x7f2e1806aee0 msgr2=0x7f2e180ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 -- 172.21.15.132:0/1929546874 shutdown_connections 2024-03-16T17:48:50.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.402+0000 7f2e1f89d640 1 -- 172.21.15.132:0/1929546874 wait complete. 2024-03-16T17:48:50.417 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-16T17:48:50.417 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T17:48:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.515+0000 7f246d223640 1 Processor -- start 2024-03-16T17:48:50.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.515+0000 7f246d223640 1 -- start start 2024-03-16T17:48:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.515+0000 7f246d223640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f246815e140 0x7f246806f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.515+0000 7f246d223640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24681627d0 0x7f246806c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.515+0000 7f246d223640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246815e520 con 0x7f2468161c60 2024-03-16T17:48:50.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f246d223640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2468070000 con 0x7f24681627d0 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f246d223640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24680702e0 con 0x7f246815e140 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f246759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24681627d0 0x7f246806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f246759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24681627d0 0x7f246806c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37842/0 (socket says 172.21.15.132:37842) 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f245e59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2468161c60 0x7f24681620c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47686/0 (socket says 172.21.15.132:47686) 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f246759e640 1 -- 172.21.15.132:0/3738435661 learned_addr learned my addr 172.21.15.132:0/3738435661 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f2466d9d640 1 --2- 172.21.15.132:0/3738435661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f246815e140 0x7f246806f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f246759e640 1 -- 172.21.15.132:0/3738435661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f246815e140 msgr2=0x7f246806f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f246759e640 1 --2- 172.21.15.132:0/3738435661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f246815e140 0x7f246806f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f246759e640 1 -- 172.21.15.132:0/3738435661 >> v1:172.21.15.132:6789/0 conn(0x7f2468161c60 legacy=0x7f24681620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f246659c640 1 -- 172.21.15.132:0/3738435661 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208545709 0 0) 0x7f246815e520 con 0x7f2468161c60 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.516+0000 7f246759e640 1 -- 172.21.15.132:0/3738435661 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246806c120 con 0x7f24681627d0 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246759e640 1 --2- 172.21.15.132:0/3738435661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 0x7f246806c920 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2460009e50 tx=0x7f246002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9593e2116970b288 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246659c640 1 -- 172.21.15.132:0/3738435661 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246002ca70 con 0x7f24681627d0 2024-03-16T17:48:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246659c640 1 -- 172.21.15.132:0/3738435661 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246002cbd0 con 0x7f24681627d0 2024-03-16T17:48:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246659c640 1 -- 172.21.15.132:0/3738435661 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24600343f0 con 0x7f24681627d0 2024-03-16T17:48:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246d223640 1 -- 172.21.15.132:0/3738435661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 msgr2=0x7f246806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246d223640 1 --2- 172.21.15.132:0/3738435661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 0x7f246806c920 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2460009e50 tx=0x7f246002bed0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246d223640 1 -- 172.21.15.132:0/3738435661 shutdown_connections 2024-03-16T17:48:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246d223640 1 --2- 172.21.15.132:0/3738435661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 0x7f246806c920 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246d223640 1 --2- 172.21.15.132:0/3738435661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f246815e140 0x7f246806f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246d223640 1 -- 172.21.15.132:0/3738435661 >> 172.21.15.132:0/3738435661 conn(0x7f246809aa70 msgr2=0x7f246809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246d223640 1 -- 172.21.15.132:0/3738435661 shutdown_connections 2024-03-16T17:48:50.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.517+0000 7f246d223640 1 -- 172.21.15.132:0/3738435661 wait complete. 2024-03-16T17:48:50.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.519+0000 7f246d223640 1 Processor -- start 2024-03-16T17:48:50.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.520+0000 7f246d223640 1 -- start start 2024-03-16T17:48:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246d223640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f246815e140 0x7f24681f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246d223640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2468161c60 0x7f24680cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246d223640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 0x7f24680b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246d223640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24680cbf50 con 0x7f24681627d0 2024-03-16T17:48:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246d223640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24680cc1a0 con 0x7f246815e140 2024-03-16T17:48:50.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246d223640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24680cc480 con 0x7f2468161c60 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 0x7f24680b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 0x7f24680b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37844/0 (socket says 172.21.15.132:37844) 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246759e640 1 -- 172.21.15.132:0/2245455856 learned_addr learned my addr 172.21.15.132:0/2245455856 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f245e59c640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2468161c60 0x7f24680cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f2466d9d640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f246815e140 0x7f24681f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246759e640 1 -- 172.21.15.132:0/2245455856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2468161c60 msgr2=0x7f24680cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246759e640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2468161c60 0x7f24680cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246759e640 1 -- 172.21.15.132:0/2245455856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f246815e140 msgr2=0x7f24681f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246759e640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f246815e140 0x7f24681f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246759e640 1 -- 172.21.15.132:0/2245455856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2460009b30 con 0x7f24681627d0 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f245e59c640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2468161c60 0x7f24680cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f2466d9d640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f246815e140 0x7f24681f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.521+0000 7f246759e640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 0x7f24680b1c40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2460009e50 tx=0x7f2460004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:50.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.522+0000 7f245ffff640 1 -- 172.21.15.132:0/2245455856 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460009510 con 0x7f24681627d0 2024-03-16T17:48:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.522+0000 7f245ffff640 1 -- 172.21.15.132:0/2245455856 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246003e450 con 0x7f24681627d0 2024-03-16T17:48:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.522+0000 7f246d223640 1 -- 172.21.15.132:0/2245455856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24680cc760 con 0x7f24681627d0 2024-03-16T17:48:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.522+0000 7f245ffff640 1 -- 172.21.15.132:0/2245455856 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246003e600 con 0x7f24681627d0 2024-03-16T17:48:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.522+0000 7f246d223640 1 -- 172.21.15.132:0/2245455856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24680ccd20 con 0x7f24681627d0 2024-03-16T17:48:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.523+0000 7f246d223640 1 -- 172.21.15.132:0/2245455856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246804f2c0 con 0x7f24681627d0 2024-03-16T17:48:50.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.523+0000 7f245ffff640 1 -- 172.21.15.132:0/2245455856 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f246003e760 con 0x7f24681627d0 2024-03-16T17:48:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.524+0000 7f245ffff640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f244806b3b0 0x7f244806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.524+0000 7f2466d9d640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f244806b3b0 0x7f244806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.524+0000 7f245ffff640 1 -- 172.21.15.132:0/2245455856 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24600ac560 con 0x7f24681627d0 2024-03-16T17:48:50.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.524+0000 7f2466d9d640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f244806b3b0 0x7f244806d870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2458006fd0 tx=0x7f2458008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.528+0000 7f245ffff640 1 -- 172.21.15.132:0/2245455856 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2460077250 con 0x7f24681627d0 2024-03-16T17:48:50.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.702+0000 7f246d223640 1 -- 172.21.15.132:0/2245455856 --> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f246806fca0 con 0x7f244806b3b0 2024-03-16T17:48:50.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.709+0000 7f245ffff640 1 -- 172.21.15.132:0/2245455856 <== mgr.4107 v2:172.21.15.132:6832/2724898791 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251879 (secure 0 0 0) 0x7f2458009e10 con 0x7f244806b3b0 2024-03-16T17:48:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:50.717 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-03-16T17:48:50.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 -- 172.21.15.132:0/2245455856 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f244806b3b0 msgr2=0x7f244806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f244806b3b0 0x7f244806d870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2458006fd0 tx=0x7f2458008040 comp rx=0 tx=0).stop 2024-03-16T17:48:50.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 -- 172.21.15.132:0/2245455856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 msgr2=0x7f24680b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 0x7f24680b1c40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2460009e50 tx=0x7f2460004a40 comp rx=0 tx=0).stop 2024-03-16T17:48:50.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 -- 172.21.15.132:0/2245455856 shutdown_connections 2024-03-16T17:48:50.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f244806b3b0 0x7f244806d870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24681627d0 0x7f24680b1c40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2468161c60 0x7f24680cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 --2- 172.21.15.132:0/2245455856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f246815e140 0x7f24681f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 -- 172.21.15.132:0/2245455856 >> 172.21.15.132:0/2245455856 conn(0x7f246809aa70 msgr2=0x7f24680aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:50.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 -- 172.21.15.132:0/2245455856 shutdown_connections 2024-03-16T17:48:50.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.712+0000 7f246d223640 1 -- 172.21.15.132:0/2245455856 wait complete. 2024-03-16T17:48:50.727 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-03-16T17:48:49.855835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220088,"kb_used_data":3908,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754632,"statfs":{"total":773094113280,"available":772868743168,"internally_reserved":0,"allocated":4001792,"data_stored":2252417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12753,"internal_metadata":221236783},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.129282"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.758834+0000","last_change":"2024-03-16T17:48:47.757564+0000","last_active":"2024-03-16T17:48:47.758834+0000","last_peered":"2024-03-16T17:48:47.758834+0000","last_clean":"2024-03-16T17:48:47.758834+0000","last_became_active":"2024-03-16T17:48:47.757261+0000","last_became_peered":"2024-03-16T17:48:47.757261+0000","last_unstale":"2024-03-16T17:48:47.758834+0000","last_undegraded":"2024-03-16T17:48:47.758834+0000","last_fullsized":"2024-03-16T17:48:47.758834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:54:46.227936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755748+0000","last_change":"2024-03-16T17:48:47.751877+0000","last_active":"2024-03-16T17:48:47.755748+0000","last_peered":"2024-03-16T17:48:47.755748+0000","last_clean":"2024-03-16T17:48:47.755748+0000","last_became_active":"2024-03-16T17:48:47.751612+0000","last_became_peered":"2024-03-16T17:48:47.751612+0000","last_unstale":"2024-03-16T17:48:47.755748+0000","last_undegraded":"2024-03-16T17:48:47.755748+0000","last_fullsized":"2024-03-16T17:48:47.755748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:19:53.998029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762152+0000","last_change":"2024-03-16T17:48:47.758621+0000","last_active":"2024-03-16T17:48:47.762152+0000","last_peered":"2024-03-16T17:48:47.762152+0000","last_clean":"2024-03-16T17:48:47.762152+0000","last_became_active":"2024-03-16T17:48:47.758165+0000","last_became_peered":"2024-03-16T17:48:47.758165+0000","last_unstale":"2024-03-16T17:48:47.762152+0000","last_undegraded":"2024-03-16T17:48:47.762152+0000","last_fullsized":"2024-03-16T17:48:47.762152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:27:17.403221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765692+0000","last_change":"2024-03-16T17:48:47.761702+0000","last_active":"2024-03-16T17:48:47.765692+0000","last_peered":"2024-03-16T17:48:47.765692+0000","last_clean":"2024-03-16T17:48:47.765692+0000","last_became_active":"2024-03-16T17:48:47.760988+0000","last_became_peered":"2024-03-16T17:48:47.760988+0000","last_unstale":"2024-03-16T17:48:47.765692+0000","last_undegraded":"2024-03-16T17:48:47.765692+0000","last_fullsized":"2024-03-16T17:48:47.765692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:50:32.529119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.758337+0000","last_change":"2024-03-16T17:48:47.752441+0000","last_active":"2024-03-16T17:48:47.758337+0000","last_peered":"2024-03-16T17:48:47.758337+0000","last_clean":"2024-03-16T17:48:47.758337+0000","last_became_active":"2024-03-16T17:48:47.751674+0000","last_became_peered":"2024-03-16T17:48:47.751674+0000","last_unstale":"2024-03-16T17:48:47.758337+0000","last_undegraded":"2024-03-16T17:48:47.758337+0000","last_fullsized":"2024-03-16T17:48:47.758337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:09:06.088918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755465+0000","last_change":"2024-03-16T17:48:47.749437+0000","last_active":"2024-03-16T17:48:47.755465+0000","last_peered":"2024-03-16T17:48:47.755465+0000","last_clean":"2024-03-16T17:48:47.755465+0000","last_became_active":"2024-03-16T17:48:47.746317+0000","last_became_peered":"2024-03-16T17:48:47.746317+0000","last_unstale":"2024-03-16T17:48:47.755465+0000","last_undegraded":"2024-03-16T17:48:47.755465+0000","last_fullsized":"2024-03-16T17:48:47.755465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:05:22.746741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761896+0000","last_change":"2024-03-16T17:48:47.759894+0000","last_active":"2024-03-16T17:48:47.761896+0000","last_peered":"2024-03-16T17:48:47.761896+0000","last_clean":"2024-03-16T17:48:47.761896+0000","last_became_active":"2024-03-16T17:48:47.759627+0000","last_became_peered":"2024-03-16T17:48:47.759627+0000","last_unstale":"2024-03-16T17:48:47.761896+0000","last_undegraded":"2024-03-16T17:48:47.761896+0000","last_fullsized":"2024-03-16T17:48:47.761896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:57:04.807347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756793+0000","last_change":"2024-03-16T17:48:47.754973+0000","last_active":"2024-03-16T17:48:47.756793+0000","last_peered":"2024-03-16T17:48:47.756793+0000","last_clean":"2024-03-16T17:48:47.756793+0000","last_became_active":"2024-03-16T17:48:47.754658+0000","last_became_peered":"2024-03-16T17:48:47.754658+0000","last_unstale":"2024-03-16T17:48:47.756793+0000","last_undegraded":"2024-03-16T17:48:47.756793+0000","last_fullsized":"2024-03-16T17:48:47.756793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:13:30.548232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760974+0000","last_change":"2024-03-16T17:48:47.753755+0000","last_active":"2024-03-16T17:48:47.760974+0000","last_peered":"2024-03-16T17:48:47.760974+0000","last_clean":"2024-03-16T17:48:47.760974+0000","last_became_active":"2024-03-16T17:48:47.753433+0000","last_became_peered":"2024-03-16T17:48:47.753433+0000","last_unstale":"2024-03-16T17:48:47.760974+0000","last_undegraded":"2024-03-16T17:48:47.760974+0000","last_fullsized":"2024-03-16T17:48:47.760974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:44:03.940649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765369+0000","last_change":"2024-03-16T17:48:47.758740+0000","last_active":"2024-03-16T17:48:47.765369+0000","last_peered":"2024-03-16T17:48:47.765369+0000","last_clean":"2024-03-16T17:48:47.765369+0000","last_became_active":"2024-03-16T17:48:47.758481+0000","last_became_peered":"2024-03-16T17:48:47.758481+0000","last_unstale":"2024-03-16T17:48:47.765369+0000","last_undegraded":"2024-03-16T17:48:47.765369+0000","last_fullsized":"2024-03-16T17:48:47.765369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:05:11.348321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762556+0000","last_change":"2024-03-16T17:48:47.760347+0000","last_active":"2024-03-16T17:48:47.762556+0000","last_peered":"2024-03-16T17:48:47.762556+0000","last_clean":"2024-03-16T17:48:47.762556+0000","last_became_active":"2024-03-16T17:48:47.758652+0000","last_became_peered":"2024-03-16T17:48:47.758652+0000","last_unstale":"2024-03-16T17:48:47.762556+0000","last_undegraded":"2024-03-16T17:48:47.762556+0000","last_fullsized":"2024-03-16T17:48:47.762556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:47.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756235+0000","last_change":"2024-03-16T17:48:47.753107+0000","last_active":"2024-03-16T17:48:47.756235+0000","last_peered":"2024-03-16T17:48:47.756235+0000","last_clean":"2024-03-16T17:48:47.756235+0000","last_became_active":"2024-03-16T17:48:47.752836+0000","last_became_peered":"2024-03-16T17:48:47.752836+0000","last_unstale":"2024-03-16T17:48:47.756235+0000","last_undegraded":"2024-03-16T17:48:47.756235+0000","last_fullsized":"2024-03-16T17:48:47.756235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:43.644778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760106+0000","last_change":"2024-03-16T17:48:47.755174+0000","last_active":"2024-03-16T17:48:47.760106+0000","last_peered":"2024-03-16T17:48:47.760106+0000","last_clean":"2024-03-16T17:48:47.760106+0000","last_became_active":"2024-03-16T17:48:47.754872+0000","last_became_peered":"2024-03-16T17:48:47.754872+0000","last_unstale":"2024-03-16T17:48:47.760106+0000","last_undegraded":"2024-03-16T17:48:47.760106+0000","last_fullsized":"2024-03-16T17:48:47.760106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:30.073800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755485+0000","last_change":"2024-03-16T17:48:47.749664+0000","last_active":"2024-03-16T17:48:47.755485+0000","last_peered":"2024-03-16T17:48:47.755485+0000","last_clean":"2024-03-16T17:48:47.755485+0000","last_became_active":"2024-03-16T17:48:47.749059+0000","last_became_peered":"2024-03-16T17:48:47.749059+0000","last_unstale":"2024-03-16T17:48:47.755485+0000","last_undegraded":"2024-03-16T17:48:47.755485+0000","last_fullsized":"2024-03-16T17:48:47.755485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:50:32.529119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761939+0000","last_change":"2024-03-16T17:48:47.757826+0000","last_active":"2024-03-16T17:48:47.761939+0000","last_peered":"2024-03-16T17:48:47.761939+0000","last_clean":"2024-03-16T17:48:47.761939+0000","last_became_active":"2024-03-16T17:48:47.755543+0000","last_became_peered":"2024-03-16T17:48:47.755543+0000","last_unstale":"2024-03-16T17:48:47.761939+0000","last_undegraded":"2024-03-16T17:48:47.761939+0000","last_fullsized":"2024-03-16T17:48:47.761939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:16:52.714825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767553+0000","last_change":"2024-03-16T17:48:47.764166+0000","last_active":"2024-03-16T17:48:47.767553+0000","last_peered":"2024-03-16T17:48:47.767553+0000","last_clean":"2024-03-16T17:48:47.767553+0000","last_became_active":"2024-03-16T17:48:47.763501+0000","last_became_peered":"2024-03-16T17:48:47.763501+0000","last_unstale":"2024-03-16T17:48:47.767553+0000","last_undegraded":"2024-03-16T17:48:47.767553+0000","last_fullsized":"2024-03-16T17:48:47.767553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:19:53.998029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762014+0000","last_change":"2024-03-16T17:48:47.760578+0000","last_active":"2024-03-16T17:48:47.762014+0000","last_peered":"2024-03-16T17:48:47.762014+0000","last_clean":"2024-03-16T17:48:47.762014+0000","last_became_active":"2024-03-16T17:48:47.760313+0000","last_became_peered":"2024-03-16T17:48:47.760313+0000","last_unstale":"2024-03-16T17:48:47.762014+0000","last_undegraded":"2024-03-16T17:48:47.762014+0000","last_fullsized":"2024-03-16T17:48:47.762014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:05:22.746741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765085+0000","last_change":"2024-03-16T17:48:47.759364+0000","last_active":"2024-03-16T17:48:47.765085+0000","last_peered":"2024-03-16T17:48:47.765085+0000","last_clean":"2024-03-16T17:48:47.765085+0000","last_became_active":"2024-03-16T17:48:47.759104+0000","last_became_peered":"2024-03-16T17:48:47.759104+0000","last_unstale":"2024-03-16T17:48:47.765085+0000","last_undegraded":"2024-03-16T17:48:47.765085+0000","last_fullsized":"2024-03-16T17:48:47.765085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:23:19.219730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760118+0000","last_change":"2024-03-16T17:48:47.757446+0000","last_active":"2024-03-16T17:48:47.760118+0000","last_peered":"2024-03-16T17:48:47.760118+0000","last_clean":"2024-03-16T17:48:47.760118+0000","last_became_active":"2024-03-16T17:48:47.757118+0000","last_became_peered":"2024-03-16T17:48:47.757118+0000","last_unstale":"2024-03-16T17:48:47.760118+0000","last_undegraded":"2024-03-16T17:48:47.760118+0000","last_fullsized":"2024-03-16T17:48:47.760118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:14:07.669072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760144+0000","last_change":"2024-03-16T17:48:47.754406+0000","last_active":"2024-03-16T17:48:47.760144+0000","last_peered":"2024-03-16T17:48:47.760144+0000","last_clean":"2024-03-16T17:48:47.760144+0000","last_became_active":"2024-03-16T17:48:47.754165+0000","last_became_peered":"2024-03-16T17:48:47.754165+0000","last_unstale":"2024-03-16T17:48:47.760144+0000","last_undegraded":"2024-03-16T17:48:47.760144+0000","last_fullsized":"2024-03-16T17:48:47.760144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:35:16.163898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.757524+0000","last_change":"2024-03-16T17:48:47.750619+0000","last_active":"2024-03-16T17:48:47.757524+0000","last_peered":"2024-03-16T17:48:47.757524+0000","last_clean":"2024-03-16T17:48:47.757524+0000","last_became_active":"2024-03-16T17:48:47.750363+0000","last_became_peered":"2024-03-16T17:48:47.750363+0000","last_unstale":"2024-03-16T17:48:47.757524+0000","last_undegraded":"2024-03-16T17:48:47.757524+0000","last_fullsized":"2024-03-16T17:48:47.757524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:22:22.290945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762680+0000","last_change":"2024-03-16T17:48:47.757511+0000","last_active":"2024-03-16T17:48:47.762680+0000","last_peered":"2024-03-16T17:48:47.762680+0000","last_clean":"2024-03-16T17:48:47.762680+0000","last_became_active":"2024-03-16T17:48:47.757233+0000","last_became_peered":"2024-03-16T17:48:47.757233+0000","last_unstale":"2024-03-16T17:48:47.762680+0000","last_undegraded":"2024-03-16T17:48:47.762680+0000","last_fullsized":"2024-03-16T17:48:47.762680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:13:30.548232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756744+0000","last_change":"2024-03-16T17:48:47.755546+0000","last_active":"2024-03-16T17:48:47.756744+0000","last_peered":"2024-03-16T17:48:47.756744+0000","last_clean":"2024-03-16T17:48:47.756744+0000","last_became_active":"2024-03-16T17:48:47.755285+0000","last_became_peered":"2024-03-16T17:48:47.755285+0000","last_unstale":"2024-03-16T17:48:47.756744+0000","last_undegraded":"2024-03-16T17:48:47.756744+0000","last_fullsized":"2024-03-16T17:48:47.756744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:47:46.904782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.752554+0000","last_change":"2024-03-16T17:48:47.745445+0000","last_active":"2024-03-16T17:48:47.752554+0000","last_peered":"2024-03-16T17:48:47.752554+0000","last_clean":"2024-03-16T17:48:47.752554+0000","last_became_active":"2024-03-16T17:48:47.745176+0000","last_became_peered":"2024-03-16T17:48:47.745176+0000","last_unstale":"2024-03-16T17:48:47.752554+0000","last_undegraded":"2024-03-16T17:48:47.752554+0000","last_fullsized":"2024-03-16T17:48:47.752554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:47.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765652+0000","last_change":"2024-03-16T17:48:47.761132+0000","last_active":"2024-03-16T17:48:47.765652+0000","last_peered":"2024-03-16T17:48:47.765652+0000","last_clean":"2024-03-16T17:48:47.765652+0000","last_became_active":"2024-03-16T17:48:47.760696+0000","last_became_peered":"2024-03-16T17:48:47.760696+0000","last_unstale":"2024-03-16T17:48:47.765652+0000","last_undegraded":"2024-03-16T17:48:47.765652+0000","last_fullsized":"2024-03-16T17:48:47.765652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:47.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755729+0000","last_change":"2024-03-16T17:48:47.751698+0000","last_active":"2024-03-16T17:48:47.755729+0000","last_peered":"2024-03-16T17:48:47.755729+0000","last_clean":"2024-03-16T17:48:47.755729+0000","last_became_active":"2024-03-16T17:48:47.751434+0000","last_became_peered":"2024-03-16T17:48:47.751434+0000","last_unstale":"2024-03-16T17:48:47.755729+0000","last_undegraded":"2024-03-16T17:48:47.755729+0000","last_fullsized":"2024-03-16T17:48:47.755729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:43.644778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765702+0000","last_change":"2024-03-16T17:48:47.761532+0000","last_active":"2024-03-16T17:48:47.765702+0000","last_peered":"2024-03-16T17:48:47.765702+0000","last_clean":"2024-03-16T17:48:47.765702+0000","last_became_active":"2024-03-16T17:48:47.760951+0000","last_became_peered":"2024-03-16T17:48:47.760951+0000","last_unstale":"2024-03-16T17:48:47.765702+0000","last_undegraded":"2024-03-16T17:48:47.765702+0000","last_fullsized":"2024-03-16T17:48:47.765702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:05:22.746741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755785+0000","last_change":"2024-03-16T17:48:47.751115+0000","last_active":"2024-03-16T17:48:47.755785+0000","last_peered":"2024-03-16T17:48:47.755785+0000","last_clean":"2024-03-16T17:48:47.755785+0000","last_became_active":"2024-03-16T17:48:47.750830+0000","last_became_peered":"2024-03-16T17:48:47.750830+0000","last_unstale":"2024-03-16T17:48:47.755785+0000","last_undegraded":"2024-03-16T17:48:47.755785+0000","last_fullsized":"2024-03-16T17:48:47.755785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:05:22.746741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762916+0000","last_change":"2024-03-16T17:48:47.757159+0000","last_active":"2024-03-16T17:48:47.762916+0000","last_peered":"2024-03-16T17:48:47.762916+0000","last_clean":"2024-03-16T17:48:47.762916+0000","last_became_active":"2024-03-16T17:48:47.756895+0000","last_became_peered":"2024-03-16T17:48:47.756895+0000","last_unstale":"2024-03-16T17:48:47.762916+0000","last_undegraded":"2024-03-16T17:48:47.762916+0000","last_fullsized":"2024-03-16T17:48:47.762916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:31.873813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761840+0000","last_change":"2024-03-16T17:48:47.759080+0000","last_active":"2024-03-16T17:48:47.761840+0000","last_peered":"2024-03-16T17:48:47.761840+0000","last_clean":"2024-03-16T17:48:47.761840+0000","last_became_active":"2024-03-16T17:48:47.758549+0000","last_became_peered":"2024-03-16T17:48:47.758549+0000","last_unstale":"2024-03-16T17:48:47.761840+0000","last_undegraded":"2024-03-16T17:48:47.761840+0000","last_fullsized":"2024-03-16T17:48:47.761840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:05:11.348321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.757909+0000","last_change":"2024-03-16T17:48:47.754918+0000","last_active":"2024-03-16T17:48:47.757909+0000","last_peered":"2024-03-16T17:48:47.757909+0000","last_clean":"2024-03-16T17:48:47.757909+0000","last_became_active":"2024-03-16T17:48:47.754664+0000","last_became_peered":"2024-03-16T17:48:47.754664+0000","last_unstale":"2024-03-16T17:48:47.757909+0000","last_undegraded":"2024-03-16T17:48:47.757909+0000","last_fullsized":"2024-03-16T17:48:47.757909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:22:22.290945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767509+0000","last_change":"2024-03-16T17:48:47.762041+0000","last_active":"2024-03-16T17:48:47.767509+0000","last_peered":"2024-03-16T17:48:47.767509+0000","last_clean":"2024-03-16T17:48:47.767509+0000","last_became_active":"2024-03-16T17:48:47.761611+0000","last_became_peered":"2024-03-16T17:48:47.761611+0000","last_unstale":"2024-03-16T17:48:47.767509+0000","last_undegraded":"2024-03-16T17:48:47.767509+0000","last_fullsized":"2024-03-16T17:48:47.767509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:43.644778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756677+0000","last_change":"2024-03-16T17:48:47.750601+0000","last_active":"2024-03-16T17:48:47.756677+0000","last_peered":"2024-03-16T17:48:47.756677+0000","last_clean":"2024-03-16T17:48:47.756677+0000","last_became_active":"2024-03-16T17:48:47.750347+0000","last_became_peered":"2024-03-16T17:48:47.750347+0000","last_unstale":"2024-03-16T17:48:47.756677+0000","last_undegraded":"2024-03-16T17:48:47.756677+0000","last_fullsized":"2024-03-16T17:48:47.756677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:31.873813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762670+0000","last_change":"2024-03-16T17:48:46.750083+0000","last_active":"2024-03-16T17:48:47.762670+0000","last_peered":"2024-03-16T17:48:47.762670+0000","last_clean":"2024-03-16T17:48:47.762670+0000","last_became_active":"2024-03-16T17:48:46.749789+0000","last_became_peered":"2024-03-16T17:48:46.749789+0000","last_unstale":"2024-03-16T17:48:47.762670+0000","last_undegraded":"2024-03-16T17:48:47.762670+0000","last_fullsized":"2024-03-16T17:48:47.762670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:36.395336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767652+0000","last_change":"2024-03-16T17:48:47.763015+0000","last_active":"2024-03-16T17:48:47.767652+0000","last_peered":"2024-03-16T17:48:47.767652+0000","last_clean":"2024-03-16T17:48:47.767652+0000","last_became_active":"2024-03-16T17:48:47.762743+0000","last_became_peered":"2024-03-16T17:48:47.762743+0000","last_unstale":"2024-03-16T17:48:47.767652+0000","last_undegraded":"2024-03-16T17:48:47.767652+0000","last_fullsized":"2024-03-16T17:48:47.767652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:03:47.483043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756865+0000","last_change":"2024-03-16T17:48:46.752761+0000","last_active":"2024-03-16T17:48:47.756865+0000","last_peered":"2024-03-16T17:48:47.756865+0000","last_clean":"2024-03-16T17:48:47.756865+0000","last_became_active":"2024-03-16T17:48:46.752519+0000","last_became_peered":"2024-03-16T17:48:46.752519+0000","last_unstale":"2024-03-16T17:48:47.756865+0000","last_undegraded":"2024-03-16T17:48:47.756865+0000","last_fullsized":"2024-03-16T17:48:47.756865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:36:43.072042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762777+0000","last_change":"2024-03-16T17:48:47.757631+0000","last_active":"2024-03-16T17:48:47.762777+0000","last_peered":"2024-03-16T17:48:47.762777+0000","last_clean":"2024-03-16T17:48:47.762777+0000","last_became_active":"2024-03-16T17:48:47.756952+0000","last_became_peered":"2024-03-16T17:48:47.756952+0000","last_unstale":"2024-03-16T17:48:47.762777+0000","last_undegraded":"2024-03-16T17:48:47.762777+0000","last_fullsized":"2024-03-16T17:48:47.762777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:47:46.904782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.766223+0000","last_change":"2024-03-16T17:48:46.761290+0000","last_active":"2024-03-16T17:48:47.766223+0000","last_peered":"2024-03-16T17:48:47.766223+0000","last_clean":"2024-03-16T17:48:47.766223+0000","last_became_active":"2024-03-16T17:48:46.760992+0000","last_became_peered":"2024-03-16T17:48:46.760992+0000","last_unstale":"2024-03-16T17:48:47.766223+0000","last_undegraded":"2024-03-16T17:48:47.766223+0000","last_fullsized":"2024-03-16T17:48:47.766223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:05:10.346433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.763187+0000","last_change":"2024-03-16T17:48:47.757048+0000","last_active":"2024-03-16T17:48:47.763187+0000","last_peered":"2024-03-16T17:48:47.763187+0000","last_clean":"2024-03-16T17:48:47.763187+0000","last_became_active":"2024-03-16T17:48:47.756780+0000","last_became_peered":"2024-03-16T17:48:47.756780+0000","last_unstale":"2024-03-16T17:48:47.763187+0000","last_undegraded":"2024-03-16T17:48:47.763187+0000","last_fullsized":"2024-03-16T17:48:47.763187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:13:30.548232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762248+0000","last_change":"2024-03-16T17:48:46.758539+0000","last_active":"2024-03-16T17:48:47.762248+0000","last_peered":"2024-03-16T17:48:47.762248+0000","last_clean":"2024-03-16T17:48:47.762248+0000","last_became_active":"2024-03-16T17:48:46.758200+0000","last_became_peered":"2024-03-16T17:48:46.758200+0000","last_unstale":"2024-03-16T17:48:47.762248+0000","last_undegraded":"2024-03-16T17:48:47.762248+0000","last_fullsized":"2024-03-16T17:48:47.762248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:41:19.482529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761814+0000","last_change":"2024-03-16T17:48:47.757364+0000","last_active":"2024-03-16T17:48:47.761814+0000","last_peered":"2024-03-16T17:48:47.761814+0000","last_clean":"2024-03-16T17:48:47.761814+0000","last_became_active":"2024-03-16T17:48:47.757035+0000","last_became_peered":"2024-03-16T17:48:47.757035+0000","last_unstale":"2024-03-16T17:48:47.761814+0000","last_undegraded":"2024-03-16T17:48:47.761814+0000","last_fullsized":"2024-03-16T17:48:47.761814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:47:46.904782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.763483+0000","last_change":"2024-03-16T17:48:46.750755+0000","last_active":"2024-03-16T17:48:47.763483+0000","last_peered":"2024-03-16T17:48:47.763483+0000","last_clean":"2024-03-16T17:48:47.763483+0000","last_became_active":"2024-03-16T17:48:46.750484+0000","last_became_peered":"2024-03-16T17:48:46.750484+0000","last_unstale":"2024-03-16T17:48:47.763483+0000","last_undegraded":"2024-03-16T17:48:47.763483+0000","last_fullsized":"2024-03-16T17:48:47.763483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:51.477046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755869+0000","last_change":"2024-03-16T17:48:47.751792+0000","last_active":"2024-03-16T17:48:47.755869+0000","last_peered":"2024-03-16T17:48:47.755869+0000","last_clean":"2024-03-16T17:48:47.755869+0000","last_became_active":"2024-03-16T17:48:47.751548+0000","last_became_peered":"2024-03-16T17:48:47.751548+0000","last_unstale":"2024-03-16T17:48:47.755869+0000","last_undegraded":"2024-03-16T17:48:47.755869+0000","last_fullsized":"2024-03-16T17:48:47.755869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:50:32.529119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.763982+0000","last_change":"2024-03-16T17:48:46.747062+0000","last_active":"2024-03-16T17:48:47.763982+0000","last_peered":"2024-03-16T17:48:47.763982+0000","last_clean":"2024-03-16T17:48:47.763982+0000","last_became_active":"2024-03-16T17:48:46.746778+0000","last_became_peered":"2024-03-16T17:48:46.746778+0000","last_unstale":"2024-03-16T17:48:47.763982+0000","last_undegraded":"2024-03-16T17:48:47.763982+0000","last_fullsized":"2024-03-16T17:48:47.763982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:11:44.232087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761045+0000","last_change":"2024-03-16T17:48:47.753732+0000","last_active":"2024-03-16T17:48:47.761045+0000","last_peered":"2024-03-16T17:48:47.761045+0000","last_clean":"2024-03-16T17:48:47.761045+0000","last_became_active":"2024-03-16T17:48:47.753450+0000","last_became_peered":"2024-03-16T17:48:47.753450+0000","last_unstale":"2024-03-16T17:48:47.761045+0000","last_undegraded":"2024-03-16T17:48:47.761045+0000","last_fullsized":"2024-03-16T17:48:47.761045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:54:46.227936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.738943+0000","last_change":"2024-03-16T17:48:46.746631+0000","last_active":"2024-03-16T17:48:47.738943+0000","last_peered":"2024-03-16T17:48:47.738943+0000","last_clean":"2024-03-16T17:48:47.738943+0000","last_became_active":"2024-03-16T17:48:46.746340+0000","last_became_peered":"2024-03-16T17:48:46.746340+0000","last_unstale":"2024-03-16T17:48:47.738943+0000","last_undegraded":"2024-03-16T17:48:47.738943+0000","last_fullsized":"2024-03-16T17:48:47.738943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:52.623889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765318+0000","last_change":"2024-03-16T17:48:47.758551+0000","last_active":"2024-03-16T17:48:47.765318+0000","last_peered":"2024-03-16T17:48:47.765318+0000","last_clean":"2024-03-16T17:48:47.765318+0000","last_became_active":"2024-03-16T17:48:47.757863+0000","last_became_peered":"2024-03-16T17:48:47.757863+0000","last_unstale":"2024-03-16T17:48:47.765318+0000","last_undegraded":"2024-03-16T17:48:47.765318+0000","last_fullsized":"2024-03-16T17:48:47.765318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:53.625777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.741602+0000","last_change":"2024-03-16T17:48:46.748456+0000","last_active":"2024-03-16T17:48:47.741602+0000","last_peered":"2024-03-16T17:48:47.741602+0000","last_clean":"2024-03-16T17:48:47.741602+0000","last_became_active":"2024-03-16T17:48:46.748192+0000","last_became_peered":"2024-03-16T17:48:46.748192+0000","last_unstale":"2024-03-16T17:48:47.741602+0000","last_undegraded":"2024-03-16T17:48:47.741602+0000","last_fullsized":"2024-03-16T17:48:47.741602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:35:15.162010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.748579+0000","last_change":"2024-03-16T17:48:47.745207+0000","last_active":"2024-03-16T17:48:47.748579+0000","last_peered":"2024-03-16T17:48:47.748579+0000","last_clean":"2024-03-16T17:48:47.748579+0000","last_became_active":"2024-03-16T17:48:47.744912+0000","last_became_peered":"2024-03-16T17:48:47.744912+0000","last_unstale":"2024-03-16T17:48:47.748579+0000","last_undegraded":"2024-03-16T17:48:47.748579+0000","last_fullsized":"2024-03-16T17:48:47.748579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:57:04.807347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.739312+0000","last_change":"2024-03-16T17:48:46.753447+0000","last_active":"2024-03-16T17:48:47.739312+0000","last_peered":"2024-03-16T17:48:47.739312+0000","last_clean":"2024-03-16T17:48:47.739312+0000","last_became_active":"2024-03-16T17:48:46.753133+0000","last_became_peered":"2024-03-16T17:48:46.753133+0000","last_unstale":"2024-03-16T17:48:47.739312+0000","last_undegraded":"2024-03-16T17:48:47.739312+0000","last_fullsized":"2024-03-16T17:48:47.739312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:57:03.805458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760277+0000","last_change":"2024-03-16T17:48:47.758395+0000","last_active":"2024-03-16T17:48:47.760277+0000","last_peered":"2024-03-16T17:48:47.760277+0000","last_clean":"2024-03-16T17:48:47.760277+0000","last_became_active":"2024-03-16T17:48:47.758128+0000","last_became_peered":"2024-03-16T17:48:47.758128+0000","last_unstale":"2024-03-16T17:48:47.760277+0000","last_undegraded":"2024-03-16T17:48:47.760277+0000","last_fullsized":"2024-03-16T17:48:47.760277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:47:36.766165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.743887+0000","last_change":"2024-03-16T17:48:46.748030+0000","last_active":"2024-03-16T17:48:47.743887+0000","last_peered":"2024-03-16T17:48:47.743887+0000","last_clean":"2024-03-16T17:48:47.743887+0000","last_became_active":"2024-03-16T17:48:46.747748+0000","last_became_peered":"2024-03-16T17:48:46.747748+0000","last_unstale":"2024-03-16T17:48:47.743887+0000","last_undegraded":"2024-03-16T17:48:47.743887+0000","last_fullsized":"2024-03-16T17:48:47.743887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:22:21.289056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760266+0000","last_change":"2024-03-16T17:48:47.755541+0000","last_active":"2024-03-16T17:48:47.760266+0000","last_peered":"2024-03-16T17:48:47.760266+0000","last_clean":"2024-03-16T17:48:47.760266+0000","last_became_active":"2024-03-16T17:48:47.755287+0000","last_became_peered":"2024-03-16T17:48:47.755287+0000","last_unstale":"2024-03-16T17:48:47.760266+0000","last_undegraded":"2024-03-16T17:48:47.760266+0000","last_fullsized":"2024-03-16T17:48:47.760266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:36:34.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.763335+0000","last_change":"2024-03-16T17:48:46.752549+0000","last_active":"2024-03-16T17:48:47.763335+0000","last_peered":"2024-03-16T17:48:47.763335+0000","last_clean":"2024-03-16T17:48:47.763335+0000","last_became_active":"2024-03-16T17:48:46.752259+0000","last_became_peered":"2024-03-16T17:48:46.752259+0000","last_unstale":"2024-03-16T17:48:47.763335+0000","last_undegraded":"2024-03-16T17:48:47.763335+0000","last_fullsized":"2024-03-16T17:48:47.763335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:05:10.346433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.764958+0000","last_change":"2024-03-16T17:48:47.759256+0000","last_active":"2024-03-16T17:48:47.764958+0000","last_peered":"2024-03-16T17:48:47.764958+0000","last_clean":"2024-03-16T17:48:47.764958+0000","last_became_active":"2024-03-16T17:48:47.758965+0000","last_became_peered":"2024-03-16T17:48:47.758965+0000","last_unstale":"2024-03-16T17:48:47.764958+0000","last_undegraded":"2024-03-16T17:48:47.764958+0000","last_fullsized":"2024-03-16T17:48:47.764958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:36:34.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.771138+0000","last_change":"2024-03-16T17:48:46.761425+0000","last_active":"2024-03-16T17:48:47.771138+0000","last_peered":"2024-03-16T17:48:47.771138+0000","last_clean":"2024-03-16T17:48:47.771138+0000","last_became_active":"2024-03-16T17:48:46.761149+0000","last_became_peered":"2024-03-16T17:48:46.761149+0000","last_unstale":"2024-03-16T17:48:47.771138+0000","last_undegraded":"2024-03-16T17:48:47.771138+0000","last_fullsized":"2024-03-16T17:48:47.771138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:46.932678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765266+0000","last_change":"2024-03-16T17:48:47.758184+0000","last_active":"2024-03-16T17:48:47.765266+0000","last_peered":"2024-03-16T17:48:47.765266+0000","last_clean":"2024-03-16T17:48:47.765266+0000","last_became_active":"2024-03-16T17:48:47.757904+0000","last_became_peered":"2024-03-16T17:48:47.757904+0000","last_unstale":"2024-03-16T17:48:47.765266+0000","last_undegraded":"2024-03-16T17:48:47.765266+0000","last_fullsized":"2024-03-16T17:48:47.765266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:47:46.904782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.759515+0000","last_change":"2024-03-16T17:48:46.748503+0000","last_active":"2024-03-16T17:48:47.759515+0000","last_peered":"2024-03-16T17:48:47.759515+0000","last_clean":"2024-03-16T17:48:47.759515+0000","last_became_active":"2024-03-16T17:48:46.748234+0000","last_became_peered":"2024-03-16T17:48:46.748234+0000","last_unstale":"2024-03-16T17:48:47.759515+0000","last_undegraded":"2024-03-16T17:48:47.759515+0000","last_fullsized":"2024-03-16T17:48:47.759515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:49:25.663616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.759555+0000","last_change":"2024-03-16T17:48:47.753323+0000","last_active":"2024-03-16T17:48:47.759555+0000","last_peered":"2024-03-16T17:48:47.759555+0000","last_clean":"2024-03-16T17:48:47.759555+0000","last_became_active":"2024-03-16T17:48:47.753012+0000","last_became_peered":"2024-03-16T17:48:47.753012+0000","last_unstale":"2024-03-16T17:48:47.759555+0000","last_undegraded":"2024-03-16T17:48:47.759555+0000","last_fullsized":"2024-03-16T17:48:47.759555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:16:52.714825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.748145+0000","last_change":"2024-03-16T17:48:46.752371+0000","last_active":"2024-03-16T17:48:47.748145+0000","last_peered":"2024-03-16T17:48:47.748145+0000","last_clean":"2024-03-16T17:48:47.748145+0000","last_became_active":"2024-03-16T17:48:46.752116+0000","last_became_peered":"2024-03-16T17:48:46.752116+0000","last_unstale":"2024-03-16T17:48:47.748145+0000","last_undegraded":"2024-03-16T17:48:47.748145+0000","last_fullsized":"2024-03-16T17:48:47.748145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:22:21.289056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767564+0000","last_change":"2024-03-16T17:48:47.764441+0000","last_active":"2024-03-16T17:48:47.767564+0000","last_peered":"2024-03-16T17:48:47.767564+0000","last_clean":"2024-03-16T17:48:47.767564+0000","last_became_active":"2024-03-16T17:48:47.763885+0000","last_became_peered":"2024-03-16T17:48:47.763885+0000","last_unstale":"2024-03-16T17:48:47.767564+0000","last_undegraded":"2024-03-16T17:48:47.767564+0000","last_fullsized":"2024-03-16T17:48:47.767564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:16:52.714825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.738853+0000","last_change":"2024-03-16T17:48:46.753503+0000","last_active":"2024-03-16T17:48:47.738853+0000","last_peered":"2024-03-16T17:48:47.738853+0000","last_clean":"2024-03-16T17:48:47.738853+0000","last_became_active":"2024-03-16T17:48:46.753195+0000","last_became_peered":"2024-03-16T17:48:46.753195+0000","last_unstale":"2024-03-16T17:48:47.738853+0000","last_undegraded":"2024-03-16T17:48:47.738853+0000","last_fullsized":"2024-03-16T17:48:47.738853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:47:45.902894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767671+0000","last_change":"2024-03-16T17:48:47.763637+0000","last_active":"2024-03-16T17:48:47.767671+0000","last_peered":"2024-03-16T17:48:47.767671+0000","last_clean":"2024-03-16T17:48:47.767671+0000","last_became_active":"2024-03-16T17:48:47.763224+0000","last_became_peered":"2024-03-16T17:48:47.763224+0000","last_unstale":"2024-03-16T17:48:47.767671+0000","last_undegraded":"2024-03-16T17:48:47.767671+0000","last_fullsized":"2024-03-16T17:48:47.767671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:31.873813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767147+0000","last_change":"2024-03-16T17:48:46.752329+0000","last_active":"2024-03-16T17:48:47.767147+0000","last_peered":"2024-03-16T17:48:47.767147+0000","last_clean":"2024-03-16T17:48:47.767147+0000","last_became_active":"2024-03-16T17:48:46.752063+0000","last_became_peered":"2024-03-16T17:48:46.752063+0000","last_unstale":"2024-03-16T17:48:47.767147+0000","last_undegraded":"2024-03-16T17:48:47.767147+0000","last_fullsized":"2024-03-16T17:48:47.767147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:30.871924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761000+0000","last_change":"2024-03-16T17:48:47.754963+0000","last_active":"2024-03-16T17:48:47.761000+0000","last_peered":"2024-03-16T17:48:47.761000+0000","last_clean":"2024-03-16T17:48:47.761000+0000","last_became_active":"2024-03-16T17:48:47.754338+0000","last_became_peered":"2024-03-16T17:48:47.754338+0000","last_unstale":"2024-03-16T17:48:47.761000+0000","last_undegraded":"2024-03-16T17:48:47.761000+0000","last_fullsized":"2024-03-16T17:48:47.761000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:03:47.483043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756396+0000","last_change":"2024-03-16T17:48:46.752541+0000","last_active":"2024-03-16T17:48:47.756396+0000","last_peered":"2024-03-16T17:48:47.756396+0000","last_clean":"2024-03-16T17:48:47.756396+0000","last_became_active":"2024-03-16T17:48:46.752255+0000","last_became_peered":"2024-03-16T17:48:46.752255+0000","last_unstale":"2024-03-16T17:48:47.756396+0000","last_undegraded":"2024-03-16T17:48:47.756396+0000","last_fullsized":"2024-03-16T17:48:47.756396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:44:02.938760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761980+0000","last_change":"2024-03-16T17:48:47.756562+0000","last_active":"2024-03-16T17:48:47.761980+0000","last_peered":"2024-03-16T17:48:47.761980+0000","last_clean":"2024-03-16T17:48:47.761980+0000","last_became_active":"2024-03-16T17:48:47.756247+0000","last_became_peered":"2024-03-16T17:48:47.756247+0000","last_unstale":"2024-03-16T17:48:47.761980+0000","last_undegraded":"2024-03-16T17:48:47.761980+0000","last_fullsized":"2024-03-16T17:48:47.761980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:19:53.998029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.759341+0000","last_change":"2024-03-16T17:48:46.748961+0000","last_active":"2024-03-16T17:48:47.759341+0000","last_peered":"2024-03-16T17:48:47.759341+0000","last_clean":"2024-03-16T17:48:47.759341+0000","last_became_active":"2024-03-16T17:48:46.748717+0000","last_became_peered":"2024-03-16T17:48:46.748717+0000","last_unstale":"2024-03-16T17:48:47.759341+0000","last_undegraded":"2024-03-16T17:48:47.759341+0000","last_fullsized":"2024-03-16T17:48:47.759341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:36:43.072042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765485+0000","last_change":"2024-03-16T17:48:47.760475+0000","last_active":"2024-03-16T17:48:47.765485+0000","last_peered":"2024-03-16T17:48:47.765485+0000","last_clean":"2024-03-16T17:48:47.765485+0000","last_became_active":"2024-03-16T17:48:47.758023+0000","last_became_peered":"2024-03-16T17:48:47.758023+0000","last_unstale":"2024-03-16T17:48:47.765485+0000","last_undegraded":"2024-03-16T17:48:47.765485+0000","last_fullsized":"2024-03-16T17:48:47.765485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:57:04.807347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760685+0000","last_change":"2024-03-16T17:48:46.744778+0000","last_active":"2024-03-16T17:48:47.760685+0000","last_peered":"2024-03-16T17:48:47.760685+0000","last_clean":"2024-03-16T17:48:47.760685+0000","last_became_active":"2024-03-16T17:48:46.744486+0000","last_became_peered":"2024-03-16T17:48:46.744486+0000","last_unstale":"2024-03-16T17:48:47.760685+0000","last_undegraded":"2024-03-16T17:48:47.760685+0000","last_fullsized":"2024-03-16T17:48:47.760685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:36.395336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.758294+0000","last_change":"2024-03-16T17:48:47.752271+0000","last_active":"2024-03-16T17:48:47.758294+0000","last_peered":"2024-03-16T17:48:47.758294+0000","last_clean":"2024-03-16T17:48:47.758294+0000","last_became_active":"2024-03-16T17:48:47.751846+0000","last_became_peered":"2024-03-16T17:48:47.751846+0000","last_unstale":"2024-03-16T17:48:47.758294+0000","last_undegraded":"2024-03-16T17:48:47.758294+0000","last_fullsized":"2024-03-16T17:48:47.758294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:46:01.680221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.742128+0000","last_change":"2024-03-16T17:48:46.750805+0000","last_active":"2024-03-16T17:48:47.742128+0000","last_peered":"2024-03-16T17:48:47.742128+0000","last_clean":"2024-03-16T17:48:47.742128+0000","last_became_active":"2024-03-16T17:48:46.750499+0000","last_became_peered":"2024-03-16T17:48:46.750499+0000","last_unstale":"2024-03-16T17:48:47.742128+0000","last_undegraded":"2024-03-16T17:48:47.742128+0000","last_fullsized":"2024-03-16T17:48:47.742128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:38:10.324469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760050+0000","last_change":"2024-03-16T17:48:47.754119+0000","last_active":"2024-03-16T17:48:47.760050+0000","last_peered":"2024-03-16T17:48:47.760050+0000","last_clean":"2024-03-16T17:48:47.760050+0000","last_became_active":"2024-03-16T17:48:47.753647+0000","last_became_peered":"2024-03-16T17:48:47.753647+0000","last_unstale":"2024-03-16T17:48:47.760050+0000","last_undegraded":"2024-03-16T17:48:47.760050+0000","last_fullsized":"2024-03-16T17:48:47.760050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:09:05.555135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.758091+0000","last_change":"2024-03-16T17:48:46.752633+0000","last_active":"2024-03-16T17:48:47.758091+0000","last_peered":"2024-03-16T17:48:47.758091+0000","last_clean":"2024-03-16T17:48:47.758091+0000","last_became_active":"2024-03-16T17:48:46.752373+0000","last_became_peered":"2024-03-16T17:48:46.752373+0000","last_unstale":"2024-03-16T17:48:47.758091+0000","last_undegraded":"2024-03-16T17:48:47.758091+0000","last_fullsized":"2024-03-16T17:48:47.758091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:44:02.938760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760086+0000","last_change":"2024-03-16T17:48:47.753138+0000","last_active":"2024-03-16T17:48:47.760086+0000","last_peered":"2024-03-16T17:48:47.760086+0000","last_clean":"2024-03-16T17:48:47.760086+0000","last_became_active":"2024-03-16T17:48:47.752107+0000","last_became_peered":"2024-03-16T17:48:47.752107+0000","last_unstale":"2024-03-16T17:48:47.760086+0000","last_undegraded":"2024-03-16T17:48:47.760086+0000","last_fullsized":"2024-03-16T17:48:47.760086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:35:31.397771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.748751+0000","last_change":"2024-03-16T17:48:46.758497+0000","last_active":"2024-03-16T17:48:47.748751+0000","last_peered":"2024-03-16T17:48:47.748751+0000","last_clean":"2024-03-16T17:48:47.748751+0000","last_became_active":"2024-03-16T17:48:46.758255+0000","last_became_peered":"2024-03-16T17:48:46.758255+0000","last_unstale":"2024-03-16T17:48:47.748751+0000","last_undegraded":"2024-03-16T17:48:47.748751+0000","last_fullsized":"2024-03-16T17:48:47.748751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:36:43.072042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.759874+0000","last_change":"2024-03-16T17:48:47.752182+0000","last_active":"2024-03-16T17:48:47.759874+0000","last_peered":"2024-03-16T17:48:47.759874+0000","last_clean":"2024-03-16T17:48:47.759874+0000","last_became_active":"2024-03-16T17:48:47.751815+0000","last_became_peered":"2024-03-16T17:48:47.751815+0000","last_unstale":"2024-03-16T17:48:47.759874+0000","last_undegraded":"2024-03-16T17:48:47.759874+0000","last_fullsized":"2024-03-16T17:48:47.759874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:05:27.275899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.741785+0000","last_change":"2024-03-16T17:48:46.752540+0000","last_active":"2024-03-16T17:48:47.741785+0000","last_peered":"2024-03-16T17:48:47.741785+0000","last_clean":"2024-03-16T17:48:47.741785+0000","last_became_active":"2024-03-16T17:48:46.752219+0000","last_became_peered":"2024-03-16T17:48:46.752219+0000","last_unstale":"2024-03-16T17:48:47.741785+0000","last_undegraded":"2024-03-16T17:48:47.741785+0000","last_fullsized":"2024-03-16T17:48:47.741785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:29.071912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761879+0000","last_change":"2024-03-16T17:48:47.758700+0000","last_active":"2024-03-16T17:48:47.761879+0000","last_peered":"2024-03-16T17:48:47.761879+0000","last_clean":"2024-03-16T17:48:47.761879+0000","last_became_active":"2024-03-16T17:48:47.758428+0000","last_became_peered":"2024-03-16T17:48:47.758428+0000","last_unstale":"2024-03-16T17:48:47.761879+0000","last_undegraded":"2024-03-16T17:48:47.761879+0000","last_fullsized":"2024-03-16T17:48:47.761879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:53.625777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.739872+0000","last_change":"2024-03-16T17:48:46.752681+0000","last_active":"2024-03-16T17:48:47.739872+0000","last_peered":"2024-03-16T17:48:47.739872+0000","last_clean":"2024-03-16T17:48:47.739872+0000","last_became_active":"2024-03-16T17:48:46.752425+0000","last_became_peered":"2024-03-16T17:48:46.752425+0000","last_unstale":"2024-03-16T17:48:47.739872+0000","last_undegraded":"2024-03-16T17:48:47.739872+0000","last_fullsized":"2024-03-16T17:48:47.739872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:52.623889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760008+0000","last_change":"2024-03-16T17:48:47.754824+0000","last_active":"2024-03-16T17:48:47.760008+0000","last_peered":"2024-03-16T17:48:47.760008+0000","last_clean":"2024-03-16T17:48:47.760008+0000","last_became_active":"2024-03-16T17:48:47.754430+0000","last_became_peered":"2024-03-16T17:48:47.754430+0000","last_unstale":"2024-03-16T17:48:47.760008+0000","last_undegraded":"2024-03-16T17:48:47.760008+0000","last_fullsized":"2024-03-16T17:48:47.760008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:44.340858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.763300+0000","last_change":"2024-03-16T17:48:46.751910+0000","last_active":"2024-03-16T17:48:47.763300+0000","last_peered":"2024-03-16T17:48:47.763300+0000","last_clean":"2024-03-16T17:48:47.763300+0000","last_became_active":"2024-03-16T17:48:46.751620+0000","last_became_peered":"2024-03-16T17:48:46.751620+0000","last_unstale":"2024-03-16T17:48:47.763300+0000","last_undegraded":"2024-03-16T17:48:47.763300+0000","last_fullsized":"2024-03-16T17:48:47.763300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:30.871924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765073+0000","last_change":"2024-03-16T17:48:47.759664+0000","last_active":"2024-03-16T17:48:47.765073+0000","last_peered":"2024-03-16T17:48:47.765073+0000","last_clean":"2024-03-16T17:48:47.765073+0000","last_became_active":"2024-03-16T17:48:47.759372+0000","last_became_peered":"2024-03-16T17:48:47.759372+0000","last_unstale":"2024-03-16T17:48:47.765073+0000","last_undegraded":"2024-03-16T17:48:47.765073+0000","last_fullsized":"2024-03-16T17:48:47.765073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:14:07.669072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.744034+0000","last_change":"2024-03-16T17:48:46.758003+0000","last_active":"2024-03-16T17:48:47.744034+0000","last_peered":"2024-03-16T17:48:47.744034+0000","last_clean":"2024-03-16T17:48:47.744034+0000","last_became_active":"2024-03-16T17:48:46.757716+0000","last_became_peered":"2024-03-16T17:48:46.757716+0000","last_unstale":"2024-03-16T17:48:47.744034+0000","last_undegraded":"2024-03-16T17:48:47.744034+0000","last_fullsized":"2024-03-16T17:48:47.744034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:54:45.226047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762767+0000","last_change":"2024-03-16T17:48:47.758672+0000","last_active":"2024-03-16T17:48:47.762767+0000","last_peered":"2024-03-16T17:48:47.762767+0000","last_clean":"2024-03-16T17:48:47.762767+0000","last_became_active":"2024-03-16T17:48:47.758411+0000","last_became_peered":"2024-03-16T17:48:47.758411+0000","last_unstale":"2024-03-16T17:48:47.762767+0000","last_undegraded":"2024-03-16T17:48:47.762767+0000","last_fullsized":"2024-03-16T17:48:47.762767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:53.625777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.748501+0000","last_change":"2024-03-16T17:48:46.757828+0000","last_active":"2024-03-16T17:48:47.748501+0000","last_peered":"2024-03-16T17:48:47.748501+0000","last_clean":"2024-03-16T17:48:47.748501+0000","last_became_active":"2024-03-16T17:48:46.757556+0000","last_became_peered":"2024-03-16T17:48:46.757556+0000","last_unstale":"2024-03-16T17:48:47.748501+0000","last_undegraded":"2024-03-16T17:48:47.748501+0000","last_fullsized":"2024-03-16T17:48:47.748501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:03:46.481155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.758840+0000","last_change":"2024-03-16T17:48:47.757594+0000","last_active":"2024-03-16T17:48:47.758840+0000","last_peered":"2024-03-16T17:48:47.758840+0000","last_clean":"2024-03-16T17:48:47.758840+0000","last_became_active":"2024-03-16T17:48:47.757233+0000","last_became_peered":"2024-03-16T17:48:47.757233+0000","last_unstale":"2024-03-16T17:48:47.758840+0000","last_undegraded":"2024-03-16T17:48:47.758840+0000","last_fullsized":"2024-03-16T17:48:47.758840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:44:03.940649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.744983+0000","last_change":"2024-03-16T17:48:46.747638+0000","last_active":"2024-03-16T17:48:47.744983+0000","last_peered":"2024-03-16T17:48:47.744983+0000","last_clean":"2024-03-16T17:48:47.744983+0000","last_became_active":"2024-03-16T17:48:46.747386+0000","last_became_peered":"2024-03-16T17:48:46.747386+0000","last_unstale":"2024-03-16T17:48:47.744983+0000","last_undegraded":"2024-03-16T17:48:47.744983+0000","last_fullsized":"2024-03-16T17:48:47.744983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:03:46.481155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.757156+0000","last_change":"2024-03-16T17:48:47.750636+0000","last_active":"2024-03-16T17:48:47.757156+0000","last_peered":"2024-03-16T17:48:47.757156+0000","last_clean":"2024-03-16T17:48:47.757156+0000","last_became_active":"2024-03-16T17:48:47.750316+0000","last_became_peered":"2024-03-16T17:48:47.750316+0000","last_unstale":"2024-03-16T17:48:47.757156+0000","last_undegraded":"2024-03-16T17:48:47.757156+0000","last_fullsized":"2024-03-16T17:48:47.757156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:13:30.548232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.748170+0000","last_change":"2024-03-16T17:48:46.757818+0000","last_active":"2024-03-16T17:48:47.748170+0000","last_peered":"2024-03-16T17:48:47.748170+0000","last_clean":"2024-03-16T17:48:47.748170+0000","last_became_active":"2024-03-16T17:48:46.757541+0000","last_became_peered":"2024-03-16T17:48:46.757541+0000","last_unstale":"2024-03-16T17:48:47.748170+0000","last_undegraded":"2024-03-16T17:48:47.748170+0000","last_fullsized":"2024-03-16T17:48:47.748170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:54:45.226047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762997+0000","last_change":"2024-03-16T17:48:47.754820+0000","last_active":"2024-03-16T17:48:47.762997+0000","last_peered":"2024-03-16T17:48:47.762997+0000","last_clean":"2024-03-16T17:48:47.762997+0000","last_became_active":"2024-03-16T17:48:47.754555+0000","last_became_peered":"2024-03-16T17:48:47.754555+0000","last_unstale":"2024-03-16T17:48:47.762997+0000","last_undegraded":"2024-03-16T17:48:47.762997+0000","last_fullsized":"2024-03-16T17:48:47.762997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:27:17.403221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.741783+0000","last_change":"2024-03-16T17:48:46.749143+0000","last_active":"2024-03-16T17:48:47.741783+0000","last_peered":"2024-03-16T17:48:47.741783+0000","last_clean":"2024-03-16T17:48:47.741783+0000","last_became_active":"2024-03-16T17:48:46.748892+0000","last_became_peered":"2024-03-16T17:48:46.748892+0000","last_unstale":"2024-03-16T17:48:47.741783+0000","last_undegraded":"2024-03-16T17:48:47.741783+0000","last_fullsized":"2024-03-16T17:48:47.741783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:43.338969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762869+0000","last_change":"2024-03-16T17:48:47.759076+0000","last_active":"2024-03-16T17:48:47.762869+0000","last_peered":"2024-03-16T17:48:47.762869+0000","last_clean":"2024-03-16T17:48:47.762869+0000","last_became_active":"2024-03-16T17:48:47.758003+0000","last_became_peered":"2024-03-16T17:48:47.758003+0000","last_unstale":"2024-03-16T17:48:47.762869+0000","last_undegraded":"2024-03-16T17:48:47.762869+0000","last_fullsized":"2024-03-16T17:48:47.762869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:53.625777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.738399+0000","last_change":"2024-03-16T17:48:46.755077+0000","last_active":"2024-03-16T17:48:47.738399+0000","last_peered":"2024-03-16T17:48:47.738399+0000","last_clean":"2024-03-16T17:48:47.738399+0000","last_became_active":"2024-03-16T17:48:46.754889+0000","last_became_peered":"2024-03-16T17:48:46.754889+0000","last_unstale":"2024-03-16T17:48:47.738399+0000","last_undegraded":"2024-03-16T17:48:47.738399+0000","last_fullsized":"2024-03-16T17:48:47.738399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:13:29.546344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.764869+0000","last_change":"2024-03-16T17:48:47.761175+0000","last_active":"2024-03-16T17:48:47.764869+0000","last_peered":"2024-03-16T17:48:47.764869+0000","last_clean":"2024-03-16T17:48:47.764869+0000","last_became_active":"2024-03-16T17:48:47.760912+0000","last_became_peered":"2024-03-16T17:48:47.760912+0000","last_unstale":"2024-03-16T17:48:47.764869+0000","last_undegraded":"2024-03-16T17:48:47.764869+0000","last_fullsized":"2024-03-16T17:48:47.764869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:50:32.529119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.745374+0000","last_change":"2024-03-16T17:48:46.748196+0000","last_active":"2024-03-16T17:48:47.745374+0000","last_peered":"2024-03-16T17:48:47.745374+0000","last_clean":"2024-03-16T17:48:47.745374+0000","last_became_active":"2024-03-16T17:48:46.747862+0000","last_became_peered":"2024-03-16T17:48:46.747862+0000","last_unstale":"2024-03-16T17:48:47.745374+0000","last_undegraded":"2024-03-16T17:48:47.745374+0000","last_fullsized":"2024-03-16T17:48:47.745374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:11:44.232087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.750063+0000","last_change":"2024-03-16T17:47:39.177353+0000","last_active":"2024-03-16T17:48:47.750063+0000","last_peered":"2024-03-16T17:48:47.750063+0000","last_clean":"2024-03-16T17:48:47.750063+0000","last_became_active":"2024-03-16T17:47:39.176109+0000","last_became_peered":"2024-03-16T17:47:39.176109+0000","last_unstale":"2024-03-16T17:48:47.750063+0000","last_undegraded":"2024-03-16T17:48:47.750063+0000","last_fullsized":"2024-03-16T17:48:47.750063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_clean_scrub_stamp":"2024-03-16T17:47:37.885590+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:47.704856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":132909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":132909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":132909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":132909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":132909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":141318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T17:48:50.731 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-16T17:48:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.866+0000 7ffb1912c640 1 Processor -- start 2024-03-16T17:48:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.866+0000 7ffb1912c640 1 -- start start 2024-03-16T17:48:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1912c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ffb14156410 0x7ffb1415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1912c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb140d2020 0x7ffb14160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1912c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1415d2f0 con 0x7ffb140d1b90 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1912c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1409b700 con 0x7ffb140d2020 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1912c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb141567f0 con 0x7ffb14156410 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb140d2020 0x7ffb14160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ffb140d1b90 0x7ffb1415f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47694/0 (socket says 172.21.15.132:47694) 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb140d2020 0x7ffb14160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37848/0 (socket says 172.21.15.132:37848) 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1259c640 1 -- 172.21.15.132:0/1262803866 learned_addr learned my addr 172.21.15.132:0/1262803866 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb12d9d640 1 --2- 172.21.15.132:0/1262803866 >> v2:172.21.15.194:3300/0 conn(0x7ffb14156410 0x7ffb1415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1359e640 1 -- 172.21.15.132:0/1262803866 >> v2:172.21.15.194:3300/0 conn(0x7ffb14156410 msgr2=0x7ffb1415cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1359e640 1 --2- 172.21.15.132:0/1262803866 >> v2:172.21.15.194:3300/0 conn(0x7ffb14156410 0x7ffb1415cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1359e640 1 -- 172.21.15.132:0/1262803866 >> v1:172.21.15.132:6789/0 conn(0x7ffb140d1b90 legacy=0x7ffb1415f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb11d9b640 1 -- 172.21.15.132:0/1262803866 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807772361 0 0) 0x7ffb1415d2f0 con 0x7ffb140d1b90 2024-03-16T17:48:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.867+0000 7ffb1359e640 1 -- 172.21.15.132:0/1262803866 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1409b180 con 0x7ffb140d2020 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.868+0000 7ffb1359e640 1 --2- 172.21.15.132:0/1262803866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 0x7ffb14160030 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffb1406e800 tx=0x7ffb0c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed0cc7c61029897 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.868+0000 7ffb11d9b640 1 -- 172.21.15.132:0/1262803866 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c031710 con 0x7ffb140d2020 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.868+0000 7ffb11d9b640 1 -- 172.21.15.132:0/1262803866 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c02f050 con 0x7ffb140d2020 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.868+0000 7ffb11d9b640 1 -- 172.21.15.132:0/1262803866 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c031a90 con 0x7ffb140d2020 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.869+0000 7ffb1912c640 1 -- 172.21.15.132:0/1262803866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 msgr2=0x7ffb14160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.869+0000 7ffb1912c640 1 --2- 172.21.15.132:0/1262803866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 0x7ffb14160030 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffb1406e800 tx=0x7ffb0c02b7b0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.869+0000 7ffb1912c640 1 -- 172.21.15.132:0/1262803866 shutdown_connections 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.869+0000 7ffb1912c640 1 --2- 172.21.15.132:0/1262803866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 0x7ffb14160030 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.869+0000 7ffb1912c640 1 --2- 172.21.15.132:0/1262803866 >> v2:172.21.15.194:3300/0 conn(0x7ffb14156410 0x7ffb1415cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.869+0000 7ffb1912c640 1 -- 172.21.15.132:0/1262803866 >> 172.21.15.132:0/1262803866 conn(0x7ffb14073220 msgr2=0x7ffb1409aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.869+0000 7ffb1912c640 1 -- 172.21.15.132:0/1262803866 shutdown_connections 2024-03-16T17:48:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.869+0000 7ffb1912c640 1 -- 172.21.15.132:0/1262803866 wait complete. 2024-03-16T17:48:50.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.870+0000 7ffb1912c640 1 Processor -- start 2024-03-16T17:48:50.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.870+0000 7ffb1912c640 1 -- start start 2024-03-16T17:48:50.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1912c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb140d1b90 0x7ffb14156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1912c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 0x7ffb141f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1912c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb14156410 0x7ffb141f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1912c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1409bc00 con 0x7ffb140d2020 2024-03-16T17:48:50.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1912c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1409bea0 con 0x7ffb140d1b90 2024-03-16T17:48:50.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1912c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1409c180 con 0x7ffb14156410 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 0x7ffb141f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 0x7ffb141f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37860/0 (socket says 172.21.15.132:37860) 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1259c640 1 -- 172.21.15.132:0/3659277208 learned_addr learned my addr 172.21.15.132:0/3659277208 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1359e640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb14156410 0x7ffb141f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb12d9d640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb140d1b90 0x7ffb14156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1259c640 1 -- 172.21.15.132:0/3659277208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb14156410 msgr2=0x7ffb141f1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1259c640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb14156410 0x7ffb141f1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1259c640 1 -- 172.21.15.132:0/3659277208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb140d1b90 msgr2=0x7ffb14156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1259c640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb140d1b90 0x7ffb14156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.871+0000 7ffb1259c640 1 -- 172.21.15.132:0/3659277208 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c009400 con 0x7ffb140d2020 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.872+0000 7ffb1259c640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 0x7ffb141f14f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800c4a0 tx=0x7ffb0800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.872+0000 7ffafb7fe640 1 -- 172.21.15.132:0/3659277208 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb080074e0 con 0x7ffb140d2020 2024-03-16T17:48:50.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.872+0000 7ffafb7fe640 1 -- 172.21.15.132:0/3659277208 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb08007640 con 0x7ffb140d2020 2024-03-16T17:48:50.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.872+0000 7ffb1912c640 1 -- 172.21.15.132:0/3659277208 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1409c460 con 0x7ffb140d2020 2024-03-16T17:48:50.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.872+0000 7ffafb7fe640 1 -- 172.21.15.132:0/3659277208 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08004a00 con 0x7ffb140d2020 2024-03-16T17:48:50.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.872+0000 7ffb1912c640 1 -- 172.21.15.132:0/3659277208 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1409ca20 con 0x7ffb140d2020 2024-03-16T17:48:50.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.873+0000 7ffb1912c640 1 -- 172.21.15.132:0/3659277208 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1409cc10 con 0x7ffb140d2020 2024-03-16T17:48:50.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.873+0000 7ffafb7fe640 1 -- 172.21.15.132:0/3659277208 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7ffb08004b60 con 0x7ffb140d2020 2024-03-16T17:48:50.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.874+0000 7ffafb7fe640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffb0006b3b0 0x7ffb0006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:50.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.874+0000 7ffafb7fe640 1 -- 172.21.15.132:0/3659277208 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb08089080 con 0x7ffb140d2020 2024-03-16T17:48:50.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.874+0000 7ffb12d9d640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffb0006b3b0 0x7ffb0006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:50.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.874+0000 7ffb12d9d640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffb0006b3b0 0x7ffb0006d870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb04007380 tx=0x7ffb0400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:50.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:50.878+0000 7ffafb7fe640 1 -- 172.21.15.132:0/3659277208 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ffb08053d70 con 0x7ffb140d2020 2024-03-16T17:48:51.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.053+0000 7ffb1912c640 1 -- 172.21.15.132:0/3659277208 --> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb140b30b0 con 0x7ffb0006b3b0 2024-03-16T17:48:51.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.059+0000 7ffafb7fe640 1 -- 172.21.15.132:0/3659277208 <== mgr.4107 v2:172.21.15.132:6832/2724898791 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251879 (secure 0 0 0) 0x7ffb040143d0 con 0x7ffb0006b3b0 2024-03-16T17:48:51.065 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-03-16T17:48:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.062+0000 7ffb1912c640 1 -- 172.21.15.132:0/3659277208 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffb0006b3b0 msgr2=0x7ffb0006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.062+0000 7ffb1912c640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffb0006b3b0 0x7ffb0006d870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb04007380 tx=0x7ffb0400b040 comp rx=0 tx=0).stop 2024-03-16T17:48:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.062+0000 7ffb1912c640 1 -- 172.21.15.132:0/3659277208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 msgr2=0x7ffb141f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.062+0000 7ffb1912c640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 0x7ffb141f14f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800c4a0 tx=0x7ffb0800c960 comp rx=0 tx=0).stop 2024-03-16T17:48:51.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.062+0000 7ffb1912c640 1 -- 172.21.15.132:0/3659277208 shutdown_connections 2024-03-16T17:48:51.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.062+0000 7ffb1912c640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ffb0006b3b0 0x7ffb0006d870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.062+0000 7ffb1912c640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb14156410 0x7ffb141f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.063+0000 7ffb1912c640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb140d2020 0x7ffb141f14f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.063+0000 7ffb1912c640 1 --2- 172.21.15.132:0/3659277208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb140d1b90 0x7ffb14156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.063+0000 7ffb1912c640 1 -- 172.21.15.132:0/3659277208 >> 172.21.15.132:0/3659277208 conn(0x7ffb14073220 msgr2=0x7ffb141556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:51.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.063+0000 7ffb1912c640 1 -- 172.21.15.132:0/3659277208 shutdown_connections 2024-03-16T17:48:51.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.063+0000 7ffb1912c640 1 -- 172.21.15.132:0/3659277208 wait complete. 2024-03-16T17:48:51.077 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-03-16T17:48:49.855835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220088,"kb_used_data":3908,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754632,"statfs":{"total":773094113280,"available":772868743168,"internally_reserved":0,"allocated":4001792,"data_stored":2252417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12753,"internal_metadata":221236783},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.129282"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.758834+0000","last_change":"2024-03-16T17:48:47.757564+0000","last_active":"2024-03-16T17:48:47.758834+0000","last_peered":"2024-03-16T17:48:47.758834+0000","last_clean":"2024-03-16T17:48:47.758834+0000","last_became_active":"2024-03-16T17:48:47.757261+0000","last_became_peered":"2024-03-16T17:48:47.757261+0000","last_unstale":"2024-03-16T17:48:47.758834+0000","last_undegraded":"2024-03-16T17:48:47.758834+0000","last_fullsized":"2024-03-16T17:48:47.758834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:54:46.227936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755748+0000","last_change":"2024-03-16T17:48:47.751877+0000","last_active":"2024-03-16T17:48:47.755748+0000","last_peered":"2024-03-16T17:48:47.755748+0000","last_clean":"2024-03-16T17:48:47.755748+0000","last_became_active":"2024-03-16T17:48:47.751612+0000","last_became_peered":"2024-03-16T17:48:47.751612+0000","last_unstale":"2024-03-16T17:48:47.755748+0000","last_undegraded":"2024-03-16T17:48:47.755748+0000","last_fullsized":"2024-03-16T17:48:47.755748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:19:53.998029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762152+0000","last_change":"2024-03-16T17:48:47.758621+0000","last_active":"2024-03-16T17:48:47.762152+0000","last_peered":"2024-03-16T17:48:47.762152+0000","last_clean":"2024-03-16T17:48:47.762152+0000","last_became_active":"2024-03-16T17:48:47.758165+0000","last_became_peered":"2024-03-16T17:48:47.758165+0000","last_unstale":"2024-03-16T17:48:47.762152+0000","last_undegraded":"2024-03-16T17:48:47.762152+0000","last_fullsized":"2024-03-16T17:48:47.762152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:27:17.403221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765692+0000","last_change":"2024-03-16T17:48:47.761702+0000","last_active":"2024-03-16T17:48:47.765692+0000","last_peered":"2024-03-16T17:48:47.765692+0000","last_clean":"2024-03-16T17:48:47.765692+0000","last_became_active":"2024-03-16T17:48:47.760988+0000","last_became_peered":"2024-03-16T17:48:47.760988+0000","last_unstale":"2024-03-16T17:48:47.765692+0000","last_undegraded":"2024-03-16T17:48:47.765692+0000","last_fullsized":"2024-03-16T17:48:47.765692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:50:32.529119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.758337+0000","last_change":"2024-03-16T17:48:47.752441+0000","last_active":"2024-03-16T17:48:47.758337+0000","last_peered":"2024-03-16T17:48:47.758337+0000","last_clean":"2024-03-16T17:48:47.758337+0000","last_became_active":"2024-03-16T17:48:47.751674+0000","last_became_peered":"2024-03-16T17:48:47.751674+0000","last_unstale":"2024-03-16T17:48:47.758337+0000","last_undegraded":"2024-03-16T17:48:47.758337+0000","last_fullsized":"2024-03-16T17:48:47.758337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:09:06.088918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755465+0000","last_change":"2024-03-16T17:48:47.749437+0000","last_active":"2024-03-16T17:48:47.755465+0000","last_peered":"2024-03-16T17:48:47.755465+0000","last_clean":"2024-03-16T17:48:47.755465+0000","last_became_active":"2024-03-16T17:48:47.746317+0000","last_became_peered":"2024-03-16T17:48:47.746317+0000","last_unstale":"2024-03-16T17:48:47.755465+0000","last_undegraded":"2024-03-16T17:48:47.755465+0000","last_fullsized":"2024-03-16T17:48:47.755465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:05:22.746741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761896+0000","last_change":"2024-03-16T17:48:47.759894+0000","last_active":"2024-03-16T17:48:47.761896+0000","last_peered":"2024-03-16T17:48:47.761896+0000","last_clean":"2024-03-16T17:48:47.761896+0000","last_became_active":"2024-03-16T17:48:47.759627+0000","last_became_peered":"2024-03-16T17:48:47.759627+0000","last_unstale":"2024-03-16T17:48:47.761896+0000","last_undegraded":"2024-03-16T17:48:47.761896+0000","last_fullsized":"2024-03-16T17:48:47.761896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:57:04.807347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756793+0000","last_change":"2024-03-16T17:48:47.754973+0000","last_active":"2024-03-16T17:48:47.756793+0000","last_peered":"2024-03-16T17:48:47.756793+0000","last_clean":"2024-03-16T17:48:47.756793+0000","last_became_active":"2024-03-16T17:48:47.754658+0000","last_became_peered":"2024-03-16T17:48:47.754658+0000","last_unstale":"2024-03-16T17:48:47.756793+0000","last_undegraded":"2024-03-16T17:48:47.756793+0000","last_fullsized":"2024-03-16T17:48:47.756793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:13:30.548232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760974+0000","last_change":"2024-03-16T17:48:47.753755+0000","last_active":"2024-03-16T17:48:47.760974+0000","last_peered":"2024-03-16T17:48:47.760974+0000","last_clean":"2024-03-16T17:48:47.760974+0000","last_became_active":"2024-03-16T17:48:47.753433+0000","last_became_peered":"2024-03-16T17:48:47.753433+0000","last_unstale":"2024-03-16T17:48:47.760974+0000","last_undegraded":"2024-03-16T17:48:47.760974+0000","last_fullsized":"2024-03-16T17:48:47.760974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:44:03.940649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765369+0000","last_change":"2024-03-16T17:48:47.758740+0000","last_active":"2024-03-16T17:48:47.765369+0000","last_peered":"2024-03-16T17:48:47.765369+0000","last_clean":"2024-03-16T17:48:47.765369+0000","last_became_active":"2024-03-16T17:48:47.758481+0000","last_became_peered":"2024-03-16T17:48:47.758481+0000","last_unstale":"2024-03-16T17:48:47.765369+0000","last_undegraded":"2024-03-16T17:48:47.765369+0000","last_fullsized":"2024-03-16T17:48:47.765369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:05:11.348321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762556+0000","last_change":"2024-03-16T17:48:47.760347+0000","last_active":"2024-03-16T17:48:47.762556+0000","last_peered":"2024-03-16T17:48:47.762556+0000","last_clean":"2024-03-16T17:48:47.762556+0000","last_became_active":"2024-03-16T17:48:47.758652+0000","last_became_peered":"2024-03-16T17:48:47.758652+0000","last_unstale":"2024-03-16T17:48:47.762556+0000","last_undegraded":"2024-03-16T17:48:47.762556+0000","last_fullsized":"2024-03-16T17:48:47.762556+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:47.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756235+0000","last_change":"2024-03-16T17:48:47.753107+0000","last_active":"2024-03-16T17:48:47.756235+0000","last_peered":"2024-03-16T17:48:47.756235+0000","last_clean":"2024-03-16T17:48:47.756235+0000","last_became_active":"2024-03-16T17:48:47.752836+0000","last_became_peered":"2024-03-16T17:48:47.752836+0000","last_unstale":"2024-03-16T17:48:47.756235+0000","last_undegraded":"2024-03-16T17:48:47.756235+0000","last_fullsized":"2024-03-16T17:48:47.756235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:43.644778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760106+0000","last_change":"2024-03-16T17:48:47.755174+0000","last_active":"2024-03-16T17:48:47.760106+0000","last_peered":"2024-03-16T17:48:47.760106+0000","last_clean":"2024-03-16T17:48:47.760106+0000","last_became_active":"2024-03-16T17:48:47.754872+0000","last_became_peered":"2024-03-16T17:48:47.754872+0000","last_unstale":"2024-03-16T17:48:47.760106+0000","last_undegraded":"2024-03-16T17:48:47.760106+0000","last_fullsized":"2024-03-16T17:48:47.760106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:30.073800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755485+0000","last_change":"2024-03-16T17:48:47.749664+0000","last_active":"2024-03-16T17:48:47.755485+0000","last_peered":"2024-03-16T17:48:47.755485+0000","last_clean":"2024-03-16T17:48:47.755485+0000","last_became_active":"2024-03-16T17:48:47.749059+0000","last_became_peered":"2024-03-16T17:48:47.749059+0000","last_unstale":"2024-03-16T17:48:47.755485+0000","last_undegraded":"2024-03-16T17:48:47.755485+0000","last_fullsized":"2024-03-16T17:48:47.755485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:50:32.529119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761939+0000","last_change":"2024-03-16T17:48:47.757826+0000","last_active":"2024-03-16T17:48:47.761939+0000","last_peered":"2024-03-16T17:48:47.761939+0000","last_clean":"2024-03-16T17:48:47.761939+0000","last_became_active":"2024-03-16T17:48:47.755543+0000","last_became_peered":"2024-03-16T17:48:47.755543+0000","last_unstale":"2024-03-16T17:48:47.761939+0000","last_undegraded":"2024-03-16T17:48:47.761939+0000","last_fullsized":"2024-03-16T17:48:47.761939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:16:52.714825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767553+0000","last_change":"2024-03-16T17:48:47.764166+0000","last_active":"2024-03-16T17:48:47.767553+0000","last_peered":"2024-03-16T17:48:47.767553+0000","last_clean":"2024-03-16T17:48:47.767553+0000","last_became_active":"2024-03-16T17:48:47.763501+0000","last_became_peered":"2024-03-16T17:48:47.763501+0000","last_unstale":"2024-03-16T17:48:47.767553+0000","last_undegraded":"2024-03-16T17:48:47.767553+0000","last_fullsized":"2024-03-16T17:48:47.767553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:19:53.998029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762014+0000","last_change":"2024-03-16T17:48:47.760578+0000","last_active":"2024-03-16T17:48:47.762014+0000","last_peered":"2024-03-16T17:48:47.762014+0000","last_clean":"2024-03-16T17:48:47.762014+0000","last_became_active":"2024-03-16T17:48:47.760313+0000","last_became_peered":"2024-03-16T17:48:47.760313+0000","last_unstale":"2024-03-16T17:48:47.762014+0000","last_undegraded":"2024-03-16T17:48:47.762014+0000","last_fullsized":"2024-03-16T17:48:47.762014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:05:22.746741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765085+0000","last_change":"2024-03-16T17:48:47.759364+0000","last_active":"2024-03-16T17:48:47.765085+0000","last_peered":"2024-03-16T17:48:47.765085+0000","last_clean":"2024-03-16T17:48:47.765085+0000","last_became_active":"2024-03-16T17:48:47.759104+0000","last_became_peered":"2024-03-16T17:48:47.759104+0000","last_unstale":"2024-03-16T17:48:47.765085+0000","last_undegraded":"2024-03-16T17:48:47.765085+0000","last_fullsized":"2024-03-16T17:48:47.765085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:23:19.219730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760118+0000","last_change":"2024-03-16T17:48:47.757446+0000","last_active":"2024-03-16T17:48:47.760118+0000","last_peered":"2024-03-16T17:48:47.760118+0000","last_clean":"2024-03-16T17:48:47.760118+0000","last_became_active":"2024-03-16T17:48:47.757118+0000","last_became_peered":"2024-03-16T17:48:47.757118+0000","last_unstale":"2024-03-16T17:48:47.760118+0000","last_undegraded":"2024-03-16T17:48:47.760118+0000","last_fullsized":"2024-03-16T17:48:47.760118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:14:07.669072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760144+0000","last_change":"2024-03-16T17:48:47.754406+0000","last_active":"2024-03-16T17:48:47.760144+0000","last_peered":"2024-03-16T17:48:47.760144+0000","last_clean":"2024-03-16T17:48:47.760144+0000","last_became_active":"2024-03-16T17:48:47.754165+0000","last_became_peered":"2024-03-16T17:48:47.754165+0000","last_unstale":"2024-03-16T17:48:47.760144+0000","last_undegraded":"2024-03-16T17:48:47.760144+0000","last_fullsized":"2024-03-16T17:48:47.760144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:35:16.163898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.757524+0000","last_change":"2024-03-16T17:48:47.750619+0000","last_active":"2024-03-16T17:48:47.757524+0000","last_peered":"2024-03-16T17:48:47.757524+0000","last_clean":"2024-03-16T17:48:47.757524+0000","last_became_active":"2024-03-16T17:48:47.750363+0000","last_became_peered":"2024-03-16T17:48:47.750363+0000","last_unstale":"2024-03-16T17:48:47.757524+0000","last_undegraded":"2024-03-16T17:48:47.757524+0000","last_fullsized":"2024-03-16T17:48:47.757524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:22:22.290945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762680+0000","last_change":"2024-03-16T17:48:47.757511+0000","last_active":"2024-03-16T17:48:47.762680+0000","last_peered":"2024-03-16T17:48:47.762680+0000","last_clean":"2024-03-16T17:48:47.762680+0000","last_became_active":"2024-03-16T17:48:47.757233+0000","last_became_peered":"2024-03-16T17:48:47.757233+0000","last_unstale":"2024-03-16T17:48:47.762680+0000","last_undegraded":"2024-03-16T17:48:47.762680+0000","last_fullsized":"2024-03-16T17:48:47.762680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:13:30.548232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756744+0000","last_change":"2024-03-16T17:48:47.755546+0000","last_active":"2024-03-16T17:48:47.756744+0000","last_peered":"2024-03-16T17:48:47.756744+0000","last_clean":"2024-03-16T17:48:47.756744+0000","last_became_active":"2024-03-16T17:48:47.755285+0000","last_became_peered":"2024-03-16T17:48:47.755285+0000","last_unstale":"2024-03-16T17:48:47.756744+0000","last_undegraded":"2024-03-16T17:48:47.756744+0000","last_fullsized":"2024-03-16T17:48:47.756744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:47:46.904782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.752554+0000","last_change":"2024-03-16T17:48:47.745445+0000","last_active":"2024-03-16T17:48:47.752554+0000","last_peered":"2024-03-16T17:48:47.752554+0000","last_clean":"2024-03-16T17:48:47.752554+0000","last_became_active":"2024-03-16T17:48:47.745176+0000","last_became_peered":"2024-03-16T17:48:47.745176+0000","last_unstale":"2024-03-16T17:48:47.752554+0000","last_undegraded":"2024-03-16T17:48:47.752554+0000","last_fullsized":"2024-03-16T17:48:47.752554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:47.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765652+0000","last_change":"2024-03-16T17:48:47.761132+0000","last_active":"2024-03-16T17:48:47.765652+0000","last_peered":"2024-03-16T17:48:47.765652+0000","last_clean":"2024-03-16T17:48:47.765652+0000","last_became_active":"2024-03-16T17:48:47.760696+0000","last_became_peered":"2024-03-16T17:48:47.760696+0000","last_unstale":"2024-03-16T17:48:47.765652+0000","last_undegraded":"2024-03-16T17:48:47.765652+0000","last_fullsized":"2024-03-16T17:48:47.765652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:47.934567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755729+0000","last_change":"2024-03-16T17:48:47.751698+0000","last_active":"2024-03-16T17:48:47.755729+0000","last_peered":"2024-03-16T17:48:47.755729+0000","last_clean":"2024-03-16T17:48:47.755729+0000","last_became_active":"2024-03-16T17:48:47.751434+0000","last_became_peered":"2024-03-16T17:48:47.751434+0000","last_unstale":"2024-03-16T17:48:47.755729+0000","last_undegraded":"2024-03-16T17:48:47.755729+0000","last_fullsized":"2024-03-16T17:48:47.755729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:43.644778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765702+0000","last_change":"2024-03-16T17:48:47.761532+0000","last_active":"2024-03-16T17:48:47.765702+0000","last_peered":"2024-03-16T17:48:47.765702+0000","last_clean":"2024-03-16T17:48:47.765702+0000","last_became_active":"2024-03-16T17:48:47.760951+0000","last_became_peered":"2024-03-16T17:48:47.760951+0000","last_unstale":"2024-03-16T17:48:47.765702+0000","last_undegraded":"2024-03-16T17:48:47.765702+0000","last_fullsized":"2024-03-16T17:48:47.765702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:05:22.746741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755785+0000","last_change":"2024-03-16T17:48:47.751115+0000","last_active":"2024-03-16T17:48:47.755785+0000","last_peered":"2024-03-16T17:48:47.755785+0000","last_clean":"2024-03-16T17:48:47.755785+0000","last_became_active":"2024-03-16T17:48:47.750830+0000","last_became_peered":"2024-03-16T17:48:47.750830+0000","last_unstale":"2024-03-16T17:48:47.755785+0000","last_undegraded":"2024-03-16T17:48:47.755785+0000","last_fullsized":"2024-03-16T17:48:47.755785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:05:22.746741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762916+0000","last_change":"2024-03-16T17:48:47.757159+0000","last_active":"2024-03-16T17:48:47.762916+0000","last_peered":"2024-03-16T17:48:47.762916+0000","last_clean":"2024-03-16T17:48:47.762916+0000","last_became_active":"2024-03-16T17:48:47.756895+0000","last_became_peered":"2024-03-16T17:48:47.756895+0000","last_unstale":"2024-03-16T17:48:47.762916+0000","last_undegraded":"2024-03-16T17:48:47.762916+0000","last_fullsized":"2024-03-16T17:48:47.762916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:31.873813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761840+0000","last_change":"2024-03-16T17:48:47.759080+0000","last_active":"2024-03-16T17:48:47.761840+0000","last_peered":"2024-03-16T17:48:47.761840+0000","last_clean":"2024-03-16T17:48:47.761840+0000","last_became_active":"2024-03-16T17:48:47.758549+0000","last_became_peered":"2024-03-16T17:48:47.758549+0000","last_unstale":"2024-03-16T17:48:47.761840+0000","last_undegraded":"2024-03-16T17:48:47.761840+0000","last_fullsized":"2024-03-16T17:48:47.761840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:05:11.348321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.757909+0000","last_change":"2024-03-16T17:48:47.754918+0000","last_active":"2024-03-16T17:48:47.757909+0000","last_peered":"2024-03-16T17:48:47.757909+0000","last_clean":"2024-03-16T17:48:47.757909+0000","last_became_active":"2024-03-16T17:48:47.754664+0000","last_became_peered":"2024-03-16T17:48:47.754664+0000","last_unstale":"2024-03-16T17:48:47.757909+0000","last_undegraded":"2024-03-16T17:48:47.757909+0000","last_fullsized":"2024-03-16T17:48:47.757909+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:22:22.290945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767509+0000","last_change":"2024-03-16T17:48:47.762041+0000","last_active":"2024-03-16T17:48:47.767509+0000","last_peered":"2024-03-16T17:48:47.767509+0000","last_clean":"2024-03-16T17:48:47.767509+0000","last_became_active":"2024-03-16T17:48:47.761611+0000","last_became_peered":"2024-03-16T17:48:47.761611+0000","last_unstale":"2024-03-16T17:48:47.767509+0000","last_undegraded":"2024-03-16T17:48:47.767509+0000","last_fullsized":"2024-03-16T17:48:47.767509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:34:43.644778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756677+0000","last_change":"2024-03-16T17:48:47.750601+0000","last_active":"2024-03-16T17:48:47.756677+0000","last_peered":"2024-03-16T17:48:47.756677+0000","last_clean":"2024-03-16T17:48:47.756677+0000","last_became_active":"2024-03-16T17:48:47.750347+0000","last_became_peered":"2024-03-16T17:48:47.750347+0000","last_unstale":"2024-03-16T17:48:47.756677+0000","last_undegraded":"2024-03-16T17:48:47.756677+0000","last_fullsized":"2024-03-16T17:48:47.756677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:31.873813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762670+0000","last_change":"2024-03-16T17:48:46.750083+0000","last_active":"2024-03-16T17:48:47.762670+0000","last_peered":"2024-03-16T17:48:47.762670+0000","last_clean":"2024-03-16T17:48:47.762670+0000","last_became_active":"2024-03-16T17:48:46.749789+0000","last_became_peered":"2024-03-16T17:48:46.749789+0000","last_unstale":"2024-03-16T17:48:47.762670+0000","last_undegraded":"2024-03-16T17:48:47.762670+0000","last_fullsized":"2024-03-16T17:48:47.762670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:36.395336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767652+0000","last_change":"2024-03-16T17:48:47.763015+0000","last_active":"2024-03-16T17:48:47.767652+0000","last_peered":"2024-03-16T17:48:47.767652+0000","last_clean":"2024-03-16T17:48:47.767652+0000","last_became_active":"2024-03-16T17:48:47.762743+0000","last_became_peered":"2024-03-16T17:48:47.762743+0000","last_unstale":"2024-03-16T17:48:47.767652+0000","last_undegraded":"2024-03-16T17:48:47.767652+0000","last_fullsized":"2024-03-16T17:48:47.767652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:03:47.483043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756865+0000","last_change":"2024-03-16T17:48:46.752761+0000","last_active":"2024-03-16T17:48:47.756865+0000","last_peered":"2024-03-16T17:48:47.756865+0000","last_clean":"2024-03-16T17:48:47.756865+0000","last_became_active":"2024-03-16T17:48:46.752519+0000","last_became_peered":"2024-03-16T17:48:46.752519+0000","last_unstale":"2024-03-16T17:48:47.756865+0000","last_undegraded":"2024-03-16T17:48:47.756865+0000","last_fullsized":"2024-03-16T17:48:47.756865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:36:43.072042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762777+0000","last_change":"2024-03-16T17:48:47.757631+0000","last_active":"2024-03-16T17:48:47.762777+0000","last_peered":"2024-03-16T17:48:47.762777+0000","last_clean":"2024-03-16T17:48:47.762777+0000","last_became_active":"2024-03-16T17:48:47.756952+0000","last_became_peered":"2024-03-16T17:48:47.756952+0000","last_unstale":"2024-03-16T17:48:47.762777+0000","last_undegraded":"2024-03-16T17:48:47.762777+0000","last_fullsized":"2024-03-16T17:48:47.762777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:47:46.904782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.766223+0000","last_change":"2024-03-16T17:48:46.761290+0000","last_active":"2024-03-16T17:48:47.766223+0000","last_peered":"2024-03-16T17:48:47.766223+0000","last_clean":"2024-03-16T17:48:47.766223+0000","last_became_active":"2024-03-16T17:48:46.760992+0000","last_became_peered":"2024-03-16T17:48:46.760992+0000","last_unstale":"2024-03-16T17:48:47.766223+0000","last_undegraded":"2024-03-16T17:48:47.766223+0000","last_fullsized":"2024-03-16T17:48:47.766223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:05:10.346433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.763187+0000","last_change":"2024-03-16T17:48:47.757048+0000","last_active":"2024-03-16T17:48:47.763187+0000","last_peered":"2024-03-16T17:48:47.763187+0000","last_clean":"2024-03-16T17:48:47.763187+0000","last_became_active":"2024-03-16T17:48:47.756780+0000","last_became_peered":"2024-03-16T17:48:47.756780+0000","last_unstale":"2024-03-16T17:48:47.763187+0000","last_undegraded":"2024-03-16T17:48:47.763187+0000","last_fullsized":"2024-03-16T17:48:47.763187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:13:30.548232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762248+0000","last_change":"2024-03-16T17:48:46.758539+0000","last_active":"2024-03-16T17:48:47.762248+0000","last_peered":"2024-03-16T17:48:47.762248+0000","last_clean":"2024-03-16T17:48:47.762248+0000","last_became_active":"2024-03-16T17:48:46.758200+0000","last_became_peered":"2024-03-16T17:48:46.758200+0000","last_unstale":"2024-03-16T17:48:47.762248+0000","last_undegraded":"2024-03-16T17:48:47.762248+0000","last_fullsized":"2024-03-16T17:48:47.762248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:41:19.482529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761814+0000","last_change":"2024-03-16T17:48:47.757364+0000","last_active":"2024-03-16T17:48:47.761814+0000","last_peered":"2024-03-16T17:48:47.761814+0000","last_clean":"2024-03-16T17:48:47.761814+0000","last_became_active":"2024-03-16T17:48:47.757035+0000","last_became_peered":"2024-03-16T17:48:47.757035+0000","last_unstale":"2024-03-16T17:48:47.761814+0000","last_undegraded":"2024-03-16T17:48:47.761814+0000","last_fullsized":"2024-03-16T17:48:47.761814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:47:46.904782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.763483+0000","last_change":"2024-03-16T17:48:46.750755+0000","last_active":"2024-03-16T17:48:47.763483+0000","last_peered":"2024-03-16T17:48:47.763483+0000","last_clean":"2024-03-16T17:48:47.763483+0000","last_became_active":"2024-03-16T17:48:46.750484+0000","last_became_peered":"2024-03-16T17:48:46.750484+0000","last_unstale":"2024-03-16T17:48:47.763483+0000","last_undegraded":"2024-03-16T17:48:47.763483+0000","last_fullsized":"2024-03-16T17:48:47.763483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:51.477046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.755869+0000","last_change":"2024-03-16T17:48:47.751792+0000","last_active":"2024-03-16T17:48:47.755869+0000","last_peered":"2024-03-16T17:48:47.755869+0000","last_clean":"2024-03-16T17:48:47.755869+0000","last_became_active":"2024-03-16T17:48:47.751548+0000","last_became_peered":"2024-03-16T17:48:47.751548+0000","last_unstale":"2024-03-16T17:48:47.755869+0000","last_undegraded":"2024-03-16T17:48:47.755869+0000","last_fullsized":"2024-03-16T17:48:47.755869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:50:32.529119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.763982+0000","last_change":"2024-03-16T17:48:46.747062+0000","last_active":"2024-03-16T17:48:47.763982+0000","last_peered":"2024-03-16T17:48:47.763982+0000","last_clean":"2024-03-16T17:48:47.763982+0000","last_became_active":"2024-03-16T17:48:46.746778+0000","last_became_peered":"2024-03-16T17:48:46.746778+0000","last_unstale":"2024-03-16T17:48:47.763982+0000","last_undegraded":"2024-03-16T17:48:47.763982+0000","last_fullsized":"2024-03-16T17:48:47.763982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:11:44.232087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761045+0000","last_change":"2024-03-16T17:48:47.753732+0000","last_active":"2024-03-16T17:48:47.761045+0000","last_peered":"2024-03-16T17:48:47.761045+0000","last_clean":"2024-03-16T17:48:47.761045+0000","last_became_active":"2024-03-16T17:48:47.753450+0000","last_became_peered":"2024-03-16T17:48:47.753450+0000","last_unstale":"2024-03-16T17:48:47.761045+0000","last_undegraded":"2024-03-16T17:48:47.761045+0000","last_fullsized":"2024-03-16T17:48:47.761045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:54:46.227936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.738943+0000","last_change":"2024-03-16T17:48:46.746631+0000","last_active":"2024-03-16T17:48:47.738943+0000","last_peered":"2024-03-16T17:48:47.738943+0000","last_clean":"2024-03-16T17:48:47.738943+0000","last_became_active":"2024-03-16T17:48:46.746340+0000","last_became_peered":"2024-03-16T17:48:46.746340+0000","last_unstale":"2024-03-16T17:48:47.738943+0000","last_undegraded":"2024-03-16T17:48:47.738943+0000","last_fullsized":"2024-03-16T17:48:47.738943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:52.623889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765318+0000","last_change":"2024-03-16T17:48:47.758551+0000","last_active":"2024-03-16T17:48:47.765318+0000","last_peered":"2024-03-16T17:48:47.765318+0000","last_clean":"2024-03-16T17:48:47.765318+0000","last_became_active":"2024-03-16T17:48:47.757863+0000","last_became_peered":"2024-03-16T17:48:47.757863+0000","last_unstale":"2024-03-16T17:48:47.765318+0000","last_undegraded":"2024-03-16T17:48:47.765318+0000","last_fullsized":"2024-03-16T17:48:47.765318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:53.625777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.741602+0000","last_change":"2024-03-16T17:48:46.748456+0000","last_active":"2024-03-16T17:48:47.741602+0000","last_peered":"2024-03-16T17:48:47.741602+0000","last_clean":"2024-03-16T17:48:47.741602+0000","last_became_active":"2024-03-16T17:48:46.748192+0000","last_became_peered":"2024-03-16T17:48:46.748192+0000","last_unstale":"2024-03-16T17:48:47.741602+0000","last_undegraded":"2024-03-16T17:48:47.741602+0000","last_fullsized":"2024-03-16T17:48:47.741602+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:35:15.162010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.748579+0000","last_change":"2024-03-16T17:48:47.745207+0000","last_active":"2024-03-16T17:48:47.748579+0000","last_peered":"2024-03-16T17:48:47.748579+0000","last_clean":"2024-03-16T17:48:47.748579+0000","last_became_active":"2024-03-16T17:48:47.744912+0000","last_became_peered":"2024-03-16T17:48:47.744912+0000","last_unstale":"2024-03-16T17:48:47.748579+0000","last_undegraded":"2024-03-16T17:48:47.748579+0000","last_fullsized":"2024-03-16T17:48:47.748579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:57:04.807347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.739312+0000","last_change":"2024-03-16T17:48:46.753447+0000","last_active":"2024-03-16T17:48:47.739312+0000","last_peered":"2024-03-16T17:48:47.739312+0000","last_clean":"2024-03-16T17:48:47.739312+0000","last_became_active":"2024-03-16T17:48:46.753133+0000","last_became_peered":"2024-03-16T17:48:46.753133+0000","last_unstale":"2024-03-16T17:48:47.739312+0000","last_undegraded":"2024-03-16T17:48:47.739312+0000","last_fullsized":"2024-03-16T17:48:47.739312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:57:03.805458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760277+0000","last_change":"2024-03-16T17:48:47.758395+0000","last_active":"2024-03-16T17:48:47.760277+0000","last_peered":"2024-03-16T17:48:47.760277+0000","last_clean":"2024-03-16T17:48:47.760277+0000","last_became_active":"2024-03-16T17:48:47.758128+0000","last_became_peered":"2024-03-16T17:48:47.758128+0000","last_unstale":"2024-03-16T17:48:47.760277+0000","last_undegraded":"2024-03-16T17:48:47.760277+0000","last_fullsized":"2024-03-16T17:48:47.760277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T05:47:36.766165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.743887+0000","last_change":"2024-03-16T17:48:46.748030+0000","last_active":"2024-03-16T17:48:47.743887+0000","last_peered":"2024-03-16T17:48:47.743887+0000","last_clean":"2024-03-16T17:48:47.743887+0000","last_became_active":"2024-03-16T17:48:46.747748+0000","last_became_peered":"2024-03-16T17:48:46.747748+0000","last_unstale":"2024-03-16T17:48:47.743887+0000","last_undegraded":"2024-03-16T17:48:47.743887+0000","last_fullsized":"2024-03-16T17:48:47.743887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:22:21.289056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760266+0000","last_change":"2024-03-16T17:48:47.755541+0000","last_active":"2024-03-16T17:48:47.760266+0000","last_peered":"2024-03-16T17:48:47.760266+0000","last_clean":"2024-03-16T17:48:47.760266+0000","last_became_active":"2024-03-16T17:48:47.755287+0000","last_became_peered":"2024-03-16T17:48:47.755287+0000","last_unstale":"2024-03-16T17:48:47.760266+0000","last_undegraded":"2024-03-16T17:48:47.760266+0000","last_fullsized":"2024-03-16T17:48:47.760266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:36:34.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.763335+0000","last_change":"2024-03-16T17:48:46.752549+0000","last_active":"2024-03-16T17:48:47.763335+0000","last_peered":"2024-03-16T17:48:47.763335+0000","last_clean":"2024-03-16T17:48:47.763335+0000","last_became_active":"2024-03-16T17:48:46.752259+0000","last_became_peered":"2024-03-16T17:48:46.752259+0000","last_unstale":"2024-03-16T17:48:47.763335+0000","last_undegraded":"2024-03-16T17:48:47.763335+0000","last_fullsized":"2024-03-16T17:48:47.763335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:05:10.346433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.764958+0000","last_change":"2024-03-16T17:48:47.759256+0000","last_active":"2024-03-16T17:48:47.764958+0000","last_peered":"2024-03-16T17:48:47.764958+0000","last_clean":"2024-03-16T17:48:47.764958+0000","last_became_active":"2024-03-16T17:48:47.758965+0000","last_became_peered":"2024-03-16T17:48:47.758965+0000","last_unstale":"2024-03-16T17:48:47.764958+0000","last_undegraded":"2024-03-16T17:48:47.764958+0000","last_fullsized":"2024-03-16T17:48:47.764958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:36:34.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.771138+0000","last_change":"2024-03-16T17:48:46.761425+0000","last_active":"2024-03-16T17:48:47.771138+0000","last_peered":"2024-03-16T17:48:47.771138+0000","last_clean":"2024-03-16T17:48:47.771138+0000","last_became_active":"2024-03-16T17:48:46.761149+0000","last_became_peered":"2024-03-16T17:48:46.761149+0000","last_unstale":"2024-03-16T17:48:47.771138+0000","last_undegraded":"2024-03-16T17:48:47.771138+0000","last_fullsized":"2024-03-16T17:48:47.771138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:33:46.932678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765266+0000","last_change":"2024-03-16T17:48:47.758184+0000","last_active":"2024-03-16T17:48:47.765266+0000","last_peered":"2024-03-16T17:48:47.765266+0000","last_clean":"2024-03-16T17:48:47.765266+0000","last_became_active":"2024-03-16T17:48:47.757904+0000","last_became_peered":"2024-03-16T17:48:47.757904+0000","last_unstale":"2024-03-16T17:48:47.765266+0000","last_undegraded":"2024-03-16T17:48:47.765266+0000","last_fullsized":"2024-03-16T17:48:47.765266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:47:46.904782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.759515+0000","last_change":"2024-03-16T17:48:46.748503+0000","last_active":"2024-03-16T17:48:47.759515+0000","last_peered":"2024-03-16T17:48:47.759515+0000","last_clean":"2024-03-16T17:48:47.759515+0000","last_became_active":"2024-03-16T17:48:46.748234+0000","last_became_peered":"2024-03-16T17:48:46.748234+0000","last_unstale":"2024-03-16T17:48:47.759515+0000","last_undegraded":"2024-03-16T17:48:47.759515+0000","last_fullsized":"2024-03-16T17:48:47.759515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:49:25.663616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.759555+0000","last_change":"2024-03-16T17:48:47.753323+0000","last_active":"2024-03-16T17:48:47.759555+0000","last_peered":"2024-03-16T17:48:47.759555+0000","last_clean":"2024-03-16T17:48:47.759555+0000","last_became_active":"2024-03-16T17:48:47.753012+0000","last_became_peered":"2024-03-16T17:48:47.753012+0000","last_unstale":"2024-03-16T17:48:47.759555+0000","last_undegraded":"2024-03-16T17:48:47.759555+0000","last_fullsized":"2024-03-16T17:48:47.759555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:16:52.714825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.748145+0000","last_change":"2024-03-16T17:48:46.752371+0000","last_active":"2024-03-16T17:48:47.748145+0000","last_peered":"2024-03-16T17:48:47.748145+0000","last_clean":"2024-03-16T17:48:47.748145+0000","last_became_active":"2024-03-16T17:48:46.752116+0000","last_became_peered":"2024-03-16T17:48:46.752116+0000","last_unstale":"2024-03-16T17:48:47.748145+0000","last_undegraded":"2024-03-16T17:48:47.748145+0000","last_fullsized":"2024-03-16T17:48:47.748145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T23:22:21.289056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767564+0000","last_change":"2024-03-16T17:48:47.764441+0000","last_active":"2024-03-16T17:48:47.767564+0000","last_peered":"2024-03-16T17:48:47.767564+0000","last_clean":"2024-03-16T17:48:47.767564+0000","last_became_active":"2024-03-16T17:48:47.763885+0000","last_became_peered":"2024-03-16T17:48:47.763885+0000","last_unstale":"2024-03-16T17:48:47.767564+0000","last_undegraded":"2024-03-16T17:48:47.767564+0000","last_fullsized":"2024-03-16T17:48:47.767564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:16:52.714825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.738853+0000","last_change":"2024-03-16T17:48:46.753503+0000","last_active":"2024-03-16T17:48:47.738853+0000","last_peered":"2024-03-16T17:48:47.738853+0000","last_clean":"2024-03-16T17:48:47.738853+0000","last_became_active":"2024-03-16T17:48:46.753195+0000","last_became_peered":"2024-03-16T17:48:46.753195+0000","last_unstale":"2024-03-16T17:48:47.738853+0000","last_undegraded":"2024-03-16T17:48:47.738853+0000","last_fullsized":"2024-03-16T17:48:47.738853+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:47:45.902894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767671+0000","last_change":"2024-03-16T17:48:47.763637+0000","last_active":"2024-03-16T17:48:47.767671+0000","last_peered":"2024-03-16T17:48:47.767671+0000","last_clean":"2024-03-16T17:48:47.767671+0000","last_became_active":"2024-03-16T17:48:47.763224+0000","last_became_peered":"2024-03-16T17:48:47.763224+0000","last_unstale":"2024-03-16T17:48:47.767671+0000","last_undegraded":"2024-03-16T17:48:47.767671+0000","last_fullsized":"2024-03-16T17:48:47.767671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:31.873813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.767147+0000","last_change":"2024-03-16T17:48:46.752329+0000","last_active":"2024-03-16T17:48:47.767147+0000","last_peered":"2024-03-16T17:48:47.767147+0000","last_clean":"2024-03-16T17:48:47.767147+0000","last_became_active":"2024-03-16T17:48:46.752063+0000","last_became_peered":"2024-03-16T17:48:46.752063+0000","last_unstale":"2024-03-16T17:48:47.767147+0000","last_undegraded":"2024-03-16T17:48:47.767147+0000","last_fullsized":"2024-03-16T17:48:47.767147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:30.871924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761000+0000","last_change":"2024-03-16T17:48:47.754963+0000","last_active":"2024-03-16T17:48:47.761000+0000","last_peered":"2024-03-16T17:48:47.761000+0000","last_clean":"2024-03-16T17:48:47.761000+0000","last_became_active":"2024-03-16T17:48:47.754338+0000","last_became_peered":"2024-03-16T17:48:47.754338+0000","last_unstale":"2024-03-16T17:48:47.761000+0000","last_undegraded":"2024-03-16T17:48:47.761000+0000","last_fullsized":"2024-03-16T17:48:47.761000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:03:47.483043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.756396+0000","last_change":"2024-03-16T17:48:46.752541+0000","last_active":"2024-03-16T17:48:47.756396+0000","last_peered":"2024-03-16T17:48:47.756396+0000","last_clean":"2024-03-16T17:48:47.756396+0000","last_became_active":"2024-03-16T17:48:46.752255+0000","last_became_peered":"2024-03-16T17:48:46.752255+0000","last_unstale":"2024-03-16T17:48:47.756396+0000","last_undegraded":"2024-03-16T17:48:47.756396+0000","last_fullsized":"2024-03-16T17:48:47.756396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:44:02.938760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761980+0000","last_change":"2024-03-16T17:48:47.756562+0000","last_active":"2024-03-16T17:48:47.761980+0000","last_peered":"2024-03-16T17:48:47.761980+0000","last_clean":"2024-03-16T17:48:47.761980+0000","last_became_active":"2024-03-16T17:48:47.756247+0000","last_became_peered":"2024-03-16T17:48:47.756247+0000","last_unstale":"2024-03-16T17:48:47.761980+0000","last_undegraded":"2024-03-16T17:48:47.761980+0000","last_fullsized":"2024-03-16T17:48:47.761980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T21:19:53.998029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.759341+0000","last_change":"2024-03-16T17:48:46.748961+0000","last_active":"2024-03-16T17:48:47.759341+0000","last_peered":"2024-03-16T17:48:47.759341+0000","last_clean":"2024-03-16T17:48:47.759341+0000","last_became_active":"2024-03-16T17:48:46.748717+0000","last_became_peered":"2024-03-16T17:48:46.748717+0000","last_unstale":"2024-03-16T17:48:47.759341+0000","last_undegraded":"2024-03-16T17:48:47.759341+0000","last_fullsized":"2024-03-16T17:48:47.759341+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:36:43.072042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765485+0000","last_change":"2024-03-16T17:48:47.760475+0000","last_active":"2024-03-16T17:48:47.765485+0000","last_peered":"2024-03-16T17:48:47.765485+0000","last_clean":"2024-03-16T17:48:47.765485+0000","last_became_active":"2024-03-16T17:48:47.758023+0000","last_became_peered":"2024-03-16T17:48:47.758023+0000","last_unstale":"2024-03-16T17:48:47.765485+0000","last_undegraded":"2024-03-16T17:48:47.765485+0000","last_fullsized":"2024-03-16T17:48:47.765485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:57:04.807347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760685+0000","last_change":"2024-03-16T17:48:46.744778+0000","last_active":"2024-03-16T17:48:47.760685+0000","last_peered":"2024-03-16T17:48:47.760685+0000","last_clean":"2024-03-16T17:48:47.760685+0000","last_became_active":"2024-03-16T17:48:46.744486+0000","last_became_peered":"2024-03-16T17:48:46.744486+0000","last_unstale":"2024-03-16T17:48:47.760685+0000","last_undegraded":"2024-03-16T17:48:47.760685+0000","last_fullsized":"2024-03-16T17:48:47.760685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:23:36.395336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.758294+0000","last_change":"2024-03-16T17:48:47.752271+0000","last_active":"2024-03-16T17:48:47.758294+0000","last_peered":"2024-03-16T17:48:47.758294+0000","last_clean":"2024-03-16T17:48:47.758294+0000","last_became_active":"2024-03-16T17:48:47.751846+0000","last_became_peered":"2024-03-16T17:48:47.751846+0000","last_unstale":"2024-03-16T17:48:47.758294+0000","last_undegraded":"2024-03-16T17:48:47.758294+0000","last_fullsized":"2024-03-16T17:48:47.758294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:46:01.680221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.742128+0000","last_change":"2024-03-16T17:48:46.750805+0000","last_active":"2024-03-16T17:48:47.742128+0000","last_peered":"2024-03-16T17:48:47.742128+0000","last_clean":"2024-03-16T17:48:47.742128+0000","last_became_active":"2024-03-16T17:48:46.750499+0000","last_became_peered":"2024-03-16T17:48:46.750499+0000","last_unstale":"2024-03-16T17:48:47.742128+0000","last_undegraded":"2024-03-16T17:48:47.742128+0000","last_fullsized":"2024-03-16T17:48:47.742128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T02:38:10.324469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760050+0000","last_change":"2024-03-16T17:48:47.754119+0000","last_active":"2024-03-16T17:48:47.760050+0000","last_peered":"2024-03-16T17:48:47.760050+0000","last_clean":"2024-03-16T17:48:47.760050+0000","last_became_active":"2024-03-16T17:48:47.753647+0000","last_became_peered":"2024-03-16T17:48:47.753647+0000","last_unstale":"2024-03-16T17:48:47.760050+0000","last_undegraded":"2024-03-16T17:48:47.760050+0000","last_fullsized":"2024-03-16T17:48:47.760050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:09:05.555135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.758091+0000","last_change":"2024-03-16T17:48:46.752633+0000","last_active":"2024-03-16T17:48:47.758091+0000","last_peered":"2024-03-16T17:48:47.758091+0000","last_clean":"2024-03-16T17:48:47.758091+0000","last_became_active":"2024-03-16T17:48:46.752373+0000","last_became_peered":"2024-03-16T17:48:46.752373+0000","last_unstale":"2024-03-16T17:48:47.758091+0000","last_undegraded":"2024-03-16T17:48:47.758091+0000","last_fullsized":"2024-03-16T17:48:47.758091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:44:02.938760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760086+0000","last_change":"2024-03-16T17:48:47.753138+0000","last_active":"2024-03-16T17:48:47.760086+0000","last_peered":"2024-03-16T17:48:47.760086+0000","last_clean":"2024-03-16T17:48:47.760086+0000","last_became_active":"2024-03-16T17:48:47.752107+0000","last_became_peered":"2024-03-16T17:48:47.752107+0000","last_unstale":"2024-03-16T17:48:47.760086+0000","last_undegraded":"2024-03-16T17:48:47.760086+0000","last_fullsized":"2024-03-16T17:48:47.760086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:35:31.397771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.748751+0000","last_change":"2024-03-16T17:48:46.758497+0000","last_active":"2024-03-16T17:48:47.748751+0000","last_peered":"2024-03-16T17:48:47.748751+0000","last_clean":"2024-03-16T17:48:47.748751+0000","last_became_active":"2024-03-16T17:48:46.758255+0000","last_became_peered":"2024-03-16T17:48:46.758255+0000","last_unstale":"2024-03-16T17:48:47.748751+0000","last_undegraded":"2024-03-16T17:48:47.748751+0000","last_fullsized":"2024-03-16T17:48:47.748751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T22:36:43.072042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.759874+0000","last_change":"2024-03-16T17:48:47.752182+0000","last_active":"2024-03-16T17:48:47.759874+0000","last_peered":"2024-03-16T17:48:47.759874+0000","last_clean":"2024-03-16T17:48:47.759874+0000","last_became_active":"2024-03-16T17:48:47.751815+0000","last_became_peered":"2024-03-16T17:48:47.751815+0000","last_unstale":"2024-03-16T17:48:47.759874+0000","last_undegraded":"2024-03-16T17:48:47.759874+0000","last_fullsized":"2024-03-16T17:48:47.759874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:05:27.275899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.741785+0000","last_change":"2024-03-16T17:48:46.752540+0000","last_active":"2024-03-16T17:48:47.741785+0000","last_peered":"2024-03-16T17:48:47.741785+0000","last_clean":"2024-03-16T17:48:47.741785+0000","last_became_active":"2024-03-16T17:48:46.752219+0000","last_became_peered":"2024-03-16T17:48:46.752219+0000","last_unstale":"2024-03-16T17:48:47.741785+0000","last_undegraded":"2024-03-16T17:48:47.741785+0000","last_fullsized":"2024-03-16T17:48:47.741785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T17:54:29.071912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.761879+0000","last_change":"2024-03-16T17:48:47.758700+0000","last_active":"2024-03-16T17:48:47.761879+0000","last_peered":"2024-03-16T17:48:47.761879+0000","last_clean":"2024-03-16T17:48:47.761879+0000","last_became_active":"2024-03-16T17:48:47.758428+0000","last_became_peered":"2024-03-16T17:48:47.758428+0000","last_unstale":"2024-03-16T17:48:47.761879+0000","last_undegraded":"2024-03-16T17:48:47.761879+0000","last_fullsized":"2024-03-16T17:48:47.761879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:53.625777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.739872+0000","last_change":"2024-03-16T17:48:46.752681+0000","last_active":"2024-03-16T17:48:47.739872+0000","last_peered":"2024-03-16T17:48:47.739872+0000","last_clean":"2024-03-16T17:48:47.739872+0000","last_became_active":"2024-03-16T17:48:46.752425+0000","last_became_peered":"2024-03-16T17:48:46.752425+0000","last_unstale":"2024-03-16T17:48:47.739872+0000","last_undegraded":"2024-03-16T17:48:47.739872+0000","last_fullsized":"2024-03-16T17:48:47.739872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:52.623889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.760008+0000","last_change":"2024-03-16T17:48:47.754824+0000","last_active":"2024-03-16T17:48:47.760008+0000","last_peered":"2024-03-16T17:48:47.760008+0000","last_clean":"2024-03-16T17:48:47.760008+0000","last_became_active":"2024-03-16T17:48:47.754430+0000","last_became_peered":"2024-03-16T17:48:47.754430+0000","last_unstale":"2024-03-16T17:48:47.760008+0000","last_undegraded":"2024-03-16T17:48:47.760008+0000","last_fullsized":"2024-03-16T17:48:47.760008+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:44.340858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.763300+0000","last_change":"2024-03-16T17:48:46.751910+0000","last_active":"2024-03-16T17:48:47.763300+0000","last_peered":"2024-03-16T17:48:47.763300+0000","last_clean":"2024-03-16T17:48:47.763300+0000","last_became_active":"2024-03-16T17:48:46.751620+0000","last_became_peered":"2024-03-16T17:48:46.751620+0000","last_unstale":"2024-03-16T17:48:47.763300+0000","last_undegraded":"2024-03-16T17:48:47.763300+0000","last_fullsized":"2024-03-16T17:48:47.763300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:24:30.871924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.765073+0000","last_change":"2024-03-16T17:48:47.759664+0000","last_active":"2024-03-16T17:48:47.765073+0000","last_peered":"2024-03-16T17:48:47.765073+0000","last_clean":"2024-03-16T17:48:47.765073+0000","last_became_active":"2024-03-16T17:48:47.759372+0000","last_became_peered":"2024-03-16T17:48:47.759372+0000","last_unstale":"2024-03-16T17:48:47.765073+0000","last_undegraded":"2024-03-16T17:48:47.765073+0000","last_fullsized":"2024-03-16T17:48:47.765073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:14:07.669072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.744034+0000","last_change":"2024-03-16T17:48:46.758003+0000","last_active":"2024-03-16T17:48:47.744034+0000","last_peered":"2024-03-16T17:48:47.744034+0000","last_clean":"2024-03-16T17:48:47.744034+0000","last_became_active":"2024-03-16T17:48:46.757716+0000","last_became_peered":"2024-03-16T17:48:46.757716+0000","last_unstale":"2024-03-16T17:48:47.744034+0000","last_undegraded":"2024-03-16T17:48:47.744034+0000","last_fullsized":"2024-03-16T17:48:47.744034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:54:45.226047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762767+0000","last_change":"2024-03-16T17:48:47.758672+0000","last_active":"2024-03-16T17:48:47.762767+0000","last_peered":"2024-03-16T17:48:47.762767+0000","last_clean":"2024-03-16T17:48:47.762767+0000","last_became_active":"2024-03-16T17:48:47.758411+0000","last_became_peered":"2024-03-16T17:48:47.758411+0000","last_unstale":"2024-03-16T17:48:47.762767+0000","last_undegraded":"2024-03-16T17:48:47.762767+0000","last_fullsized":"2024-03-16T17:48:47.762767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:53.625777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.748501+0000","last_change":"2024-03-16T17:48:46.757828+0000","last_active":"2024-03-16T17:48:47.748501+0000","last_peered":"2024-03-16T17:48:47.748501+0000","last_clean":"2024-03-16T17:48:47.748501+0000","last_became_active":"2024-03-16T17:48:46.757556+0000","last_became_peered":"2024-03-16T17:48:46.757556+0000","last_unstale":"2024-03-16T17:48:47.748501+0000","last_undegraded":"2024-03-16T17:48:47.748501+0000","last_fullsized":"2024-03-16T17:48:47.748501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:03:46.481155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.758840+0000","last_change":"2024-03-16T17:48:47.757594+0000","last_active":"2024-03-16T17:48:47.758840+0000","last_peered":"2024-03-16T17:48:47.758840+0000","last_clean":"2024-03-16T17:48:47.758840+0000","last_became_active":"2024-03-16T17:48:47.757233+0000","last_became_peered":"2024-03-16T17:48:47.757233+0000","last_unstale":"2024-03-16T17:48:47.758840+0000","last_undegraded":"2024-03-16T17:48:47.758840+0000","last_fullsized":"2024-03-16T17:48:47.758840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:44:03.940649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.744983+0000","last_change":"2024-03-16T17:48:46.747638+0000","last_active":"2024-03-16T17:48:47.744983+0000","last_peered":"2024-03-16T17:48:47.744983+0000","last_clean":"2024-03-16T17:48:47.744983+0000","last_became_active":"2024-03-16T17:48:46.747386+0000","last_became_peered":"2024-03-16T17:48:46.747386+0000","last_unstale":"2024-03-16T17:48:47.744983+0000","last_undegraded":"2024-03-16T17:48:47.744983+0000","last_fullsized":"2024-03-16T17:48:47.744983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T03:03:46.481155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.757156+0000","last_change":"2024-03-16T17:48:47.750636+0000","last_active":"2024-03-16T17:48:47.757156+0000","last_peered":"2024-03-16T17:48:47.757156+0000","last_clean":"2024-03-16T17:48:47.757156+0000","last_became_active":"2024-03-16T17:48:47.750316+0000","last_became_peered":"2024-03-16T17:48:47.750316+0000","last_unstale":"2024-03-16T17:48:47.757156+0000","last_undegraded":"2024-03-16T17:48:47.757156+0000","last_fullsized":"2024-03-16T17:48:47.757156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:13:30.548232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.748170+0000","last_change":"2024-03-16T17:48:46.757818+0000","last_active":"2024-03-16T17:48:47.748170+0000","last_peered":"2024-03-16T17:48:47.748170+0000","last_clean":"2024-03-16T17:48:47.748170+0000","last_became_active":"2024-03-16T17:48:46.757541+0000","last_became_peered":"2024-03-16T17:48:46.757541+0000","last_unstale":"2024-03-16T17:48:47.748170+0000","last_undegraded":"2024-03-16T17:48:47.748170+0000","last_fullsized":"2024-03-16T17:48:47.748170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T18:54:45.226047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762997+0000","last_change":"2024-03-16T17:48:47.754820+0000","last_active":"2024-03-16T17:48:47.762997+0000","last_peered":"2024-03-16T17:48:47.762997+0000","last_clean":"2024-03-16T17:48:47.762997+0000","last_became_active":"2024-03-16T17:48:47.754555+0000","last_became_peered":"2024-03-16T17:48:47.754555+0000","last_unstale":"2024-03-16T17:48:47.762997+0000","last_undegraded":"2024-03-16T17:48:47.762997+0000","last_fullsized":"2024-03-16T17:48:47.762997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T01:27:17.403221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.741783+0000","last_change":"2024-03-16T17:48:46.749143+0000","last_active":"2024-03-16T17:48:47.741783+0000","last_peered":"2024-03-16T17:48:47.741783+0000","last_clean":"2024-03-16T17:48:47.741783+0000","last_became_active":"2024-03-16T17:48:46.748892+0000","last_became_peered":"2024-03-16T17:48:46.748892+0000","last_unstale":"2024-03-16T17:48:47.741783+0000","last_undegraded":"2024-03-16T17:48:47.741783+0000","last_fullsized":"2024-03-16T17:48:47.741783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:35:43.338969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.762869+0000","last_change":"2024-03-16T17:48:47.759076+0000","last_active":"2024-03-16T17:48:47.762869+0000","last_peered":"2024-03-16T17:48:47.762869+0000","last_clean":"2024-03-16T17:48:47.762869+0000","last_became_active":"2024-03-16T17:48:47.758003+0000","last_became_peered":"2024-03-16T17:48:47.758003+0000","last_unstale":"2024-03-16T17:48:47.762869+0000","last_undegraded":"2024-03-16T17:48:47.762869+0000","last_fullsized":"2024-03-16T17:48:47.762869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T20:49:53.625777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.738399+0000","last_change":"2024-03-16T17:48:46.755077+0000","last_active":"2024-03-16T17:48:47.738399+0000","last_peered":"2024-03-16T17:48:47.738399+0000","last_clean":"2024-03-16T17:48:47.738399+0000","last_became_active":"2024-03-16T17:48:46.754889+0000","last_became_peered":"2024-03-16T17:48:46.754889+0000","last_unstale":"2024-03-16T17:48:47.738399+0000","last_undegraded":"2024-03-16T17:48:47.738399+0000","last_fullsized":"2024-03-16T17:48:47.738399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T00:13:29.546344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.764869+0000","last_change":"2024-03-16T17:48:47.761175+0000","last_active":"2024-03-16T17:48:47.764869+0000","last_peered":"2024-03-16T17:48:47.764869+0000","last_clean":"2024-03-16T17:48:47.764869+0000","last_became_active":"2024-03-16T17:48:47.760912+0000","last_became_peered":"2024-03-16T17:48:47.760912+0000","last_unstale":"2024-03-16T17:48:47.764869+0000","last_undegraded":"2024-03-16T17:48:47.764869+0000","last_fullsized":"2024-03-16T17:48:47.764869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:46.725974+0000","last_clean_scrub_stamp":"2024-03-16T17:48:46.725974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:50:32.529119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.745374+0000","last_change":"2024-03-16T17:48:46.748196+0000","last_active":"2024-03-16T17:48:47.745374+0000","last_peered":"2024-03-16T17:48:47.745374+0000","last_clean":"2024-03-16T17:48:47.745374+0000","last_became_active":"2024-03-16T17:48:46.747862+0000","last_became_peered":"2024-03-16T17:48:46.747862+0000","last_unstale":"2024-03-16T17:48:47.745374+0000","last_undegraded":"2024-03-16T17:48:47.745374+0000","last_fullsized":"2024-03-16T17:48:47.745374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:48:45.724086+0000","last_clean_scrub_stamp":"2024-03-16T17:48:45.724086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-17T19:11:44.232087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-16T17:48:47.750063+0000","last_change":"2024-03-16T17:47:39.177353+0000","last_active":"2024-03-16T17:48:47.750063+0000","last_peered":"2024-03-16T17:48:47.750063+0000","last_clean":"2024-03-16T17:48:47.750063+0000","last_became_active":"2024-03-16T17:47:39.176109+0000","last_became_peered":"2024-03-16T17:47:39.176109+0000","last_unstale":"2024-03-16T17:48:47.750063+0000","last_undegraded":"2024-03-16T17:48:47.750063+0000","last_fullsized":"2024-03-16T17:48:47.750063+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-16T17:47:37.885590+0000","last_clean_scrub_stamp":"2024-03-16T17:47:37.885590+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-18T04:31:47.704856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":132909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":132909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":132909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":132909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":132909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":141318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":723277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-16T17:48:51.081 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-16T17:48:51.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-16T17:48:51.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.222+0000 7fc43169d640 1 Processor -- start 2024-03-16T17:48:51.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.222+0000 7fc43169d640 1 -- start start 2024-03-16T17:48:51.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.223+0000 7fc43169d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc42c0cda20 0x7fc42c06bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.223+0000 7fc43169d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c06c430 0x7fc42c06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.223+0000 7fc43169d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42c06c880 con 0x7fc42c15bcd0 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.223+0000 7fc43169d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc42c0ce000 con 0x7fc42c0cda20 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.223+0000 7fc43169d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c0ce2e0 con 0x7fc42c06c430 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.223+0000 7fc42b7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c06c430 0x7fc42c06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.223+0000 7fc42b7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c06c430 0x7fc42c06d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:55200/0 (socket says 172.21.15.132:55200) 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.223+0000 7fc42b7fe640 1 -- 172.21.15.132:0/3655167644 learned_addr learned my addr 172.21.15.132:0/3655167644 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.223+0000 7fc423fff640 1 --2- 172.21.15.132:0/3655167644 >> v2:172.21.15.194:3300/0 conn(0x7fc42c0cda20 0x7fc42c06bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.224+0000 7fc423fff640 1 -- 172.21.15.132:0/3655167644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c06c430 msgr2=0x7fc42c06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.224+0000 7fc423fff640 1 --2- 172.21.15.132:0/3655167644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c06c430 0x7fc42c06d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.224+0000 7fc423fff640 1 -- 172.21.15.132:0/3655167644 >> v1:172.21.15.194:6789/0 conn(0x7fc42c15bcd0 legacy=0x7fc42c0cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.224+0000 7fc423fff640 1 -- 172.21.15.132:0/3655167644 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c0ce5c0 con 0x7fc42c0cda20 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.224+0000 7fc42a7fc640 1 -- 172.21.15.132:0/3655167644 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500517660 0 0) 0x7fc41c001110 con 0x7fc42c15bcd0 2024-03-16T17:48:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.224+0000 7fc42b7fe640 1 --2- 172.21.15.132:0/3655167644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c06c430 0x7fc42c06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc423fff640 1 --2- 172.21.15.132:0/3655167644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c0cda20 0x7fc42c06bef0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4140097a0 tx=0x7fc41402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eb9e755231f1764 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc42a7fc640 1 -- 172.21.15.132:0/3655167644 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41402e070 con 0x7fc42c0cda20 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc42a7fc640 1 -- 172.21.15.132:0/3655167644 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4140315a0 con 0x7fc42c0cda20 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc42a7fc640 1 -- 172.21.15.132:0/3655167644 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414031930 con 0x7fc42c0cda20 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc43169d640 1 -- 172.21.15.132:0/3655167644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c0cda20 msgr2=0x7fc42c06bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc43169d640 1 --2- 172.21.15.132:0/3655167644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c0cda20 0x7fc42c06bef0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4140097a0 tx=0x7fc41402b840 comp rx=0 tx=0).stop 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc43169d640 1 -- 172.21.15.132:0/3655167644 shutdown_connections 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc43169d640 1 --2- 172.21.15.132:0/3655167644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c06c430 0x7fc42c06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc43169d640 1 --2- 172.21.15.132:0/3655167644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c0cda20 0x7fc42c06bef0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc43169d640 1 -- 172.21.15.132:0/3655167644 >> 172.21.15.132:0/3655167644 conn(0x7fc42c071470 msgr2=0x7fc42c071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc43169d640 1 -- 172.21.15.132:0/3655167644 shutdown_connections 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.225+0000 7fc43169d640 1 -- 172.21.15.132:0/3655167644 wait complete. 2024-03-16T17:48:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.226+0000 7fc43169d640 1 Processor -- start 2024-03-16T17:48:51.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.226+0000 7fc43169d640 1 -- start start 2024-03-16T17:48:51.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc43169d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc42c06c430 0x7fc42c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc43169d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c0cda20 0x7fc42c159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc43169d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c15bcd0 0x7fc42c15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc43169d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c14b6e0 con 0x7fc42c06c430 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc43169d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c158080 con 0x7fc42c0cda20 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc43169d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c157da0 con 0x7fc42c15bcd0 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc42affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc42c06c430 0x7fc42c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc42affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc42c06c430 0x7fc42c14b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37862/0 (socket says 172.21.15.132:37862) 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc42affd640 1 -- 172.21.15.132:0/1595593239 learned_addr learned my addr 172.21.15.132:0/1595593239 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc423fff640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c0cda20 0x7fc42c159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.227+0000 7fc42b7fe640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c15bcd0 0x7fc42c15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc42affd640 1 -- 172.21.15.132:0/1595593239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c15bcd0 msgr2=0x7fc42c15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc42affd640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c15bcd0 0x7fc42c15a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc42affd640 1 -- 172.21.15.132:0/1595593239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c0cda20 msgr2=0x7fc42c159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc42affd640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c0cda20 0x7fc42c159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc42affd640 1 -- 172.21.15.132:0/1595593239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc424009b30 con 0x7fc42c06c430 2024-03-16T17:48:51.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc42affd640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc42c06c430 0x7fc42c14b1a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00c750 tx=0x7fc41c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:51.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc4237fe640 1 -- 172.21.15.132:0/1595593239 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c005270 con 0x7fc42c06c430 2024-03-16T17:48:51.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc4237fe640 1 -- 172.21.15.132:0/1595593239 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41c0053f0 con 0x7fc42c06c430 2024-03-16T17:48:51.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc43169d640 1 -- 172.21.15.132:0/1595593239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc414009400 con 0x7fc42c06c430 2024-03-16T17:48:51.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc4237fe640 1 -- 172.21.15.132:0/1595593239 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00a880 con 0x7fc42c06c430 2024-03-16T17:48:51.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.228+0000 7fc43169d640 1 -- 172.21.15.132:0/1595593239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42c15c230 con 0x7fc42c06c430 2024-03-16T17:48:51.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.229+0000 7fc43169d640 1 -- 172.21.15.132:0/1595593239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42c068450 con 0x7fc42c06c430 2024-03-16T17:48:51.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.229+0000 7fc4237fe640 1 -- 172.21.15.132:0/1595593239 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fc41c00a9e0 con 0x7fc42c06c430 2024-03-16T17:48:51.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.230+0000 7fc4237fe640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40c06b3b0 0x7fc40c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.230+0000 7fc4237fe640 1 -- 172.21.15.132:0/1595593239 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc41c088f20 con 0x7fc42c06c430 2024-03-16T17:48:51.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.230+0000 7fc423fff640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40c06b3b0 0x7fc40c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.230+0000 7fc423fff640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40c06b3b0 0x7fc40c06d870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc414036000 tx=0x7fc41403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.234+0000 7fc4237fe640 1 -- 172.21.15.132:0/1595593239 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc41c053cc0 con 0x7fc42c06c430 2024-03-16T17:48:51.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.474+0000 7fc43169d640 1 -- 172.21.15.132:0/1595593239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc42c06c880 con 0x7fc42c06c430 2024-03-16T17:48:51.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.476+0000 7fc4237fe640 1 -- 172.21.15.132:0/1595593239 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc42c06c880 con 0x7fc42c06c430 2024-03-16T17:48:51.480 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2024-03-16T17:48:51.480 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAH2/VlI+SXDhAAVkJdiLaLBWETaZXg7PjHcA== 2024-03-16T17:48:51.481 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow" 2024-03-16T17:48:51.481 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow r" 2024-03-16T17:48:51.481 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-16T17:48:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 -- 172.21.15.132:0/1595593239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40c06b3b0 msgr2=0x7fc40c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40c06b3b0 0x7fc40c06d870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc414036000 tx=0x7fc41403d040 comp rx=0 tx=0).stop 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 -- 172.21.15.132:0/1595593239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc42c06c430 msgr2=0x7fc42c14b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc42c06c430 0x7fc42c14b1a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00c750 tx=0x7fc41c00cc10 comp rx=0 tx=0).stop 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 -- 172.21.15.132:0/1595593239 shutdown_connections 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fc40c06b3b0 0x7fc40c06d870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc42c15bcd0 0x7fc42c15a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc42c0cda20 0x7fc42c159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 --2- 172.21.15.132:0/1595593239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc42c06c430 0x7fc42c14b1a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 -- 172.21.15.132:0/1595593239 >> 172.21.15.132:0/1595593239 conn(0x7fc42c071470 msgr2=0x7fc42c06d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 -- 172.21.15.132:0/1595593239 shutdown_connections 2024-03-16T17:48:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.479+0000 7fc43169d640 1 -- 172.21.15.132:0/1595593239 wait complete. 2024-03-16T17:48:51.493 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-16T17:48:51.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.590+0000 7f1730015640 1 Processor -- start 2024-03-16T17:48:51.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.590+0000 7f1730015640 1 -- start start 2024-03-16T17:48:51.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f1730015640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1728151470 0x7f17280729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f1730015640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172815b670 con 0x7f172806dba0 2024-03-16T17:48:51.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f1730015640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280b2ff0 con 0x7f17280b2bb0 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f1730015640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172815ad40 con 0x7f1728151470 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172e5b2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f172806dba0 0x7f1728070ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47696/0 (socket says 172.21.15.132:47696) 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172e5b2640 1 -- 172.21.15.132:0/3162060513 learned_addr learned my addr 172.21.15.132:0/3162060513 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841213700 0 0) 0x7f172815b670 con 0x7f172806dba0 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172ddb1640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1728151470 0x7f17280729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1714004630 con 0x7f172806dba0 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 865535189 0 0) 0x7f1714004630 con 0x7f172806dba0 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1728151470 msgr2=0x7f17280729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172cdaf640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1728151470 0x7f17280729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 >> v1:172.21.15.194:6789/0 conn(0x7f17280b2bb0 legacy=0x7f172806d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172815b020 con 0x7f172806dba0 2024-03-16T17:48:51.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7f17200019f0 con 0x7f172806dba0 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.591+0000 7f172ddb1640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1728151470 0x7f17280729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 >> v1:172.21.15.132:6789/0 conn(0x7f172806dba0 legacy=0x7f1728070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172cdaf640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1728151470 0x7f1714004ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172cdaf640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17140050a0 0x7f17140058d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172cdaf640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1714005e10 0x7f1714006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172815ad40 con 0x7f1714005e10 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171400cbf0 con 0x7f17140050a0 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171400cdb0 con 0x7f1728151470 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172e5b2640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1714005e10 0x7f1714006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172ddb1640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1728151470 0x7f1714004ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172d5b0640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17140050a0 0x7f17140058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172e5b2640 1 -- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1728151470 msgr2=0x7f1714004ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172e5b2640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1728151470 0x7f1714004ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172e5b2640 1 -- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17140050a0 msgr2=0x7f17140058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172e5b2640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17140050a0 0x7f17140058d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.592+0000 7f172e5b2640 1 -- 172.21.15.132:0/3162060513 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1714004630 con 0x7f1714005e10 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.593+0000 7f172e5b2640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1714005e10 0x7f1714006290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f172000a830 tx=0x7f1714006900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c9fe4a8183f4ef server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.593+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200072d0 con 0x7f1714005e10 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.593+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172002f070 con 0x7f1714005e10 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.593+0000 7f172cdaf640 1 -- 172.21.15.132:0/3162060513 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200076f0 con 0x7f1714005e10 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.593+0000 7f1730015640 1 -- 172.21.15.132:0/3162060513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1714005e10 msgr2=0x7f1714006290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.593+0000 7f1730015640 1 --2- 172.21.15.132:0/3162060513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1714005e10 0x7f1714006290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f172000a830 tx=0x7f1714006900 comp rx=0 tx=0).stop 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.593+0000 7f172e5b2640 1 -- 172.21.15.132:0/3162060513 reap_dead start 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.593+0000 7f1730015640 1 -- 172.21.15.132:0/3162060513 shutdown_connections 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.593+0000 7f1730015640 1 -- 172.21.15.132:0/3162060513 >> 172.21.15.132:0/3162060513 conn(0x7f172806aee0 msgr2=0x7f172806b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.594+0000 7f1730015640 1 -- 172.21.15.132:0/3162060513 shutdown_connections 2024-03-16T17:48:51.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.594+0000 7f1730015640 1 -- 172.21.15.132:0/3162060513 wait complete. 2024-03-16T17:48:51.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.595+0000 7f1730015640 1 Processor -- start 2024-03-16T17:48:51.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.595+0000 7f1730015640 1 -- start start 2024-03-16T17:48:51.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f1730015640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172813cd20 0x7f1728147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f1730015640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1728148e50 0x7f17281492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f1730015640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17281f52d0 0x7f17281f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f1730015640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1728149810 con 0x7f172813cd20 2024-03-16T17:48:51.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f1730015640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17281f6040 con 0x7f1728148e50 2024-03-16T17:48:51.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f1730015640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1728147080 con 0x7f17281f52d0 2024-03-16T17:48:51.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172ddb1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172813cd20 0x7f1728147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172ddb1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172813cd20 0x7f1728147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37884/0 (socket says 172.21.15.132:37884) 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172ddb1640 1 -- 172.21.15.132:0/2988174576 learned_addr learned my addr 172.21.15.132:0/2988174576 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172d5b0640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1728148e50 0x7f17281492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172e5b2640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17281f52d0 0x7f17281f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172ddb1640 1 -- 172.21.15.132:0/2988174576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17281f52d0 msgr2=0x7f17281f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172ddb1640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17281f52d0 0x7f17281f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172ddb1640 1 -- 172.21.15.132:0/2988174576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1728148e50 msgr2=0x7f17281492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172ddb1640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1728148e50 0x7f17281492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172ddb1640 1 -- 172.21.15.132:0/2988174576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728147360 con 0x7f172813cd20 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172e5b2640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17281f52d0 0x7f17281f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f172ddb1640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172813cd20 0x7f1728147e40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f17240115f0 tx=0x7f1724011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:51.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f171e7fc640 1 -- 172.21.15.132:0/2988174576 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172400c070 con 0x7f172813cd20 2024-03-16T17:48:51.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f171e7fc640 1 -- 172.21.15.132:0/2988174576 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1724004220 con 0x7f172813cd20 2024-03-16T17:48:51.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f1730015640 1 -- 172.21.15.132:0/2988174576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1728147640 con 0x7f172813cd20 2024-03-16T17:48:51.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f171e7fc640 1 -- 172.21.15.132:0/2988174576 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172400f6f0 con 0x7f172813cd20 2024-03-16T17:48:51.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.597+0000 7f1730015640 1 -- 172.21.15.132:0/2988174576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17281f5c90 con 0x7f172813cd20 2024-03-16T17:48:51.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.598+0000 7f1730015640 1 -- 172.21.15.132:0/2988174576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172804f2c0 con 0x7f172813cd20 2024-03-16T17:48:51.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.599+0000 7f171e7fc640 1 -- 172.21.15.132:0/2988174576 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f172400f850 con 0x7f172813cd20 2024-03-16T17:48:51.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.599+0000 7f171e7fc640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f170c06b3b0 0x7f170c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:51.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.599+0000 7f171e7fc640 1 -- 172.21.15.132:0/2988174576 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1724089b10 con 0x7f172813cd20 2024-03-16T17:48:51.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.599+0000 7f172d5b0640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f170c06b3b0 0x7f170c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:51.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.600+0000 7f172d5b0640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f170c06b3b0 0x7f170c06d870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1728148680 tx=0x7f1718009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:51.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.608+0000 7f171e7fc640 1 -- 172.21.15.132:0/2988174576 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f17240548b0 con 0x7f172813cd20 2024-03-16T17:48:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.823+0000 7f1730015640 1 -- 172.21.15.132:0/2988174576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f172806bde0 con 0x7f172813cd20 2024-03-16T17:48:51.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.823+0000 7f171e7fc640 1 -- 172.21.15.132:0/2988174576 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4979 (secure 0 0 0) 0x7f1724022090 con 0x7f172813cd20 2024-03-16T17:48:51.827 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:51.827 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/113905029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":113905029},{"type":"v1","addr":"172.21.15.194:6835","nonce":113905029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/951306128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":951306128},{"type":"v1","addr":"172.21.15.194:6834","nonce":951306128}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5055,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/913030001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":913030001},{"type":"v1","addr":"172.21.15.132:6835","nonce":913030001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-16T17:48:47.087430+0000","modified":"2024-03-16T17:48:49.097247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6837/4278287334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4278287334},{"type":"v1","addr":"172.21.15.132:6837","nonce":4278287334}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5073,"qdb_cluster":[5073]},"id":2}]} 2024-03-16T17:48:51.827 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 14 2024-03-16T17:48:51.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 -- 172.21.15.132:0/2988174576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f170c06b3b0 msgr2=0x7f170c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f170c06b3b0 0x7f170c06d870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1728148680 tx=0x7f1718009040 comp rx=0 tx=0).stop 2024-03-16T17:48:51.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 -- 172.21.15.132:0/2988174576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172813cd20 msgr2=0x7f1728147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:51.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172813cd20 0x7f1728147e40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f17240115f0 tx=0x7f1724011ab0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 -- 172.21.15.132:0/2988174576 shutdown_connections 2024-03-16T17:48:51.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f170c06b3b0 0x7f170c06d870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17281f52d0 0x7f17281f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1728148e50 0x7f17281492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 --2- 172.21.15.132:0/2988174576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172813cd20 0x7f1728147e40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:51.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 -- 172.21.15.132:0/2988174576 >> 172.21.15.132:0/2988174576 conn(0x7f172806aee0 msgr2=0x7f17280b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:51.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 -- 172.21.15.132:0/2988174576 shutdown_connections 2024-03-16T17:48:51.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:51.825+0000 7f1730015640 1 -- 172.21.15.132:0/2988174576 wait complete. 2024-03-16T17:48:52.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-16T17:48:47.087430+0000', 'modified': '2024-03-16T17:48:49.097247+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5073}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5073': {'gid': 5073, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.132:6837/4278287334', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6836', 'nonce': 4278287334}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 4278287334}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5073, 'qdb_cluster': [5073]} 2024-03-16T17:48:52.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-16T17:48:52.242 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-16T17:48:52.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.341+0000 7fd1f60aa640 1 Processor -- start 2024-03-16T17:48:52.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.341+0000 7fd1f60aa640 1 -- start start 2024-03-16T17:48:52.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1f60aa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd1f015bfe0 0x7fd1f00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1f60aa640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd1f00b2ca0 0x7fd1f00d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1f60aa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f00cc600 con 0x7fd1f00d22a0 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1f60aa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f00d2730 con 0x7fd1f015bfe0 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1f60aa640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00b37a0 con 0x7fd1f00b2ca0 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1ef7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd1f015bfe0 0x7fd1f00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1ef7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd1f015bfe0 0x7fd1f00b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37892/0 (socket says 172.21.15.132:37892) 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1effff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd1f00d22a0 0x7fd1f00ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47704/0 (socket says 172.21.15.132:47704) 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/187838845 learned_addr learned my addr 172.21.15.132:0/187838845 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/187838845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd1f00b2ca0 0x7fd1f00d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/187838845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd1f00b2ca0 msgr2=0x7fd1f00d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/187838845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd1f00b2ca0 0x7fd1f00d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/187838845 >> v1:172.21.15.132:6789/0 conn(0x7fd1f00d22a0 legacy=0x7fd1f00ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1ee7fc640 1 -- 172.21.15.132:0/187838845 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296493914 0 0) 0x7fd1f00cc600 con 0x7fd1f00d22a0 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.342+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/187838845 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f015c3c0 con 0x7fd1f015bfe0 2024-03-16T17:48:52.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.343+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/187838845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f015bfe0 0x7fd1f00b2760 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0009e50 tx=0x7fd1e002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af000c559c70ff0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.343+0000 7fd1ee7fc640 1 -- 172.21.15.132:0/187838845 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e002cb00 con 0x7fd1f015bfe0 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.343+0000 7fd1ee7fc640 1 -- 172.21.15.132:0/187838845 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e002cc60 con 0x7fd1f015bfe0 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.343+0000 7fd1ee7fc640 1 -- 172.21.15.132:0/187838845 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00343f0 con 0x7fd1f015bfe0 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.344+0000 7fd1f60aa640 1 -- 172.21.15.132:0/187838845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f015bfe0 msgr2=0x7fd1f00b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.344+0000 7fd1f60aa640 1 --2- 172.21.15.132:0/187838845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f015bfe0 0x7fd1f00b2760 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0009e50 tx=0x7fd1e002bf60 comp rx=0 tx=0).stop 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.344+0000 7fd1f60aa640 1 -- 172.21.15.132:0/187838845 shutdown_connections 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.344+0000 7fd1f60aa640 1 --2- 172.21.15.132:0/187838845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd1f00b2ca0 0x7fd1f00d1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.344+0000 7fd1f60aa640 1 --2- 172.21.15.132:0/187838845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f015bfe0 0x7fd1f00b2760 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.344+0000 7fd1f60aa640 1 -- 172.21.15.132:0/187838845 >> 172.21.15.132:0/187838845 conn(0x7fd1f009aa70 msgr2=0x7fd1f009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.344+0000 7fd1f60aa640 1 -- 172.21.15.132:0/187838845 shutdown_connections 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.344+0000 7fd1f60aa640 1 -- 172.21.15.132:0/187838845 wait complete. 2024-03-16T17:48:52.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.345+0000 7fd1f60aa640 1 Processor -- start 2024-03-16T17:48:52.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.345+0000 7fd1f60aa640 1 -- start start 2024-03-16T17:48:52.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1f60aa640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f00b2ca0 0x7fd1f01533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1f60aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00d22a0 0x7fd1f006d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1f60aa640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd1f015bfe0 0x7fd1f0153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1f60aa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f006cca0 con 0x7fd1f00d22a0 2024-03-16T17:48:52.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1f60aa640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f006c090 con 0x7fd1f00b2ca0 2024-03-16T17:48:52.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1f60aa640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f006c370 con 0x7fd1f015bfe0 2024-03-16T17:48:52.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00d22a0 0x7fd1f006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00d22a0 0x7fd1f006d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37898/0 (socket says 172.21.15.132:37898) 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1eeffd640 1 -- 172.21.15.132:0/518322211 learned_addr learned my addr 172.21.15.132:0/518322211 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1effff640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd1f015bfe0 0x7fd1f0153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f00b2ca0 0x7fd1f01533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1eeffd640 1 -- 172.21.15.132:0/518322211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd1f015bfe0 msgr2=0x7fd1f0153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd1f015bfe0 0x7fd1f0153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1eeffd640 1 -- 172.21.15.132:0/518322211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f00b2ca0 msgr2=0x7fd1f01533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f00b2ca0 0x7fd1f01533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1eeffd640 1 -- 172.21.15.132:0/518322211 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e0009b30 con 0x7fd1f00d22a0 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.346+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f00b2ca0 0x7fd1f01533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.347+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00d22a0 0x7fd1f006d130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800d800 tx=0x7fd1d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.347+0000 7fd1e7fff640 1 -- 172.21.15.132:0/518322211 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800b6c0 con 0x7fd1f00d22a0 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.347+0000 7fd1e7fff640 1 -- 172.21.15.132:0/518322211 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800b820 con 0x7fd1f00d22a0 2024-03-16T17:48:52.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.347+0000 7fd1f60aa640 1 -- 172.21.15.132:0/518322211 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f006c650 con 0x7fd1f00d22a0 2024-03-16T17:48:52.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.347+0000 7fd1e7fff640 1 -- 172.21.15.132:0/518322211 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800bbb0 con 0x7fd1f00d22a0 2024-03-16T17:48:52.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.347+0000 7fd1f60aa640 1 -- 172.21.15.132:0/518322211 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f006d670 con 0x7fd1f00d22a0 2024-03-16T17:48:52.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.348+0000 7fd1e7fff640 1 -- 172.21.15.132:0/518322211 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7fd1d800bd10 con 0x7fd1f00d22a0 2024-03-16T17:48:52.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.349+0000 7fd1e7fff640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd1d006b3e0 0x7fd1d006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.349+0000 7fd1e7fff640 1 -- 172.21.15.132:0/518322211 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1d808a010 con 0x7fd1f00d22a0 2024-03-16T17:48:52.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.349+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd1d006b3e0 0x7fd1d006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.349+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd1d006b3e0 0x7fd1d006d8a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0035000 tx=0x7fd1e0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.350+0000 7fd1f8c85740 1 Processor -- start 2024-03-16T17:48:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.350+0000 7fd1f8c85740 1 -- start start 2024-03-16T17:48:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9ddbbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9dd8c510 0x55de9ddbc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de9dd4ccd0 con 0x55de9ddb9030 2024-03-16T17:48:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de9dcfff20 con 0x55de9dd8c510 2024-03-16T17:48:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de9dcfd450 con 0x55de9ddb9410 2024-03-16T17:48:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37908/0 (socket says 172.21.15.132:37908) 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/1668732632 learned_addr learned my addr 172.21.15.132:0/1668732632 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9ddbbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1effff640 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9dd8c510 0x55de9ddbc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/1668732632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 msgr2=0x55de9ddbbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9ddbbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/1668732632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9dd8c510 msgr2=0x55de9ddbc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9dd8c510 0x55de9ddbc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/1668732632 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de9dcadf20 con 0x55de9ddb9030 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1effff640 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9dd8c510 0x55de9ddbc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.351+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9ddbbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.352+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8bfd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0009f40 tx=0x7fd1e002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc601cb7a285786 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:52.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.352+0000 7fd1e57fa640 1 -- 172.21.15.132:0/1668732632 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e003ee70 con 0x55de9ddb9030 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.352+0000 7fd1e57fa640 1 -- 172.21.15.132:0/1668732632 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0045040 con 0x55de9ddb9030 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.352+0000 7fd1e57fa640 1 -- 172.21.15.132:0/1668732632 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0049610 con 0x55de9ddb9030 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.352+0000 7fd1f8c85740 1 -- 172.21.15.132:0/1668732632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 msgr2=0x55de9dd8bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.352+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8bfd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0009f40 tx=0x7fd1e002e000 comp rx=0 tx=0).stop 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.353+0000 7fd1f8c85740 1 -- 172.21.15.132:0/1668732632 shutdown_connections 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.353+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9dd8c510 0x55de9ddbc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.353+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9ddbbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.353+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/1668732632 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8bfd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.353+0000 7fd1f8c85740 1 -- 172.21.15.132:0/1668732632 >> 172.21.15.132:0/1668732632 conn(0x55de9dd8e240 msgr2=0x55de9ddd6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.353+0000 7fd1f8c85740 1 -- 172.21.15.132:0/1668732632 shutdown_connections 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.353+0000 7fd1f8c85740 1 -- 172.21.15.132:0/1668732632 wait complete. 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.353+0000 7fd1f8c85740 1 -- start start 2024-03-16T17:48:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.353+0000 7fd1f8c85740 1 Processor -- start 2024-03-16T17:48:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dda5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9dda2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9ddb5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de9dcf8c30 con 0x55de9ddb9030 2024-03-16T17:48:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de9dc9dd30 con 0x55de9ddcd8e0 2024-03-16T17:48:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de9d9cc310 con 0x55de9ddb9410 2024-03-16T17:48:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1f8c85740 10 client.0 _ll_register_callbacks cb 0x55de9dca5d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T17:48:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dda5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dda5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37912/0 (socket says 172.21.15.132:37912) 2024-03-16T17:48:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/5380831 learned_addr learned my addr 172.21.15.132:0/5380831 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1effff640 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9ddb5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9dda2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/5380831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 msgr2=0x55de9dda2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9dda2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/5380831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 msgr2=0x55de9ddb5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9ddb5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/5380831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f015c3c0 con 0x55de9ddb9030 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1effff640 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9ddb5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.354+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9dda2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.355+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dda5de0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd1e004c040 tx=0x7fd1e0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a354229d46f66 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.355+0000 7fd1ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.355+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/5380831 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0049cd0 con 0x55de9ddb9030 2024-03-16T17:48:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.355+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/5380831 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1e0049e30 con 0x55de9ddb9030 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.355+0000 7fd1f8c85740 1 -- 172.21.15.132:0/5380831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de9d9f86c0 con 0x55de9ddb9030 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.355+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/5380831 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1e0054440 con 0x55de9ddb9030 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.355+0000 7fd1f8c85740 10 client.5250 fetch_fsmap learned FSMap version 14 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.355+0000 7fd1f8c85740 1 -- 172.21.15.132:0/5380831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55de9dcf72b0 con 0x55de9ddb9030 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.355+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/5380831 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55de9d9f86c0 con 0x55de9ddb9030 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.356+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/5380831 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 14) v1 ==== 3314+0+0 (secure 0 0 0) 0x7fd1e0048070 con 0x55de9ddb9030 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.356+0000 7fd1f8c85740 10 client.5250 fetch_fsmap finished waiting for FSMap version 14 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.356+0000 7fd1f8c85740 10 client.5250 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.356+0000 7fd1f8c85740 20 client.5250 populate_metadata read hostname 'smithi132' 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.356+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.132:6836/4278287334,v1:172.21.15.132:6837/4278287334] conn(0x55de9dde6990 0x55de9dde6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.356+0000 7fd1f8c85740 4 client.5250 mds_command: new command op to 5073 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.356+0000 7fd1f8c85740 1 -- 172.21.15.132:0/5380831 --> [v2:172.21.15.132:6836/4278287334,v1:172.21.15.132:6837/4278287334] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de9da49270 con 0x55de9dde6990 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.356+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.132:6836/4278287334,v1:172.21.15.132:6837/4278287334] conn(0x55de9dde6990 0x55de9dde6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.356+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.132:6836/4278287334,v1:172.21.15.132:6837/4278287334] conn(0x55de9dde6990 0x55de9dde6d70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3810652c98ac040 server_cookie=43e2622d77aef5e2 in_seq=0 out_seq=0 2024-03-16T17:48:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.356+0000 7fd1ce7fc640 10 client.5250 ms_handle_connect on v2:172.21.15.132:6836/4278287334 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/5380831 <== mds.0 v2:172.21.15.132:6836/4278287334 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55de9da49270 con 0x55de9dde6990 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1ce7fc640 10 client.5250 handle_command_reply: tid=0 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 client.5250 shutdown 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 -- 172.21.15.132:0/5380831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 msgr2=0x55de9dda5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dda5de0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd1e004c040 tx=0x7fd1e0004ab0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 -- 172.21.15.132:0/5380831 shutdown_connections 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.132:6836/4278287334,v1:172.21.15.132:6837/4278287334] conn(0x55de9dde6990 0x55de9dde6d70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9ddb5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9dda2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1ce7fc640 0 client.5250 ms_handle_reset on v2:172.21.15.132:6836/4278287334 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/5380831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dda5de0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 -- 172.21.15.132:0/5380831 >> 172.21.15.132:0/5380831 conn(0x55de9dd8c510 msgr2=0x55de9dd8fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 -- 172.21.15.132:0/5380831 shutdown_connections 2024-03-16T17:48:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 1 -- 172.21.15.132:0/5380831 wait complete. 2024-03-16T17:48:52.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.357+0000 7fd1f8c85740 20 client.5250 trim_cache size 0 max 16384 2024-03-16T17:48:52.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.374+0000 7fd1f8c85740 1 Processor -- start 2024-03-16T17:48:52.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.374+0000 7fd1f8c85740 1 -- start start 2024-03-16T17:48:52.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9dd8f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9dd8fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de9dc7e490 con 0x55de9ddb9030 2024-03-16T17:48:52.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de9dcacd30 con 0x55de9ddcd8e0 2024-03-16T17:48:52.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de9ddb8830 con 0x55de9ddb9410 2024-03-16T17:48:52.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37916/0 (socket says 172.21.15.132:37916) 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/4215419173 learned_addr learned my addr 172.21.15.132:0/4215419173 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1effff640 1 --2- 172.21.15.132:0/4215419173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9dd8fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/4215419173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9dd8f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/4215419173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 msgr2=0x55de9dd8f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/4215419173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9dd8f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/4215419173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 msgr2=0x55de9dd8fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/4215419173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9dd8fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1ef7fe640 1 -- 172.21.15.132:0/4215419173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de9dc93a20 con 0x55de9ddb9030 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/4215419173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8af40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd1e002c570 tx=0x7fd1e0042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff51c40aa52e401 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1e4ff9640 1 -- 172.21.15.132:0/4215419173 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0054440 con 0x55de9ddb9030 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1e4ff9640 1 -- 172.21.15.132:0/4215419173 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0049680 con 0x55de9ddb9030 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.375+0000 7fd1e4ff9640 1 -- 172.21.15.132:0/4215419173 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0054d10 con 0x55de9ddb9030 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.376+0000 7fd1f8c85740 1 -- 172.21.15.132:0/4215419173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 msgr2=0x55de9dd8af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.376+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/4215419173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8af40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd1e002c570 tx=0x7fd1e0042000 comp rx=0 tx=0).stop 2024-03-16T17:48:52.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.376+0000 7fd1f8c85740 1 -- 172.21.15.132:0/4215419173 shutdown_connections 2024-03-16T17:48:52.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.376+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/4215419173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9dd8fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.376+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/4215419173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9410 0x55de9dd8f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.376+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/4215419173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9030 0x55de9dd8af40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.376+0000 7fd1f8c85740 1 -- 172.21.15.132:0/4215419173 >> 172.21.15.132:0/4215419173 conn(0x55de9dd8c510 msgr2=0x55de9ddb5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:52.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.376+0000 7fd1f8c85740 1 -- 172.21.15.132:0/4215419173 shutdown_connections 2024-03-16T17:48:52.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.376+0000 7fd1f8c85740 1 -- 172.21.15.132:0/4215419173 wait complete. 2024-03-16T17:48:52.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.377+0000 7fd1f8c85740 1 -- start start 2024-03-16T17:48:52.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.377+0000 7fd1f8c85740 1 Processor -- start 2024-03-16T17:48:52.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.377+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9030 0x55de9de499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.377+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9410 0x55de9dd8fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.377+0000 7fd1f8c85740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9de3b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.377+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de9de49f00 con 0x55de9ddb9410 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.377+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de9dd90a80 con 0x55de9ddcd8e0 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.377+0000 7fd1f8c85740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de9ddb3bd0 con 0x55de9ddb9030 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1f8c85740 10 client.0 _ll_register_callbacks cb 0x7fd1e004c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9410 0x55de9dd8fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9410 0x55de9dd8fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37924/0 (socket says 172.21.15.132:37924) 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1eeffd640 1 -- 172.21.15.132:0/2817714065 learned_addr learned my addr 172.21.15.132:0/2817714065 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9030 0x55de9de499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1effff640 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9de3b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1eeffd640 1 -- 172.21.15.132:0/2817714065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9030 msgr2=0x55de9de499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9030 0x55de9de499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1eeffd640 1 -- 172.21.15.132:0/2817714065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 msgr2=0x55de9de3b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9de3b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1eeffd640 1 -- 172.21.15.132:0/2817714065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de9dcf72b0 con 0x55de9ddb9410 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9030 0x55de9de499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1eeffd640 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9410 0x55de9dd8fd40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8054ec0 tx=0x7fd1d800b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c069779f96b95aa server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/2817714065 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80550d0 con 0x55de9ddb9410 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/2817714065 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1d8055230 con 0x55de9ddb9410 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1f8c85740 1 -- 172.21.15.132:0/2817714065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de9da35610 con 0x55de9ddb9410 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/2817714065 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1d8057eb0 con 0x55de9ddb9410 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1f8c85740 10 client.5256 fetch_fsmap learned FSMap version 14 2024-03-16T17:48:52.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1f8c85740 1 -- 172.21.15.132:0/2817714065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55de9dcb9780 con 0x55de9ddb9410 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.378+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/2817714065 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55de9da35610 con 0x55de9ddb9410 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/2817714065 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 14) v1 ==== 3314+0+0 (secure 0 0 0) 0x7fd1d8085020 con 0x55de9ddb9410 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 10 client.5256 fetch_fsmap finished waiting for FSMap version 14 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 10 client.5256 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 20 client.5256 populate_metadata read hostname 'smithi132' 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.132:6836/4278287334,v1:172.21.15.132:6837/4278287334] conn(0x55de9ddf9d40 0x55de9ddcc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 4 client.5256 mds_command: new command op to 5073 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 -- 172.21.15.132:0/2817714065 --> [v2:172.21.15.132:6836/4278287334,v1:172.21.15.132:6837/4278287334] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55de9d9a45e0 con 0x55de9ddf9d40 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.132:6836/4278287334,v1:172.21.15.132:6837/4278287334] conn(0x55de9ddf9d40 0x55de9ddcc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1ce7fc640 10 client.5256 ms_handle_connect on v2:172.21.15.132:6836/4278287334 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1ef7fe640 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.132:6836/4278287334,v1:172.21.15.132:6837/4278287334] conn(0x55de9ddf9d40 0x55de9ddcc750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec39b779d1963bb6 server_cookie=181cd73a3a7980cc in_seq=0 out_seq=0 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1ce7fc640 1 -- 172.21.15.132:0/2817714065 <== mds.0 v2:172.21.15.132:6836/4278287334 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55de9d9a45e0 con 0x55de9ddf9d40 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1ce7fc640 10 client.5256 handle_command_reply: tid=0 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 client.5256 shutdown 2024-03-16T17:48:52.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 -- 172.21.15.132:0/2817714065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9410 msgr2=0x55de9dd8fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9410 0x55de9dd8fd40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8054ec0 tx=0x7fd1d800b5e0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 -- 172.21.15.132:0/2817714065 shutdown_connections 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.132:6836/4278287334,v1:172.21.15.132:6837/4278287334] conn(0x55de9ddf9d40 0x55de9ddcc750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de9ddcd8e0 0x55de9de3b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1ce7fc640 0 client.5256 ms_handle_reset on v2:172.21.15.132:6836/4278287334 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de9ddb9410 0x55de9dd8fd40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 --2- 172.21.15.132:0/2817714065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55de9ddb9030 0x55de9de499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 -- 172.21.15.132:0/2817714065 >> 172.21.15.132:0/2817714065 conn(0x55de9dd8c510 msgr2=0x55de9de3c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 -- 172.21.15.132:0/2817714065 shutdown_connections 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.379+0000 7fd1f8c85740 1 -- 172.21.15.132:0/2817714065 wait complete. 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f8c85740 20 client.5256 trim_cache size 0 max 16384 2024-03-16T17:48:52.389 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e", 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5073, 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 4.6446164669999996, 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 14, 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 33, 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 33, 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 13.139511184 2024-03-16T17:48:52.390 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 -- 172.21.15.132:0/518322211 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd1d006b3e0 msgr2=0x7fd1d006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd1d006b3e0 0x7fd1d006d8a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0035000 tx=0x7fd1e0030000 comp rx=0 tx=0).stop 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 -- 172.21.15.132:0/518322211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00d22a0 msgr2=0x7fd1f006d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00d22a0 0x7fd1f006d130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800d800 tx=0x7fd1d800dcc0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 -- 172.21.15.132:0/518322211 shutdown_connections 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7fd1d006b3e0 0x7fd1d006d8a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd1f015bfe0 0x7fd1f0153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1f00d22a0 0x7fd1f006d130 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 --2- 172.21.15.132:0/518322211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd1f00b2ca0 0x7fd1f01533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 -- 172.21.15.132:0/518322211 >> 172.21.15.132:0/518322211 conn(0x7fd1f009aa70 msgr2=0x7fd1f00cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:52.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 -- 172.21.15.132:0/518322211 shutdown_connections 2024-03-16T17:48:52.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.380+0000 7fd1f60aa640 1 -- 172.21.15.132:0/518322211 wait complete. 2024-03-16T17:48:52.396 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-16T17:48:52.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.492+0000 7f9b4c325640 1 Processor -- start 2024-03-16T17:48:52.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.492+0000 7f9b4c325640 1 -- start start 2024-03-16T17:48:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.493+0000 7f9b4c325640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9b44161540 0x7f9b440b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.493+0000 7f9b4c325640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440d1980 0x7f9b440d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.493+0000 7f9b4c325640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b440d0680 con 0x7f9b440cf080 2024-03-16T17:48:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.493+0000 7f9b4c325640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b440b4f30 con 0x7f9b44161540 2024-03-16T17:48:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.493+0000 7f9b4c325640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440d08d0 con 0x7f9b440d1980 2024-03-16T17:48:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.493+0000 7f9b4a8c2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440d1980 0x7f9b440d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.493+0000 7f9b4a0c1640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9b44161540 0x7f9b440b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.493+0000 7f9b4a8c2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440d1980 0x7f9b440d1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.132:55288/0 (socket says 172.21.15.132:55288) 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.493+0000 7f9b4a8c2640 1 -- 172.21.15.132:0/3984670503 learned_addr learned my addr 172.21.15.132:0/3984670503 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.493+0000 7f9b498c0640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f9b440cf080 0x7f9b440cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.132:33112/0 (socket says 172.21.15.132:33112) 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.494+0000 7f9b4a8c2640 1 -- 172.21.15.132:0/3984670503 >> v2:172.21.15.194:3300/0 conn(0x7f9b44161540 msgr2=0x7f9b440b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.494+0000 7f9b4a8c2640 1 --2- 172.21.15.132:0/3984670503 >> v2:172.21.15.194:3300/0 conn(0x7f9b44161540 0x7f9b440b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.494+0000 7f9b4a8c2640 1 -- 172.21.15.132:0/3984670503 >> v1:172.21.15.194:6789/0 conn(0x7f9b440cf080 legacy=0x7f9b440cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.494+0000 7f9b4a8c2640 1 -- 172.21.15.132:0/3984670503 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440d0bb0 con 0x7f9b440d1980 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.495+0000 7f9b4a8c2640 1 --2- 172.21.15.132:0/3984670503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440d1980 0x7f9b440d1e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009e50 tx=0x7f9b3c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d7f321dbd6b4d96 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.495+0000 7f9b490bf640 1 -- 172.21.15.132:0/3984670503 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c02cb00 con 0x7f9b440d1980 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.495+0000 7f9b490bf640 1 -- 172.21.15.132:0/3984670503 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c02cc60 con 0x7f9b440d1980 2024-03-16T17:48:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.495+0000 7f9b490bf640 1 -- 172.21.15.132:0/3984670503 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0343f0 con 0x7f9b440d1980 2024-03-16T17:48:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.496+0000 7f9b4c325640 1 -- 172.21.15.132:0/3984670503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440d1980 msgr2=0x7f9b440d1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.496+0000 7f9b4c325640 1 --2- 172.21.15.132:0/3984670503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440d1980 0x7f9b440d1e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009e50 tx=0x7f9b3c02bf60 comp rx=0 tx=0).stop 2024-03-16T17:48:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.496+0000 7f9b4c325640 1 -- 172.21.15.132:0/3984670503 shutdown_connections 2024-03-16T17:48:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.496+0000 7f9b4c325640 1 --2- 172.21.15.132:0/3984670503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440d1980 0x7f9b440d1e10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.496+0000 7f9b4c325640 1 --2- 172.21.15.132:0/3984670503 >> v2:172.21.15.194:3300/0 conn(0x7f9b44161540 0x7f9b440b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.496+0000 7f9b4c325640 1 -- 172.21.15.132:0/3984670503 >> 172.21.15.132:0/3984670503 conn(0x7f9b4409d120 msgr2=0x7f9b440d3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.496+0000 7f9b4c325640 1 -- 172.21.15.132:0/3984670503 shutdown_connections 2024-03-16T17:48:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.496+0000 7f9b4c325640 1 -- 172.21.15.132:0/3984670503 wait complete. 2024-03-16T17:48:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.497+0000 7f9b4c325640 1 Processor -- start 2024-03-16T17:48:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.498+0000 7f9b4c325640 1 -- start start 2024-03-16T17:48:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b4c325640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440cf080 0x7f9b440cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b4c325640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440d1980 0x7f9b44160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b4c325640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b44161540 0x7f9b440c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b4c325640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4415eb30 con 0x7f9b440d1980 2024-03-16T17:48:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b4c325640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440cbe40 con 0x7f9b44161540 2024-03-16T17:48:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b4c325640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440c8860 con 0x7f9b440cf080 2024-03-16T17:48:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b498c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440d1980 0x7f9b44160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b498c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440d1980 0x7f9b44160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37934/0 (socket says 172.21.15.132:37934) 2024-03-16T17:48:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b498c0640 1 -- 172.21.15.132:0/2037321120 learned_addr learned my addr 172.21.15.132:0/2037321120 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:48:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b4a0c1640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440cf080 0x7f9b440cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b4a8c2640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b44161540 0x7f9b440c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b498c0640 1 -- 172.21.15.132:0/2037321120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440cf080 msgr2=0x7f9b440cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b498c0640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440cf080 0x7f9b440cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b498c0640 1 -- 172.21.15.132:0/2037321120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b44161540 msgr2=0x7f9b440c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b498c0640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b44161540 0x7f9b440c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b498c0640 1 -- 172.21.15.132:0/2037321120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c009b30 con 0x7f9b440d1980 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b498c0640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440d1980 0x7f9b44160770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000c3c0 tx=0x7f9b4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b3affd640 1 -- 172.21.15.132:0/2037321120 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b400074e0 con 0x7f9b440d1980 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.499+0000 7f9b3affd640 1 -- 172.21.15.132:0/2037321120 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b40007640 con 0x7f9b440d1980 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.500+0000 7f9b4c325640 1 -- 172.21.15.132:0/2037321120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4415ed80 con 0x7f9b440d1980 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.500+0000 7f9b3affd640 1 -- 172.21.15.132:0/2037321120 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40004a00 con 0x7f9b440d1980 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.500+0000 7f9b4c325640 1 -- 172.21.15.132:0/2037321120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4415f340 con 0x7f9b440d1980 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.501+0000 7f9b4c325640 1 -- 172.21.15.132:0/2037321120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4404f2c0 con 0x7f9b440d1980 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.501+0000 7f9b3affd640 1 -- 172.21.15.132:0/2037321120 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f9b40004b60 con 0x7f9b440d1980 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.501+0000 7f9b3affd640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9b2806b3b0 0x7f9b2806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:48:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.502+0000 7f9b4a0c1640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9b2806b3b0 0x7f9b2806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:48:52.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.502+0000 7f9b3affd640 1 -- 172.21.15.132:0/2037321120 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b40089430 con 0x7f9b440d1980 2024-03-16T17:48:52.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.502+0000 7f9b4a0c1640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9b2806b3b0 0x7f9b2806d870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009b40 tx=0x7f9b34009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:48:52.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.506+0000 7f9b3affd640 1 -- 172.21.15.132:0/2037321120 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9b40054140 con 0x7f9b440d1980 2024-03-16T17:48:52.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.720+0000 7f9b4c325640 1 -- 172.21.15.132:0/2037321120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9b440683c0 con 0x7f9b440d1980 2024-03-16T17:48:52.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.720+0000 7f9b3affd640 1 -- 172.21.15.132:0/2037321120 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9b4005ce60 con 0x7f9b440d1980 2024-03-16T17:48:52.724 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-16T17:48:52.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.722+0000 7f9b4c325640 1 -- 172.21.15.132:0/2037321120 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9b2806b3b0 msgr2=0x7f9b2806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.722+0000 7f9b4c325640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9b2806b3b0 0x7f9b2806d870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009b40 tx=0x7f9b34009190 comp rx=0 tx=0).stop 2024-03-16T17:48:52.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.722+0000 7f9b4c325640 1 -- 172.21.15.132:0/2037321120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440d1980 msgr2=0x7f9b44160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:48:52.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.722+0000 7f9b4c325640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440d1980 0x7f9b44160770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000c3c0 tx=0x7f9b4000c880 comp rx=0 tx=0).stop 2024-03-16T17:48:52.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.722+0000 7f9b4c325640 1 -- 172.21.15.132:0/2037321120 shutdown_connections 2024-03-16T17:48:52.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.722+0000 7f9b4c325640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f9b2806b3b0 0x7f9b2806d870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.722+0000 7f9b4c325640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b44161540 0x7f9b440c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.722+0000 7f9b4c325640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440d1980 0x7f9b44160770 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.722+0000 7f9b4c325640 1 --2- 172.21.15.132:0/2037321120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9b440cf080 0x7f9b440cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:48:52.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.722+0000 7f9b4c325640 1 -- 172.21.15.132:0/2037321120 >> 172.21.15.132:0/2037321120 conn(0x7f9b4409d120 msgr2=0x7f9b440d3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:48:52.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.723+0000 7f9b4c325640 1 -- 172.21.15.132:0/2037321120 shutdown_connections 2024-03-16T17:48:52.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:48:52.723+0000 7f9b4c325640 1 -- 172.21.15.132:0/2037321120 wait complete. 2024-03-16T17:48:52.737 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-16T17:48:52.737 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-16T17:48:52.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2024-03-16T17:48:52.737 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-16T17:48:52.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-16T17:48:52.737 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-16T17:48:52.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-16T17:48:52.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-16T17:48:52.737 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T17:48:52.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:52.738 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2024-03-16T17:48:52.753 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-16T17:48:52.753 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-16T17:48:52.753 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-03-16T17:48:52.753 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:52.753 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-03-16T17:48:52.753 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:52.753 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:52.753 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:52.753 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42700sec preferred_lft 42700sec 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:52.754 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 5e:9c:38:1d:65:5c brd ff:ff:ff:ff:ff:ff 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::9cfe:f6ff:fe35:4/64 scope link 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 62:13:04:58:2e:e9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::6013:4ff:fe58:2ee9/64 scope link 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 5e:9c:38:1d:65:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::5c9c:38ff:fe1d:655c/64 scope link 2024-03-16T17:48:52.755 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-03-16T17:48:52.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:52.756 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-16T17:48:52.819 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-03-16T17:48:52.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:52.820 DEBUG:teuthology.orchestra.run.smithi132:> route 2024-03-16T17:48:52.876 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2024-03-16T17:48:52.876 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-16T17:48:52.876 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-16T17:48:52.876 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-16T17:48:52.876 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-16T17:48:52.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:52.876 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2024-03-16T17:48:52.876 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-03-16T17:48:52.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-16T17:48:52.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-16T17:48:52.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-16T17:48:52.877 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-03-16T17:48:52.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:52.972 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-03-16T17:48:52.987 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-16T17:48:52.987 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-16T17:48:52.987 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-16T17:48:52.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:52.987 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2024-03-16T17:48:53.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T17:48:53.054 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-16T17:48:53.107 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-16T17:48:53.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-16T17:48:53.108 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-16T17:48:53.162 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-16T17:48:53.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:53.163 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-16T17:48:53.246 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-16T17:48:53.246 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-16T17:48:53.247 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2024-03-16T17:48:53.255 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-16T17:48:53.255 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-16T17:48:53.255 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2024-03-16T17:48:53.255 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-03-16T17:48:53.255 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-16T17:48:53.260 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-16T17:48:53.260 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-16T17:48:53.260 INFO:teuthology.orchestra.run.smithi132.stdout:invalid new device string format 2024-03-16T17:48:53.261 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-03-16T17:48:53.261 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-16T17:48:53.261 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:6789,172.21.15.194:6789,172.21.15.194:6790" 2024-03-16T17:48:53.261 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.132:6789,172.21.15.194:6789,172.21.15.194:6790:/ 2024-03-16T17:48:53.261 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e" will pass to kernel 2024-03-16T17:48:53.261 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-16T17:48:53.261 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2024-03-16T17:48:53.262 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-16T17:48:53.262 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2024-03-16T17:48:53.262 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-16T17:48:53.263 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-16T17:48:53.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:53.263 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-16T17:48:53.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:53.291 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-16T17:48:53.349 INFO:teuthology.orchestra.run.smithi132.stdout:client5095 2024-03-16T17:48:53.350 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:48:53.350 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-16T17:48:53.405 DEBUG:teuthology.orchestra.run.smithi132:> mktemp -d --suffix=xfstests-dev 2024-03-16T17:48:53.459 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.elA9P9Bv3mxfstests-dev 2024-03-16T17:48:53.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:53.459 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.elA9P9Bv3mxfstests-dev) 2024-03-16T17:48:53.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:53.528 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.elA9P9Bv3mxfstests-dev) 2024-03-16T17:48:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:Cloning into '/tmp/tmp.elA9P9Bv3mxfstests-dev'... 2024-03-16T17:48:54.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:54.315 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-03-16T17:48:54.374 DEBUG:teuthology.orchestra.run.smithi132:> mktemp -d --suffix=test 2024-03-16T17:48:54.429 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.nfM1z1FzKOtest 2024-03-16T17:48:54.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:48:54.429 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-03-16T17:48:54.485 DEBUG:teuthology.orchestra.run.smithi132:> mktemp -d --suffix=scratch 2024-03-16T17:48:54.540 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:48:54.540 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-03-16T17:48:54.540 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-03-16T17:48:55.207 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:03:37 ago on Sat 16 Mar 2024 05:45:18 PM UTC. 2024-03-16T17:48:55.308 INFO:teuthology.orchestra.run.smithi132.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-03-16T17:48:55.309 INFO:teuthology.orchestra.run.smithi132.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-03-16T17:48:55.310 INFO:teuthology.orchestra.run.smithi132.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-03-16T17:48:55.311 INFO:teuthology.orchestra.run.smithi132.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-03-16T17:48:55.312 INFO:teuthology.orchestra.run.smithi132.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-03-16T17:48:55.314 INFO:teuthology.orchestra.run.smithi132.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-03-16T17:48:55.316 INFO:teuthology.orchestra.run.smithi132.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-03-16T17:48:55.317 INFO:teuthology.orchestra.run.smithi132.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-03-16T17:48:55.318 INFO:teuthology.orchestra.run.smithi132.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-03-16T17:48:55.321 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-03-16T17:48:55.322 INFO:teuthology.orchestra.run.smithi132.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-03-16T17:48:55.324 INFO:teuthology.orchestra.run.smithi132.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-03-16T17:48:55.325 INFO:teuthology.orchestra.run.smithi132.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-03-16T17:48:55.325 INFO:teuthology.orchestra.run.smithi132.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-03-16T17:48:55.326 INFO:teuthology.orchestra.run.smithi132.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-03-16T17:48:55.328 INFO:teuthology.orchestra.run.smithi132.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-03-16T17:48:55.329 INFO:teuthology.orchestra.run.smithi132.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-03-16T17:48:55.329 INFO:teuthology.orchestra.run.smithi132.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-03-16T17:48:55.330 INFO:teuthology.orchestra.run.smithi132.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-03-16T17:48:55.333 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-03-16T17:48:55.400 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-03-16T17:48:55.404 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-03-16T17:48:55.404 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-03-16T17:48:55.404 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-03-16T17:48:55.404 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-03-16T17:48:55.404 INFO:teuthology.orchestra.run.smithi132.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-03-16T17:48:55.404 INFO:teuthology.orchestra.run.smithi132.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-03-16T17:48:55.404 INFO:teuthology.orchestra.run.smithi132.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-03-16T17:48:55.404 INFO:teuthology.orchestra.run.smithi132.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-devel x86_64 5.14.0-427.el9 appstream 22 M 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: cpp x86_64 11.4.1-3.el9 appstream 11 M 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: device-mapper x86_64 9:1.02.197-2.el9 baseos 141 k 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 baseos 34 k 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 baseos 32 k 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 baseos 179 k 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: e2fsprogs x86_64 1.46.5-5.el9 baseos 1.0 M 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 baseos 222 k 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: gcc x86_64 11.4.1-3.el9 appstream 32 M 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: gcc-c++ x86_64 11.4.1-3.el9 appstream 13 M 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 appstream 47 k 2024-03-16T17:48:55.405 INFO:teuthology.orchestra.run.smithi132.stdout: git x86_64 2.43.0-1.el9 appstream 51 k 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: git-core x86_64 2.43.0-1.el9 appstream 4.4 M 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: git-core-doc noarch 2.43.0-1.el9 appstream 2.9 M 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: libcom_err x86_64 1.46.5-5.el9 baseos 26 k 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: libgcc x86_64 11.4.1-3.el9 baseos 92 k 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: libgomp x86_64 11.4.1-3.el9 baseos 268 k 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: libss x86_64 1.46.5-5.el9 baseos 32 k 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: libstdc++ x86_64 11.4.1-3.el9 baseos 743 k 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: libstdc++-devel x86_64 11.4.1-3.el9 appstream 2.4 M 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: lvm2 x86_64 9:2.03.23-2.el9 baseos 1.5 M 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 baseos 1.0 M 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: make x86_64 1:4.3-8.el9 baseos 536 k 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: perl-Git noarch 2.43.0-1.el9 appstream 38 k 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-03-16T17:48:55.406 INFO:teuthology.orchestra.run.smithi132.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-16T17:48:55.407 INFO:teuthology.orchestra.run.smithi132.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-03-16T17:48:55.408 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:55.408 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-03-16T17:48:55.408 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-03-16T17:48:55.408 INFO:teuthology.orchestra.run.smithi132.stdout:Install 17 Packages 2024-03-16T17:48:55.408 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 28 Packages 2024-03-16T17:48:55.408 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:48:55.408 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 109 M 2024-03-16T17:48:55.408 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-03-16T17:48:56.079 INFO:teuthology.orchestra.run.smithi132.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 120 kB/s | 17 kB 00:00 2024-03-16T17:48:56.104 INFO:teuthology.orchestra.run.smithi132.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 87 kB/s | 14 kB 00:00 2024-03-16T17:48:56.305 INFO:teuthology.orchestra.run.smithi132.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 60 kB/s | 13 kB 00:00 2024-03-16T17:48:56.330 INFO:teuthology.orchestra.run.smithi132.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 65 kB/s | 15 kB 00:00 2024-03-16T17:48:56.497 INFO:teuthology.orchestra.run.smithi132.stdout:(5/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 91 kB/s | 15 kB 00:00 2024-03-16T17:48:56.522 INFO:teuthology.orchestra.run.smithi132.stdout:(6/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 102 kB/s | 20 kB 00:00 2024-03-16T17:48:56.631 INFO:teuthology.orchestra.run.smithi132.stdout:(7/45): fio-3.35-1.el9.x86_64.rpm 9.0 MB/s | 6.2 MB 00:00 2024-03-16T17:48:56.656 INFO:teuthology.orchestra.run.smithi132.stdout:(8/45): libcap-devel-2.48-9.el9.x86_64.rpm 248 kB/s | 33 kB 00:00 2024-03-16T17:48:56.681 INFO:teuthology.orchestra.run.smithi132.stdout:(9/45): sqlite-3.34.1-7.el9.x86_64.rpm 4.6 MB/s | 747 kB 00:00 2024-03-16T17:48:56.707 INFO:teuthology.orchestra.run.smithi132.stdout:(10/45): udftools-2.2-5.el9.x86_64.rpm 1.9 MB/s | 144 kB 00:00 2024-03-16T17:48:56.732 INFO:teuthology.orchestra.run.smithi132.stdout:(11/45): rmt-1.6-6.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-03-16T17:48:56.932 INFO:teuthology.orchestra.run.smithi132.stdout:(12/45): gdbm-1.19-4.el9.x86_64.rpm 661 kB/s | 132 kB 00:00 2024-03-16T17:48:56.991 INFO:teuthology.orchestra.run.smithi132.stdout:(13/45): gdbm-devel-1.19-4.el9.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2024-03-16T17:48:57.141 INFO:teuthology.orchestra.run.smithi132.stdout:(14/45): libnbd-1.18.1-3.el9.x86_64.rpm 383 kB/s | 166 kB 00:00 2024-03-16T17:48:57.258 INFO:teuthology.orchestra.run.smithi132.stdout:(15/45): dump-0.4-0.51.b47.el9.x86_64.rpm 329 kB/s | 88 kB 00:00 2024-03-16T17:48:57.292 INFO:teuthology.orchestra.run.smithi132.stdout:(16/45): python-unversioned-command-3.9.18-3.el 248 kB/s | 8.3 kB 00:00 2024-03-16T17:48:57.351 INFO:teuthology.orchestra.run.smithi132.stdout:(17/45): python3-devel-3.9.18-3.el9.x86_64.rpm 3.4 MB/s | 204 kB 00:00 2024-03-16T17:48:57.393 INFO:teuthology.orchestra.run.smithi132.stdout:(18/45): python3-3.9.18-3.el9.x86_64.rpm 601 kB/s | 25 kB 00:00 2024-03-16T17:48:57.451 INFO:teuthology.orchestra.run.smithi132.stdout:(19/45): indent-2.2.13-5.el9.x86_64.rpm 579 kB/s | 179 kB 00:00 2024-03-16T17:48:57.635 INFO:teuthology.orchestra.run.smithi132.stdout:(20/45): python3-libs-3.9.18-3.el9.x86_64.rpm 30 MB/s | 7.3 MB 00:00 2024-03-16T17:48:57.669 INFO:teuthology.orchestra.run.smithi132.stdout:(21/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 2.8 MB/s | 619 kB 00:00 2024-03-16T17:48:57.902 INFO:teuthology.orchestra.run.smithi132.stdout:(22/45): device-mapper-1.02.197-2.el9.x86_64.rp 532 kB/s | 141 kB 00:00 2024-03-16T17:48:57.936 INFO:teuthology.orchestra.run.smithi132.stdout:(23/45): device-mapper-event-1.02.197-2.el9.x86 128 kB/s | 34 kB 00:00 2024-03-16T17:48:58.003 INFO:teuthology.orchestra.run.smithi132.stdout:(24/45): device-mapper-event-libs-1.02.197-2.el 321 kB/s | 32 kB 00:00 2024-03-16T17:48:58.278 INFO:teuthology.orchestra.run.smithi132.stdout:(25/45): device-mapper-libs-1.02.197-2.el9.x86_ 523 kB/s | 179 kB 00:00 2024-03-16T17:48:58.378 INFO:teuthology.orchestra.run.smithi132.stdout:(26/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-03-16T17:48:58.470 INFO:teuthology.orchestra.run.smithi132.stdout:(27/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 1.1 MB/s | 222 kB 00:00 2024-03-16T17:48:58.496 INFO:teuthology.orchestra.run.smithi132.stdout:(28/45): libcom_err-1.46.5-5.el9.x86_64.rpm 225 kB/s | 26 kB 00:00 2024-03-16T17:48:58.579 INFO:teuthology.orchestra.run.smithi132.stdout:(29/45): libgcc-11.4.1-3.el9.x86_64.rpm 849 kB/s | 92 kB 00:00 2024-03-16T17:48:58.604 INFO:teuthology.orchestra.run.smithi132.stdout:(30/45): libgomp-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 268 kB 00:00 2024-03-16T17:48:58.697 INFO:teuthology.orchestra.run.smithi132.stdout:(31/45): libss-1.46.5-5.el9.x86_64.rpm 272 kB/s | 32 kB 00:00 2024-03-16T17:48:58.722 INFO:teuthology.orchestra.run.smithi132.stdout:(32/45): libstdc++-11.4.1-3.el9.x86_64.rpm 6.2 MB/s | 743 kB 00:00 2024-03-16T17:48:58.847 INFO:teuthology.orchestra.run.smithi132.stdout:(33/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-03-16T17:48:58.956 INFO:teuthology.orchestra.run.smithi132.stdout:(34/45): make-4.3-8.el9.x86_64.rpm 4.8 MB/s | 536 kB 00:00 2024-03-16T17:48:59.081 INFO:teuthology.orchestra.run.smithi132.stdout:(35/45): lvm2-2.03.23-2.el9.x86_64.rpm 4.0 MB/s | 1.5 MB 00:00 2024-03-16T17:49:13.414 INFO:teuthology.orchestra.run.smithi132.stdout:(36/45): cpp-11.4.1-3.el9.x86_64.rpm 753 kB/s | 11 MB 00:14 2024-03-16T17:49:14.692 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:49:14.694 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:49:15.581 INFO:teuthology.orchestra.run.smithi132.stdout:(37/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 5.9 MB/s | 13 MB 00:02 2024-03-16T17:49:15.706 INFO:teuthology.orchestra.run.smithi132.stdout:(38/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 378 kB/s | 47 kB 00:00 2024-03-16T17:49:15.832 INFO:teuthology.orchestra.run.smithi132.stdout:(39/45): git-2.43.0-1.el9.x86_64.rpm 404 kB/s | 51 kB 00:00 2024-03-16T17:49:16.332 INFO:teuthology.orchestra.run.smithi132.stdout:(40/45): kernel-devel-5.14.0-427.el9.x86_64.rpm 1.1 MB/s | 22 MB 00:19 2024-03-16T17:49:16.707 INFO:teuthology.orchestra.run.smithi132.stdout:(41/45): git-core-2.43.0-1.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-03-16T17:49:17.275 INFO:teuthology.orchestra.run.smithi132.stdout:(42/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 4.3 MB/s | 2.4 MB 00:00 2024-03-16T17:49:17.583 INFO:teuthology.orchestra.run.smithi132.stdout:(43/45): gcc-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 32 MB 00:18 2024-03-16T17:49:17.608 INFO:teuthology.orchestra.run.smithi132.stdout:(44/45): perl-Git-2.43.0-1.el9.noarch.rpm 113 kB/s | 38 kB 00:00 2024-03-16T17:49:18.766 INFO:teuthology.orchestra.run.smithi132.stdout:(45/45): git-core-doc-2.43.0-1.el9.noarch.rpm 1.2 MB/s | 2.9 MB 00:02 2024-03-16T17:49:18.768 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-03-16T17:49:18.769 INFO:teuthology.orchestra.run.smithi132.stdout:Total 4.7 MB/s | 109 MB 00:23 2024-03-16T17:49:19.798 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-03-16T17:49:20.368 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-03-16T17:49:20.368 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-03-16T17:49:22.062 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-03-16T17:49:22.062 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-03-16T17:49:25.375 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-03-16T17:49:25.434 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-16T17:49:25.502 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-16T17:49:25.563 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-03-16T17:49:25.627 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-03-16T17:49:25.686 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-03-16T17:49:25.749 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-03-16T17:49:25.799 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-03-16T17:49:26.009 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-03-16T17:49:26.241 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 8/73 2024-03-16T17:49:26.306 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : make-1:4.3-8.el9.x86_64 9/73 2024-03-16T17:49:27.726 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 10/73 2024-03-16T17:49:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 11/73 2024-03-16T17:49:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 12/73 2024-03-16T17:49:28.737 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 13/73 2024-03-16T17:49:28.804 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-03-16T17:49:28.849 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-03-16T17:49:28.881 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-03-16T17:49:28.911 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-16T17:49:29.134 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-16T17:49:29.743 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-03-16T17:49:29.852 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-03-16T17:49:30.261 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-03-16T17:49:30.324 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 21/73 2024-03-16T17:49:31.458 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 22/73 2024-03-16T17:49:31.597 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-03-16T17:49:31.653 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-03-16T17:49:31.704 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-03-16T17:49:31.735 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 25/73 2024-03-16T17:49:31.751 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 26/73 2024-03-16T17:49:31.777 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 27/73 2024-03-16T17:49:31.802 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 28/73 2024-03-16T17:49:31.827 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 29/73 2024-03-16T17:49:31.853 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 30/73 2024-03-16T17:49:32.097 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 31/73 2024-03-16T17:49:32.133 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fio-3.35-1.el9.x86_64 32/73 2024-03-16T17:49:32.168 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rmt-2:1.6-6.el9.x86_64 33/73 2024-03-16T17:49:32.199 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-03-16T17:49:42.012 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-03-16T17:49:42.246 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-devel-5.14.0-427.el9.x86_64 36/73 2024-03-16T17:49:44.799 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:49:44.803 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:49:52.583 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-devel-5.14.0-427.el9.x86_64 36/73 2024-03-16T17:49:52.655 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-03-16T17:49:52.687 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-16T17:49:52.816 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-16T17:49:53.000 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-03-16T17:49:53.000 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-16T17:49:53.000 INFO:teuthology.orchestra.run.smithi132.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-03-16T17:49:53.000 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:49:53.313 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-16T17:49:53.361 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-03-16T17:49:53.408 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-03-16T17:49:53.457 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-03-16T17:49:53.506 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-03-16T17:49:53.541 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-03-16T17:49:53.568 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-03-16T17:49:53.601 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 47/73 2024-03-16T17:49:53.644 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 48/73 2024-03-16T17:49:53.685 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 49/73 2024-03-16T17:49:53.710 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-03-16T17:49:53.736 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-03-16T17:49:53.736 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-16T17:49:53.786 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-16T17:49:53.821 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 53/73 2024-03-16T17:49:53.830 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-16T17:49:53.831 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-16T17:49:53.901 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-16T17:49:53.968 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 55/73 2024-03-16T17:49:54.004 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 56/73 2024-03-16T17:49:54.031 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 57/73 2024-03-16T17:49:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 58/73 2024-03-16T17:49:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-16T17:49:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-16T17:49:54.114 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 60/73 2024-03-16T17:49:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 61/73 2024-03-16T17:49:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-03-16T17:49:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-03-16T17:49:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-03-16T17:49:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-03-16T17:49:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-03-16T17:49:54.369 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-03-16T17:49:54.394 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-03-16T17:49:54.394 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-16T17:49:54.483 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-16T17:49:54.523 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 70/73 2024-03-16T17:49:54.547 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 71/73 2024-03-16T17:49:54.573 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 72/73 2024-03-16T17:49:54.642 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : make-1:4.3-7.el9.x86_64 73/73 2024-03-16T17:49:57.499 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: make-1:4.3-7.el9.x86_64 73/73 2024-03-16T17:49:57.499 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-03-16T17:49:57.499 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-03-16T17:49:57.499 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 9/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : udftools-2.2-5.el9.x86_64 10/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 11/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-devel-5.14.0-427.el9.x86_64 12/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-03-16T17:49:57.500 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 18/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 19/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 20/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 21/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-3.9.18-3.el9.x86_64 22/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-3.9.17-2.el9.x86_64 23/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 24/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 25/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 26/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 27/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 28/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 29/73 2024-03-16T17:49:57.501 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 30/73 2024-03-16T17:49:57.505 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 31/73 2024-03-16T17:49:57.505 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 32/73 2024-03-16T17:49:57.505 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 33/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 34/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 35/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 36/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 37/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 38/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 39/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 40/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 41/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 42/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 43/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 44/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 45/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libss-1.46.5-5.el9.x86_64 46/73 2024-03-16T17:49:57.506 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libss-1.46.5-3.el9.x86_64 47/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 48/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 49/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 50/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 51/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 52/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : make-1:4.3-8.el9.x86_64 54/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : make-1:4.3-7.el9.x86_64 55/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 56/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 57/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 58/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 59/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 60/73 2024-03-16T17:49:57.507 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 61/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 62/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 63/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : git-2.43.0-1.el9.x86_64 64/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : git-2.39.3-1.el9.x86_64 65/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 66/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 67/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 68/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 69/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 70/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 71/73 2024-03-16T17:49:57.508 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 72/73 2024-03-16T17:49:58.696 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 73/73 2024-03-16T17:49:58.696 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:49:58.696 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2024-03-16T17:49:58.696 INFO:teuthology.orchestra.run.smithi132.stdout: cpp-11.4.1-3.el9.x86_64 2024-03-16T17:49:58.696 INFO:teuthology.orchestra.run.smithi132.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-03-16T17:49:58.696 INFO:teuthology.orchestra.run.smithi132.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-03-16T17:49:58.696 INFO:teuthology.orchestra.run.smithi132.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-03-16T17:49:58.696 INFO:teuthology.orchestra.run.smithi132.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-03-16T17:49:58.696 INFO:teuthology.orchestra.run.smithi132.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-03-16T17:49:58.696 INFO:teuthology.orchestra.run.smithi132.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: gcc-11.4.1-3.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: git-2.43.0-1.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: git-core-2.43.0-1.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: libgcc-11.4.1-3.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: libgomp-11.4.1-3.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: libss-1.46.5-5.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-03-16T17:49:58.697 INFO:teuthology.orchestra.run.smithi132.stdout: make-1:4.3-8.el9.x86_64 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout: perl-Git-2.43.0-1.el9.noarch 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout: python3-3.9.18-3.el9.x86_64 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-03-16T17:49:58.698 INFO:teuthology.orchestra.run.smithi132.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-03-16T17:49:58.699 INFO:teuthology.orchestra.run.smithi132.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-03-16T17:49:58.699 INFO:teuthology.orchestra.run.smithi132.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-427.el9.x86_64 2024-03-16T17:49:58.699 INFO:teuthology.orchestra.run.smithi132.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-03-16T17:49:58.699 INFO:teuthology.orchestra.run.smithi132.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-03-16T17:49:58.699 INFO:teuthology.orchestra.run.smithi132.stdout: udftools-2.2-5.el9.x86_64 2024-03-16T17:49:58.699 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:49:58.699 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-03-16T17:49:59.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo useradd -m fsgqa 2024-03-16T17:49:59.566 INFO:teuthology.orchestra.run.smithi132.stderr:useradd: user 'fsgqa' already exists 2024-03-16T17:49:59.567 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-16T17:49:59.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo groupadd fsgqa 2024-03-16T17:49:59.634 INFO:teuthology.orchestra.run.smithi132.stderr:groupadd: group 'fsgqa' already exists 2024-03-16T17:49:59.634 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-16T17:49:59.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo useradd fsgqa2 2024-03-16T17:50:00.358 DEBUG:teuthology.orchestra.run.smithi132:> sudo useradd 123456-fsgqa 2024-03-16T17:50:00.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-03-16T17:50:01.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.039+0000 7f6251584640 1 Processor -- start 2024-03-16T17:50:01.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.039+0000 7f6251584640 1 -- start start 2024-03-16T17:50:01.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f6251584640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b35c0 0x7f624c0724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f6251584640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f624c0cda00 0x7f624c0cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f6251584640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c072030 con 0x7f624c0b3dd0 2024-03-16T17:50:01.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f6251584640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0717d0 con 0x7f624c0cda00 2024-03-16T17:50:01.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f6251584640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c06d2c0 con 0x7f624c0b35c0 2024-03-16T17:50:01.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f624b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f624c0cda00 0x7f624c0cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f624b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f624c0cda00 0x7f624c0cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55758/0 (socket says 172.21.15.132:55758) 2024-03-16T17:50:01.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f624b7fe640 1 -- 172.21.15.132:0/3567993763 learned_addr learned my addr 172.21.15.132:0/3567993763 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:50:01.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f6243fff640 1 --2- 172.21.15.132:0/3567993763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b35c0 0x7f624c0724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f624b7fe640 1 -- 172.21.15.132:0/3567993763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b35c0 msgr2=0x7f624c0724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:50:01.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f624b7fe640 1 --2- 172.21.15.132:0/3567993763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b35c0 0x7f624c0724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f624b7fe640 1 -- 172.21.15.132:0/3567993763 >> v1:172.21.15.194:6789/0 conn(0x7f624c0b3dd0 legacy=0x7f624c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f624b7fe640 1 -- 172.21.15.132:0/3567993763 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0ce3d0 con 0x7f624c0cda00 2024-03-16T17:50:01.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.041+0000 7f6243fff640 1 --2- 172.21.15.132:0/3567993763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b35c0 0x7f624c0724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:50:01.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.042+0000 7f624b7fe640 1 --2- 172.21.15.132:0/3567993763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0cda00 0x7f624c0cde90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6244009e50 tx=0x7f624402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22c8c65ecbbdd80 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:50:01.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f624a7fc640 1 -- 172.21.15.132:0/3567993763 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624402cb00 con 0x7f624c0cda00 2024-03-16T17:50:01.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f624a7fc640 1 -- 172.21.15.132:0/3567993763 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624402cc60 con 0x7f624c0cda00 2024-03-16T17:50:01.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f624a7fc640 1 -- 172.21.15.132:0/3567993763 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440343f0 con 0x7f624c0cda00 2024-03-16T17:50:01.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f6251584640 1 -- 172.21.15.132:0/3567993763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0cda00 msgr2=0x7f624c0cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f6251584640 1 --2- 172.21.15.132:0/3567993763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0cda00 0x7f624c0cde90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6244009e50 tx=0x7f624402bf60 comp rx=0 tx=0).stop 2024-03-16T17:50:01.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f6251584640 1 -- 172.21.15.132:0/3567993763 shutdown_connections 2024-03-16T17:50:01.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f6251584640 1 --2- 172.21.15.132:0/3567993763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0cda00 0x7f624c0cde90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f6251584640 1 --2- 172.21.15.132:0/3567993763 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b35c0 0x7f624c0724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f6251584640 1 -- 172.21.15.132:0/3567993763 >> 172.21.15.132:0/3567993763 conn(0x7f624c06aee0 msgr2=0x7f624c06b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:50:01.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f6251584640 1 -- 172.21.15.132:0/3567993763 shutdown_connections 2024-03-16T17:50:01.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.043+0000 7f6251584640 1 -- 172.21.15.132:0/3567993763 wait complete. 2024-03-16T17:50:01.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f6251584640 1 Processor -- start 2024-03-16T17:50:01.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f6251584640 1 -- start start 2024-03-16T17:50:01.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f6251584640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b35c0 0x7f624c1528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f6251584640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b3dd0 0x7f624c13ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f6251584640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f624c0cda00 0x7f624c0aa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f6251584640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0abe80 con 0x7f624c0b35c0 2024-03-16T17:50:01.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f6251584640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0ab270 con 0x7f624c0cda00 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f6251584640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0ab550 con 0x7f624c0b3dd0 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f624affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b35c0 0x7f624c1528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f624affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b35c0 0x7f624c1528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55760/0 (socket says 172.21.15.132:55760) 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.045+0000 7f624affd640 1 -- 172.21.15.132:0/2332792366 learned_addr learned my addr 172.21.15.132:0/2332792366 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f6243fff640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b3dd0 0x7f624c13ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f624b7fe640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f624c0cda00 0x7f624c0aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f624affd640 1 -- 172.21.15.132:0/2332792366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b3dd0 msgr2=0x7f624c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f624affd640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b3dd0 0x7f624c13ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f624affd640 1 -- 172.21.15.132:0/2332792366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f624c0cda00 msgr2=0x7f624c0aa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f624affd640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f624c0cda00 0x7f624c0aa820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f624affd640 1 -- 172.21.15.132:0/2332792366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6244009b30 con 0x7f624c0b35c0 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f6243fff640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b3dd0 0x7f624c13ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:50:01.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f624b7fe640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f624c0cda00 0x7f624c0aa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:50:01.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f624affd640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b35c0 0x7f624c1528a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f623c00c3c0 tx=0x7f623c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:50:01.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f62437fe640 1 -- 172.21.15.132:0/2332792366 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c0052d0 con 0x7f624c0b35c0 2024-03-16T17:50:01.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f62437fe640 1 -- 172.21.15.132:0/2332792366 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c005450 con 0x7f624c0b35c0 2024-03-16T17:50:01.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f6251584640 1 -- 172.21.15.132:0/2332792366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c0ab830 con 0x7f624c0b35c0 2024-03-16T17:50:01.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f62437fe640 1 -- 172.21.15.132:0/2332792366 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c007260 con 0x7f624c0b35c0 2024-03-16T17:50:01.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.046+0000 7f6251584640 1 -- 172.21.15.132:0/2332792366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c13b260 con 0x7f624c0b35c0 2024-03-16T17:50:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.047+0000 7f6251584640 1 -- 172.21.15.132:0/2332792366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c0af530 con 0x7f624c0b35c0 2024-03-16T17:50:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.048+0000 7f62437fe640 1 -- 172.21.15.132:0/2332792366 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7f623c0073c0 con 0x7f624c0b35c0 2024-03-16T17:50:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.048+0000 7f62437fe640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f622c06b3e0 0x7f622c06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.048+0000 7f62437fe640 1 -- 172.21.15.132:0/2332792366 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f623c088f20 con 0x7f624c0b35c0 2024-03-16T17:50:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.048+0000 7f6243fff640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f622c06b3e0 0x7f622c06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.049+0000 7f6243fff640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f622c06b3e0 0x7f622c06d8a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f624c15b900 tx=0x7f6234008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:50:01.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.056+0000 7f62437fe640 1 -- 172.21.15.132:0/2332792366 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f623c053c10 con 0x7f624c0b35c0 2024-03-16T17:50:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.300+0000 7f6251584640 1 -- 172.21.15.132:0/2332792366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f624c04f2a0 con 0x7f624c0b35c0 2024-03-16T17:50:01.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.300+0000 7f62437fe640 1 -- 172.21.15.132:0/2332792366 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1289 (secure 0 0 0) 0x7f623c0572d0 con 0x7f624c0b35c0 2024-03-16T17:50:01.304 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:50:01.304 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":1,"fsid":"6d4d560c-40f0-49f1-bbb0-529aaf3b0b8e","modified":"2024-03-16T17:46:46.143306Z","created":"2024-03-16T17:46:46.143306Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3300","nonce":0},{"type":"v1","addr":"172.21.15.132:6789","nonce":0}]},"addr":"172.21.15.132:6789/0","public_addr":"172.21.15.132:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-16T17:50:01.304 INFO:teuthology.orchestra.run.smithi132.stderr:dumped monmap epoch 1 2024-03-16T17:50:01.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 -- 172.21.15.132:0/2332792366 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f622c06b3e0 msgr2=0x7f622c06d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f622c06b3e0 0x7f622c06d8a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f624c15b900 tx=0x7f6234008040 comp rx=0 tx=0).stop 2024-03-16T17:50:01.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 -- 172.21.15.132:0/2332792366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b35c0 msgr2=0x7f624c1528a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b35c0 0x7f624c1528a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f623c00c3c0 tx=0x7f623c00c880 comp rx=0 tx=0).stop 2024-03-16T17:50:01.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 -- 172.21.15.132:0/2332792366 shutdown_connections 2024-03-16T17:50:01.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7f622c06b3e0 0x7f622c06d8a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f624c0cda00 0x7f624c0aa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f624c0b3dd0 0x7f624c13ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 --2- 172.21.15.132:0/2332792366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b35c0 0x7f624c1528a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 -- 172.21.15.132:0/2332792366 >> 172.21.15.132:0/2332792366 conn(0x7f624c06aee0 msgr2=0x7f624c0cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:50:01.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 -- 172.21.15.132:0/2332792366 shutdown_connections 2024-03-16T17:50:01.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.302+0000 7f6251584640 1 -- 172.21.15.132:0/2332792366 wait complete. 2024-03-16T17:50:01.317 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-03-16T17:50:01.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.420+0000 7ff642f3e640 1 Processor -- start 2024-03-16T17:50:01.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.420+0000 7ff642f3e640 1 -- start start 2024-03-16T17:50:01.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff642f3e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff63c0d4a10 0x7ff63c0d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff642f3e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c0d2960 con 0x7ff63c0b4730 2024-03-16T17:50:01.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff642f3e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c0d2bb0 con 0x7ff63c161710 2024-03-16T17:50:01.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff642f3e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63c0d0ce0 con 0x7ff63c0d4a10 2024-03-16T17:50:01.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff6414db640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff63c0b4730 0x7ff63c0cea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33494/0 (socket says 172.21.15.132:33494) 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff6414db640 1 -- 172.21.15.132:0/3338498623 learned_addr learned my addr 172.21.15.132:0/3338498623 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63bfff640 1 --2- 172.21.15.132:0/3338498623 >> v2:172.21.15.194:3300/0 conn(0x7ff63c0d4a10 0x7ff63c0d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665550826 0 0) 0x7ff63c0d2960 con 0x7ff63c0b4730 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff62c003520 con 0x7ff63c0b4730 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3442164671 0 0) 0x7ff62c003520 con 0x7ff63c0b4730 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 >> v2:172.21.15.194:3300/0 conn(0x7ff63c0d4a10 msgr2=0x7ff63c0d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 --2- 172.21.15.132:0/3338498623 >> v2:172.21.15.194:3300/0 conn(0x7ff63c0d4a10 0x7ff63c0d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 >> v1:172.21.15.194:6789/0 conn(0x7ff63c161710 legacy=0x7ff63c0d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c0d2e90 con 0x7ff63c0b4730 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2615399190 0 0) 0x7ff6340019f0 con 0x7ff63c0b4730 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 >> v1:172.21.15.132:6789/0 conn(0x7ff63c0b4730 legacy=0x7ff63c0cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff62c003970 0x7ff62c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62c0047c0 0x7ff62c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.421+0000 7ff63b7fe640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff62c005180 0x7ff62c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c00c000 con 0x7ff62c003970 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c00c170 con 0x7ff62c0047c0 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c00c330 con 0x7ff62c005180 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff640cda640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff62c003970 0x7ff62c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff63bfff640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62c0047c0 0x7ff62c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff6414db640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff62c005180 0x7ff62c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff640cda640 1 -- 172.21.15.132:0/3338498623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff62c005180 msgr2=0x7ff62c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff640cda640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff62c005180 0x7ff62c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff640cda640 1 -- 172.21.15.132:0/3338498623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62c0047c0 msgr2=0x7ff62c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff640cda640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62c0047c0 0x7ff62c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff6414db640 1 -- 172.21.15.132:0/3338498623 reap_dead start 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.422+0000 7ff640cda640 1 -- 172.21.15.132:0/3338498623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c003520 con 0x7ff62c003970 2024-03-16T17:50:01.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff640cda640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff62c003970 0x7ff62c003d90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff630001750 tx=0x7ff62c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d971a6e40364a93 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:50:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300052d0 con 0x7ff62c003970 2024-03-16T17:50:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63002e050 con 0x7ff62c003970 2024-03-16T17:50:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff63b7fe640 1 -- 172.21.15.132:0/3338498623 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630003830 con 0x7ff62c003970 2024-03-16T17:50:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff642f3e640 1 -- 172.21.15.132:0/3338498623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff62c003970 msgr2=0x7ff62c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff642f3e640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff62c003970 0x7ff62c003d90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff630001750 tx=0x7ff62c0057f0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff642f3e640 1 -- 172.21.15.132:0/3338498623 shutdown_connections 2024-03-16T17:50:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff642f3e640 1 --2- 172.21.15.132:0/3338498623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff62c003970 0x7ff62c003d90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff642f3e640 1 -- 172.21.15.132:0/3338498623 >> 172.21.15.132:0/3338498623 conn(0x7ff63c0d3e10 msgr2=0x7ff63c0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:50:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff642f3e640 1 -- 172.21.15.132:0/3338498623 shutdown_connections 2024-03-16T17:50:01.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.423+0000 7ff642f3e640 1 -- 172.21.15.132:0/3338498623 wait complete. 2024-03-16T17:50:01.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.425+0000 7ff642f3e640 1 Processor -- start 2024-03-16T17:50:01.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.425+0000 7ff642f3e640 1 -- start start 2024-03-16T17:50:01.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.425+0000 7ff642f3e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62c003970 0x7ff63c0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.425+0000 7ff642f3e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff63c0cd870 0x7ff63c15c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.425+0000 7ff642f3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff63c15fb40 0x7ff63c15ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.425+0000 7ff642f3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c15df80 con 0x7ff63c15fb40 2024-03-16T17:50:01.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.425+0000 7ff642f3e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c160500 con 0x7ff62c003970 2024-03-16T17:50:01.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.425+0000 7ff642f3e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c0cbe30 con 0x7ff63c0cd870 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.425+0000 7ff6414db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff63c15fb40 0x7ff63c15ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6414db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff63c15fb40 0x7ff63c15ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55780/0 (socket says 172.21.15.132:55780) 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6414db640 1 -- 172.21.15.132:0/1905011299 learned_addr learned my addr 172.21.15.132:0/1905011299 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff63bfff640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff63c0cd870 0x7ff63c15c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff640cda640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62c003970 0x7ff63c0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6414db640 1 -- 172.21.15.132:0/1905011299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff63c0cd870 msgr2=0x7ff63c15c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6414db640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff63c0cd870 0x7ff63c15c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6414db640 1 -- 172.21.15.132:0/1905011299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62c003970 msgr2=0x7ff63c0cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6414db640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62c003970 0x7ff63c0cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6414db640 1 -- 172.21.15.132:0/1905011299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c0cc0d0 con 0x7ff63c15fb40 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff640cda640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62c003970 0x7ff63c0cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-16T17:50:01.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6414db640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff63c15fb40 0x7ff63c15ffc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff63c08d130 tx=0x7ff634007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6397fa640 1 -- 172.21.15.132:0/1905011299 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63400aab0 con 0x7ff63c15fb40 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6397fa640 1 -- 172.21.15.132:0/1905011299 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63400ac50 con 0x7ff63c15fb40 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff642f3e640 1 -- 172.21.15.132:0/1905011299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c0cc3b0 con 0x7ff63c15fb40 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff6397fa640 1 -- 172.21.15.132:0/1905011299 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340133f0 con 0x7ff63c15fb40 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.426+0000 7ff642f3e640 1 -- 172.21.15.132:0/1905011299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c15e190 con 0x7ff63c15fb40 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.427+0000 7ff642f3e640 1 -- 172.21.15.132:0/1905011299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c068450 con 0x7ff63c15fb40 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.428+0000 7ff6397fa640 1 -- 172.21.15.132:0/1905011299 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89462+0+0 (secure 0 0 0) 0x7ff634013550 con 0x7ff63c15fb40 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.428+0000 7ff6397fa640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff62006b3b0 0x7ff62006d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.428+0000 7ff6397fa640 1 -- 172.21.15.132:0/1905011299 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff63408a1e0 con 0x7ff63c15fb40 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.428+0000 7ff640cda640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff62006b3b0 0x7ff62006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-16T17:50:01.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.429+0000 7ff640cda640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff62006b3b0 0x7ff62006d870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff630033000 tx=0x7ff630009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-16T17:50:01.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.437+0000 7ff6397fa640 1 -- 172.21.15.132:0/1905011299 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff634054e40 con 0x7ff63c15fb40 2024-03-16T17:50:01.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.682+0000 7ff642f3e640 1 -- 172.21.15.132:0/1905011299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7ff63c0a1de0 con 0x7ff63c15fb40 2024-03-16T17:50:01.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.682+0000 7ff6397fa640 1 -- 172.21.15.132:0/1905011299 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7ff634058500 con 0x7ff63c15fb40 2024-03-16T17:50:01.686 INFO:teuthology.orchestra.run.smithi132.stdout:[client.admin] 2024-03-16T17:50:01.686 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 -- 172.21.15.132:0/1905011299 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff62006b3b0 msgr2=0x7ff62006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff62006b3b0 0x7ff62006d870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff630033000 tx=0x7ff630009030 comp rx=0 tx=0).stop 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 -- 172.21.15.132:0/1905011299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff63c15fb40 msgr2=0x7ff63c15ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff63c15fb40 0x7ff63c15ffc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff63c08d130 tx=0x7ff634007b10 comp rx=0 tx=0).stop 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 -- 172.21.15.132:0/1905011299 shutdown_connections 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.132:6832/2724898791,v1:172.21.15.132:6833/2724898791] conn(0x7ff62006b3b0 0x7ff62006d870 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff63c15fb40 0x7ff63c15ffc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff63c0cd870 0x7ff63c15c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 --2- 172.21.15.132:0/1905011299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62c003970 0x7ff63c0cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 -- 172.21.15.132:0/1905011299 >> 172.21.15.132:0/1905011299 conn(0x7ff63c0d3e10 msgr2=0x7ff63c0b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-16T17:50:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 -- 172.21.15.132:0/1905011299 shutdown_connections 2024-03-16T17:50:01.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-03-16T17:50:01.685+0000 7ff642f3e640 1 -- 172.21.15.132:0/1905011299 wait complete. 2024-03-16T17:50:01.704 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:50:01.704 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/tmp/tmp.elA9P9Bv3mxfstests-dev/local.config 2024-03-16T17:50:01.736 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.132:6789:/test export TEST_DIR=/tmp/tmp.nfM1z1FzKOtest export SCRATCH_DEV=172.21.15.132:6789:/scratch export SCRATCH_MNT=/tmp/tmp.ZUDwMxKonOscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA==" 2024-03-16T17:50:01.736 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-03-16T17:50:01.736 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/tmp/tmp.elA9P9Bv3mxfstests-dev/ceph.exclude 2024-03-16T17:50:01.802 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo make) 2024-03-16T17:50:01.873 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize -cfi 2024-03-16T17:50:02.291 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: putting auxiliary files in '.'. 2024-03-16T17:50:02.291 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file './config.guess' 2024-03-16T17:50:02.295 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file './config.sub' 2024-03-16T17:50:02.298 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file './install-sh' 2024-03-16T17:50:02.302 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file './ltmain.sh' 2024-03-16T17:50:02.324 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-03-16T17:50:02.324 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-03-16T17:50:02.328 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-03-16T17:50:02.332 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-03-16T17:50:02.337 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-03-16T17:50:02.341 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-03-16T17:50:02.348 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-03-16T17:50:02.349 INFO:teuthology.orchestra.run.smithi132.stdout:cp include/install-sh . 2024-03-16T17:50:02.350 INFO:teuthology.orchestra.run.smithi132.stdout:aclocal -I m4 2024-03-16T17:50:03.386 INFO:teuthology.orchestra.run.smithi132.stdout:autoheader 2024-03-16T17:50:03.719 INFO:teuthology.orchestra.run.smithi132.stdout:autoconf 2024-03-16T17:50:03.893 INFO:teuthology.orchestra.run.smithi132.stdout:./configure \ 2024-03-16T17:50:03.893 INFO:teuthology.orchestra.run.smithi132.stdout: --libexecdir=/usr/lib \ 2024-03-16T17:50:03.893 INFO:teuthology.orchestra.run.smithi132.stdout: --exec_prefix=/var/lib 2024-03-16T17:50:04.097 INFO:teuthology.orchestra.run.smithi132.stdout:checking build system type... x86_64-pc-linux-gnu 2024-03-16T17:50:04.097 INFO:teuthology.orchestra.run.smithi132.stdout:checking host system type... x86_64-pc-linux-gnu 2024-03-16T17:50:04.098 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to print strings... printf 2024-03-16T17:50:04.098 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gcc... gcc 2024-03-16T17:50:04.160 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether the C compiler works... yes 2024-03-16T17:50:04.160 INFO:teuthology.orchestra.run.smithi132.stdout:checking for C compiler default output file name... a.out 2024-03-16T17:50:04.187 INFO:teuthology.orchestra.run.smithi132.stdout:checking for suffix of executables... 2024-03-16T17:50:04.237 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether we are cross compiling... no 2024-03-16T17:50:04.253 INFO:teuthology.orchestra.run.smithi132.stdout:checking for suffix of object files... o 2024-03-16T17:50:04.268 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether we are using the GNU C compiler... yes 2024-03-16T17:50:04.283 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether gcc accepts -g... yes 2024-03-16T17:50:04.309 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-16T17:50:04.311 INFO:teuthology.orchestra.run.smithi132.stdout:checking for a sed that does not truncate output... /bin/sed 2024-03-16T17:50:04.314 INFO:teuthology.orchestra.run.smithi132.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-03-16T17:50:04.315 INFO:teuthology.orchestra.run.smithi132.stdout:checking for egrep... /bin/grep -E 2024-03-16T17:50:04.316 INFO:teuthology.orchestra.run.smithi132.stdout:checking for fgrep... /bin/grep -F 2024-03-16T17:50:04.319 INFO:teuthology.orchestra.run.smithi132.stdout:checking for ld used by gcc... /bin/ld 2024-03-16T17:50:04.320 INFO:teuthology.orchestra.run.smithi132.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-03-16T17:50:04.328 INFO:teuthology.orchestra.run.smithi132.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-03-16T17:50:05.325 INFO:teuthology.orchestra.run.smithi132.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-03-16T17:50:05.326 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether ln -s works... yes 2024-03-16T17:50:05.334 INFO:teuthology.orchestra.run.smithi132.stdout:checking the maximum length of command line arguments... 1572864 2024-03-16T17:50:05.337 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-03-16T17:50:05.337 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-03-16T17:50:05.337 INFO:teuthology.orchestra.run.smithi132.stdout:checking for /bin/ld option to reload object files... -r 2024-03-16T17:50:05.337 INFO:teuthology.orchestra.run.smithi132.stdout:checking for objdump... objdump 2024-03-16T17:50:05.337 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to recognize dependent libraries... pass_all 2024-03-16T17:50:05.337 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dlltool... no 2024-03-16T17:50:05.337 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-03-16T17:50:05.338 INFO:teuthology.orchestra.run.smithi132.stdout:checking for ar... ar 2024-03-16T17:50:05.371 INFO:teuthology.orchestra.run.smithi132.stdout:checking for archiver @FILE support... @ 2024-03-16T17:50:05.371 INFO:teuthology.orchestra.run.smithi132.stdout:checking for strip... strip 2024-03-16T17:50:05.371 INFO:teuthology.orchestra.run.smithi132.stdout:checking for ranlib... ranlib 2024-03-16T17:50:05.371 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gawk... gawk 2024-03-16T17:50:05.431 INFO:teuthology.orchestra.run.smithi132.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-03-16T17:50:05.432 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sysroot... no 2024-03-16T17:50:05.435 INFO:teuthology.orchestra.run.smithi132.stdout:checking for a working dd... /bin/dd 2024-03-16T17:50:05.437 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-03-16T17:50:05.450 INFO:teuthology.orchestra.run.smithi132.stdout:checking for mt... no 2024-03-16T17:50:05.451 INFO:teuthology.orchestra.run.smithi132.stdout:checking if : is a manifest tool... no 2024-03-16T17:50:05.493 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to run the C preprocessor... gcc -E 2024-03-16T17:50:05.649 INFO:teuthology.orchestra.run.smithi132.stdout:checking for ANSI C header files... yes 2024-03-16T17:50:05.669 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/types.h... yes 2024-03-16T17:50:05.704 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/stat.h... yes 2024-03-16T17:50:05.727 INFO:teuthology.orchestra.run.smithi132.stdout:checking for stdlib.h... yes 2024-03-16T17:50:05.751 INFO:teuthology.orchestra.run.smithi132.stdout:checking for string.h... yes 2024-03-16T17:50:05.783 INFO:teuthology.orchestra.run.smithi132.stdout:checking for memory.h... yes 2024-03-16T17:50:05.807 INFO:teuthology.orchestra.run.smithi132.stdout:checking for strings.h... yes 2024-03-16T17:50:05.849 INFO:teuthology.orchestra.run.smithi132.stdout:checking for inttypes.h... yes 2024-03-16T17:50:05.882 INFO:teuthology.orchestra.run.smithi132.stdout:checking for stdint.h... yes 2024-03-16T17:50:05.919 INFO:teuthology.orchestra.run.smithi132.stdout:checking for unistd.h... yes 2024-03-16T17:50:05.955 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dlfcn.h... yes 2024-03-16T17:50:05.958 INFO:teuthology.orchestra.run.smithi132.stdout:checking for objdir... .libs 2024-03-16T17:50:06.020 INFO:teuthology.orchestra.run.smithi132.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-03-16T17:50:06.020 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-03-16T17:50:06.035 INFO:teuthology.orchestra.run.smithi132.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-03-16T17:50:06.052 INFO:teuthology.orchestra.run.smithi132.stdout:checking if gcc static flag -static works... no 2024-03-16T17:50:06.072 INFO:teuthology.orchestra.run.smithi132.stdout:checking if gcc supports -c -o file.o... yes 2024-03-16T17:50:06.073 INFO:teuthology.orchestra.run.smithi132.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-03-16T17:50:06.079 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-03-16T17:50:06.104 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether -lc should be explicitly linked in... no 2024-03-16T17:50:06.164 INFO:teuthology.orchestra.run.smithi132.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-03-16T17:50:06.165 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to hardcode library paths into programs... immediate 2024-03-16T17:50:06.166 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether stripping libraries is possible... yes 2024-03-16T17:50:06.166 INFO:teuthology.orchestra.run.smithi132.stdout:checking if libtool supports shared libraries... yes 2024-03-16T17:50:06.166 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether to build shared libraries... yes 2024-03-16T17:50:06.166 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether to build static libraries... yes 2024-03-16T17:50:06.172 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gcc... (cached) gcc 2024-03-16T17:50:06.187 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-16T17:50:06.187 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-16T17:50:06.187 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-16T17:50:06.187 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gmake... /usr/bin/gmake 2024-03-16T17:50:06.188 INFO:teuthology.orchestra.run.smithi132.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-03-16T17:50:06.188 INFO:teuthology.orchestra.run.smithi132.stdout:checking for tar... /bin/tar 2024-03-16T17:50:06.188 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gzip... /bin/gzip 2024-03-16T17:50:06.197 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether gcc -MM is supported... yes 2024-03-16T17:50:06.198 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sort... /bin/sort 2024-03-16T17:50:06.198 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether ln -s works... yes 2024-03-16T17:50:06.198 INFO:teuthology.orchestra.run.smithi132.stdout:checking for rpm... /bin/rpm 2024-03-16T17:50:06.200 INFO:teuthology.orchestra.run.smithi132.stdout:checking for rpmbuild... no 2024-03-16T17:50:06.225 INFO:teuthology.orchestra.run.smithi132.stdout:checking assert.h usability... yes 2024-03-16T17:50:06.233 INFO:teuthology.orchestra.run.smithi132.stdout:checking assert.h presence... yes 2024-03-16T17:50:06.233 INFO:teuthology.orchestra.run.smithi132.stdout:checking for assert.h... yes 2024-03-16T17:50:06.258 INFO:teuthology.orchestra.run.smithi132.stdout:checking bstring.h usability... no 2024-03-16T17:50:06.269 INFO:teuthology.orchestra.run.smithi132.stdout:checking bstring.h presence... no 2024-03-16T17:50:06.269 INFO:teuthology.orchestra.run.smithi132.stdout:checking for bstring.h... no 2024-03-16T17:50:06.293 INFO:teuthology.orchestra.run.smithi132.stdout:checking libgen.h usability... yes 2024-03-16T17:50:06.301 INFO:teuthology.orchestra.run.smithi132.stdout:checking libgen.h presence... yes 2024-03-16T17:50:06.301 INFO:teuthology.orchestra.run.smithi132.stdout:checking for libgen.h... yes 2024-03-16T17:50:06.335 INFO:teuthology.orchestra.run.smithi132.stdout:checking dirent.h usability... yes 2024-03-16T17:50:06.344 INFO:teuthology.orchestra.run.smithi132.stdout:checking dirent.h presence... yes 2024-03-16T17:50:06.344 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dirent.h... yes 2024-03-16T17:50:06.392 INFO:teuthology.orchestra.run.smithi132.stdout:checking errno.h usability... yes 2024-03-16T17:50:06.402 INFO:teuthology.orchestra.run.smithi132.stdout:checking errno.h presence... yes 2024-03-16T17:50:06.402 INFO:teuthology.orchestra.run.smithi132.stdout:checking for errno.h... yes 2024-03-16T17:50:06.432 INFO:teuthology.orchestra.run.smithi132.stdout:checking malloc.h usability... yes 2024-03-16T17:50:06.442 INFO:teuthology.orchestra.run.smithi132.stdout:checking malloc.h presence... yes 2024-03-16T17:50:06.442 INFO:teuthology.orchestra.run.smithi132.stdout:checking for malloc.h... yes 2024-03-16T17:50:06.467 INFO:teuthology.orchestra.run.smithi132.stdout:checking uuid.h usability... no 2024-03-16T17:50:06.478 INFO:teuthology.orchestra.run.smithi132.stdout:checking uuid.h presence... no 2024-03-16T17:50:06.478 INFO:teuthology.orchestra.run.smithi132.stdout:checking for uuid.h... no 2024-03-16T17:50:06.518 INFO:teuthology.orchestra.run.smithi132.stdout:checking uuid/uuid.h usability... yes 2024-03-16T17:50:06.527 INFO:teuthology.orchestra.run.smithi132.stdout:checking uuid/uuid.h presence... yes 2024-03-16T17:50:06.527 INFO:teuthology.orchestra.run.smithi132.stdout:checking for uuid/uuid.h... yes 2024-03-16T17:50:06.553 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/uuid.h usability... no 2024-03-16T17:50:06.566 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/uuid.h presence... no 2024-03-16T17:50:06.566 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/uuid.h... no 2024-03-16T17:50:06.602 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/file.h usability... yes 2024-03-16T17:50:06.611 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/file.h presence... yes 2024-03-16T17:50:06.611 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/file.h... yes 2024-03-16T17:50:06.647 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fcntl.h usability... yes 2024-03-16T17:50:06.656 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fcntl.h presence... yes 2024-03-16T17:50:06.656 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/fcntl.h... yes 2024-03-16T17:50:06.682 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/syssgi.h usability... no 2024-03-16T17:50:06.692 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/syssgi.h presence... no 2024-03-16T17:50:06.692 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/syssgi.h... no 2024-03-16T17:50:06.732 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/param.h usability... yes 2024-03-16T17:50:06.743 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/param.h presence... yes 2024-03-16T17:50:06.744 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/param.h... yes 2024-03-16T17:50:06.748 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/stat.h... (cached) yes 2024-03-16T17:50:06.776 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/statvfs.h usability... yes 2024-03-16T17:50:06.785 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/statvfs.h presence... yes 2024-03-16T17:50:06.785 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/statvfs.h... yes 2024-03-16T17:50:06.811 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/time.h usability... yes 2024-03-16T17:50:06.824 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/time.h presence... yes 2024-03-16T17:50:06.824 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/time.h... yes 2024-03-16T17:50:06.853 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/ioctl.h usability... yes 2024-03-16T17:50:06.861 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/ioctl.h presence... yes 2024-03-16T17:50:06.862 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/ioctl.h... yes 2024-03-16T17:50:06.896 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/wait.h usability... yes 2024-03-16T17:50:06.906 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/wait.h presence... yes 2024-03-16T17:50:06.906 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/wait.h... yes 2024-03-16T17:50:06.911 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/types.h... (cached) yes 2024-03-16T17:50:06.915 INFO:teuthology.orchestra.run.smithi132.stdout:checking for strings.h... (cached) yes 2024-03-16T17:50:06.942 INFO:teuthology.orchestra.run.smithi132.stdout:checking err.h usability... yes 2024-03-16T17:50:06.950 INFO:teuthology.orchestra.run.smithi132.stdout:checking err.h presence... yes 2024-03-16T17:50:06.950 INFO:teuthology.orchestra.run.smithi132.stdout:checking for err.h... yes 2024-03-16T17:50:06.977 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/falloc.h usability... yes 2024-03-16T17:50:06.985 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/falloc.h presence... yes 2024-03-16T17:50:06.985 INFO:teuthology.orchestra.run.smithi132.stdout:checking for linux/falloc.h... yes 2024-03-16T17:50:07.011 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-03-16T17:50:07.021 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-03-16T17:50:07.021 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/fs/xfs_fsops.h... no 2024-03-16T17:50:07.045 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fs/xfs_itable.h usability... no 2024-03-16T17:50:07.057 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fs/xfs_itable.h presence... no 2024-03-16T17:50:07.057 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/fs/xfs_itable.h... no 2024-03-16T17:50:07.081 INFO:teuthology.orchestra.run.smithi132.stdout:checking xfs/platform_defs.h usability... no 2024-03-16T17:50:07.091 INFO:teuthology.orchestra.run.smithi132.stdout:checking xfs/platform_defs.h presence... no 2024-03-16T17:50:07.091 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/platform_defs.h... no 2024-03-16T17:50:07.115 INFO:teuthology.orchestra.run.smithi132.stdout:checking btrfs/ioctl.h usability... no 2024-03-16T17:50:07.125 INFO:teuthology.orchestra.run.smithi132.stdout:checking btrfs/ioctl.h presence... no 2024-03-16T17:50:07.125 INFO:teuthology.orchestra.run.smithi132.stdout:checking for btrfs/ioctl.h... no 2024-03-16T17:50:07.149 INFO:teuthology.orchestra.run.smithi132.stdout:checking cifs/ioctl.h usability... no 2024-03-16T17:50:07.159 INFO:teuthology.orchestra.run.smithi132.stdout:checking cifs/ioctl.h presence... no 2024-03-16T17:50:07.160 INFO:teuthology.orchestra.run.smithi132.stdout:checking for cifs/ioctl.h... no 2024-03-16T17:50:07.185 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/mman.h usability... yes 2024-03-16T17:50:07.193 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/mman.h presence... yes 2024-03-16T17:50:07.193 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/mman.h... yes 2024-03-16T17:50:07.207 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/xfs_log_format.h... no 2024-03-16T17:50:07.242 INFO:teuthology.orchestra.run.smithi132.stdout:checking for uuid_compare... no 2024-03-16T17:50:07.272 INFO:teuthology.orchestra.run.smithi132.stdout:checking for uuid_compare in -luuid... yes 2024-03-16T17:50:07.337 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/xfs.h... yes 2024-03-16T17:50:07.349 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/libxfs.h... no 2024-03-16T17:50:07.364 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether xlog_assign_lsn is declared... no 2024-03-16T17:50:07.394 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/xqm.h... yes 2024-03-16T17:50:07.442 INFO:teuthology.orchestra.run.smithi132.stdout:checking xfsctl from xfs/xfs.h... ok 2024-03-16T17:50:07.465 INFO:teuthology.orchestra.run.smithi132.stdout:checking xfs/handle.h usability... yes 2024-03-16T17:50:07.472 INFO:teuthology.orchestra.run.smithi132.stdout:checking xfs/handle.h presence... yes 2024-03-16T17:50:07.472 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/handle.h... yes 2024-03-16T17:50:07.503 INFO:teuthology.orchestra.run.smithi132.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-03-16T17:50:07.526 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/acl.h usability... yes 2024-03-16T17:50:07.535 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/acl.h presence... yes 2024-03-16T17:50:07.536 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/acl.h... yes 2024-03-16T17:50:07.558 INFO:teuthology.orchestra.run.smithi132.stdout:checking acl/libacl.h usability... yes 2024-03-16T17:50:07.567 INFO:teuthology.orchestra.run.smithi132.stdout:checking acl/libacl.h presence... yes 2024-03-16T17:50:07.567 INFO:teuthology.orchestra.run.smithi132.stdout:checking for acl/libacl.h... yes 2024-03-16T17:50:07.599 INFO:teuthology.orchestra.run.smithi132.stdout:checking for acl_init in -lacl... yes 2024-03-16T17:50:07.621 INFO:teuthology.orchestra.run.smithi132.stdout:checking gdbm-ndbm.h usability... no 2024-03-16T17:50:07.634 INFO:teuthology.orchestra.run.smithi132.stdout:checking gdbm-ndbm.h presence... no 2024-03-16T17:50:07.634 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gdbm-ndbm.h... no 2024-03-16T17:50:07.656 INFO:teuthology.orchestra.run.smithi132.stdout:checking gdbm/ndbm.h usability... yes 2024-03-16T17:50:07.666 INFO:teuthology.orchestra.run.smithi132.stdout:checking gdbm/ndbm.h presence... yes 2024-03-16T17:50:07.666 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gdbm/ndbm.h... yes 2024-03-16T17:50:07.700 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dbm_open in -lgdbm... no 2024-03-16T17:50:07.734 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dbm_fetch in -lgdbm... no 2024-03-16T17:50:07.770 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dbm_store in -lgdbm... no 2024-03-16T17:50:07.804 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dbm_close in -lgdbm... no 2024-03-16T17:50:07.845 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-03-16T17:50:07.876 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-03-16T17:50:07.908 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-03-16T17:50:07.945 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-03-16T17:50:07.969 INFO:teuthology.orchestra.run.smithi132.stdout:checking libaio.h usability... yes 2024-03-16T17:50:07.980 INFO:teuthology.orchestra.run.smithi132.stdout:checking libaio.h presence... yes 2024-03-16T17:50:07.980 INFO:teuthology.orchestra.run.smithi132.stdout:checking for libaio.h... yes 2024-03-16T17:50:08.002 INFO:teuthology.orchestra.run.smithi132.stdout:checking liburing.h usability... no 2024-03-16T17:50:08.013 INFO:teuthology.orchestra.run.smithi132.stdout:checking liburing.h presence... no 2024-03-16T17:50:08.013 INFO:teuthology.orchestra.run.smithi132.stdout:checking for liburing.h... no 2024-03-16T17:50:08.054 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/capability.h usability... yes 2024-03-16T17:50:08.062 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/capability.h presence... yes 2024-03-16T17:50:08.062 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/capability.h... yes 2024-03-16T17:50:08.084 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/fiemap.h usability... yes 2024-03-16T17:50:08.092 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/fiemap.h presence... yes 2024-03-16T17:50:08.093 INFO:teuthology.orchestra.run.smithi132.stdout:checking for linux/fiemap.h... yes 2024-03-16T17:50:08.130 INFO:teuthology.orchestra.run.smithi132.stdout:checking for fallocate... yes 2024-03-16T17:50:08.163 INFO:teuthology.orchestra.run.smithi132.stdout:checking for open_by_handle_at... yes 2024-03-16T17:50:08.187 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/fs.h usability... yes 2024-03-16T17:50:08.195 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/fs.h presence... yes 2024-03-16T17:50:08.196 INFO:teuthology.orchestra.run.smithi132.stdout:checking for linux/fs.h... yes 2024-03-16T17:50:08.216 INFO:teuthology.orchestra.run.smithi132.stdout:checking btrfsutil.h usability... no 2024-03-16T17:50:08.227 INFO:teuthology.orchestra.run.smithi132.stdout:checking btrfsutil.h presence... no 2024-03-16T17:50:08.227 INFO:teuthology.orchestra.run.smithi132.stdout:checking for btrfsutil.h... no 2024-03-16T17:50:08.274 INFO:teuthology.orchestra.run.smithi132.stdout:checking for copy_file_range... yes 2024-03-16T17:50:08.310 INFO:teuthology.orchestra.run.smithi132.stdout:checking for SEEK_DATA... yes 2024-03-16T17:50:08.358 INFO:teuthology.orchestra.run.smithi132.stdout:checking for BMV_OF_SHARED... yes 2024-03-16T17:50:08.393 INFO:teuthology.orchestra.run.smithi132.stdout:checking for nftw... yes 2024-03-16T17:50:08.427 INFO:teuthology.orchestra.run.smithi132.stdout:checking for RLIMIT_NOFILE... yes 2024-03-16T17:50:08.458 INFO:teuthology.orchestra.run.smithi132.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-03-16T17:50:08.491 INFO:teuthology.orchestra.run.smithi132.stdout:checking for FICLONE... yes 2024-03-16T17:50:08.528 INFO:teuthology.orchestra.run.smithi132.stdout:checking for renameat2... yes 2024-03-16T17:50:08.561 INFO:teuthology.orchestra.run.smithi132.stdout:checking for reallocarray... yes 2024-03-16T17:50:08.591 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct mount_attr... yes 2024-03-16T17:50:08.623 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_qgroup_limit... yes 2024-03-16T17:50:08.655 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-03-16T17:50:08.687 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-03-16T17:50:08.720 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-03-16T17:50:08.752 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-03-16T17:50:08.783 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-03-16T17:50:08.815 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-03-16T17:50:08.841 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/btrfs.h usability... yes 2024-03-16T17:50:08.849 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/btrfs.h presence... yes 2024-03-16T17:50:08.850 INFO:teuthology.orchestra.run.smithi132.stdout:checking for linux/btrfs.h... yes 2024-03-16T17:50:08.880 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/btrfs_tree.h usability... yes 2024-03-16T17:50:08.889 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/btrfs_tree.h presence... yes 2024-03-16T17:50:08.889 INFO:teuthology.orchestra.run.smithi132.stdout:checking for linux/btrfs_tree.h... yes 2024-03-16T17:50:08.916 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-03-16T17:50:08.938 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-03-16T17:50:08.953 INFO:teuthology.orchestra.run.smithi132.stdout:configure: creating ./config.status 2024-03-16T17:50:09.248 INFO:teuthology.orchestra.run.smithi132.stdout:config.status: creating include/builddefs 2024-03-16T17:50:09.258 INFO:teuthology.orchestra.run.smithi132.stdout:config.status: creating include/config.h 2024-03-16T17:50:09.266 INFO:teuthology.orchestra.run.smithi132.stdout:config.status: executing libtool commands 2024-03-16T17:50:09.303 INFO:teuthology.orchestra.run.smithi132.stdout:Building include 2024-03-16T17:50:09.306 INFO:teuthology.orchestra.run.smithi132.stdout:Building lib 2024-03-16T17:50:09.309 INFO:teuthology.orchestra.run.smithi132.stdout: [LTDEP] 2024-03-16T17:50:09.452 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dataascii.lo 2024-03-16T17:50:09.558 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] databin.lo 2024-03-16T17:50:09.690 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] datapid.lo 2024-03-16T17:50:09.785 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] file_lock.lo 2024-03-16T17:50:09.918 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] forker.lo 2024-03-16T17:50:10.050 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] pattern.lo 2024-03-16T17:50:10.160 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] open_flags.lo 2024-03-16T17:50:10.302 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] random_range.lo 2024-03-16T17:50:10.519 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] string_to_tokens.lo 2024-03-16T17:50:10.621 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] str_to_bytes.lo 2024-03-16T17:50:10.748 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] tlibio.lo 2024-03-16T17:50:11.007 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] write_log.lo 2024-03-16T17:50:11.226 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] random.lo 2024-03-16T17:50:11.334 INFO:teuthology.orchestra.run.smithi132.stdout: [LD] 2024-03-16T17:50:11.409 INFO:teuthology.orchestra.run.smithi132.stdout:Building ltp 2024-03-16T17:50:11.411 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2024-03-16T17:50:11.544 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] doio 2024-03-16T17:50:12.193 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fsstress 2024-03-16T17:50:13.619 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fsx 2024-03-16T17:50:14.305 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] growfiles 2024-03-16T17:50:14.779 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] iogen 2024-03-16T17:50:14.952 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:50:14.955 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:50:15.141 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-stress 2024-03-16T17:50:15.547 INFO:teuthology.orchestra.run.smithi132.stdout:Building src 2024-03-16T17:50:15.552 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2024-03-16T17:50:17.289 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2024-03-16T17:50:17.318 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2024-03-16T17:50:17.327 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2024-03-16T17:50:17.538 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2024-03-16T17:50:17.558 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dirstress 2024-03-16T17:50:17.793 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fill 2024-03-16T17:50:17.944 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fill2 2024-03-16T17:50:18.148 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] getpagesize 2024-03-16T17:50:18.283 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] holes 2024-03-16T17:50:18.468 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] lstat64 2024-03-16T17:50:18.649 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] nametest 2024-03-16T17:50:18.912 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] permname 2024-03-16T17:50:19.110 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] randholes 2024-03-16T17:50:19.339 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] runas 2024-03-16T17:50:19.514 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] truncfile 2024-03-16T17:50:19.688 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] usemem 2024-03-16T17:50:19.836 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] mmapcat 2024-03-16T17:50:19.986 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] append_reader 2024-03-16T17:50:20.138 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] append_writer 2024-03-16T17:50:20.283 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dirperf 2024-03-16T17:50:20.507 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] metaperf 2024-03-16T17:50:20.754 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] devzero 2024-03-16T17:50:20.933 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] feature 2024-03-16T17:50:21.131 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] alloc 2024-03-16T17:50:21.344 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fault 2024-03-16T17:50:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fstest 2024-03-16T17:50:21.737 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_access_root 2024-03-16T17:50:21.888 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] godown 2024-03-16T17:50:22.048 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] resvtest 2024-03-16T17:50:22.212 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] writemod 2024-03-16T17:50:22.349 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] writev_on_pagefault 2024-03-16T17:50:22.507 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] makeextents 2024-03-16T17:50:22.672 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] itrash 2024-03-16T17:50:22.829 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] rename 2024-03-16T17:50:22.977 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] multi_open_unlink 2024-03-16T17:50:23.128 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] unwritten_sync 2024-03-16T17:50:23.303 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] genhashnames 2024-03-16T17:50:23.467 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_holes 2024-03-16T17:50:23.613 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_writev 2024-03-16T17:50:23.750 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_truncate_cmtime 2024-03-16T17:50:23.911 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dirhash_collide 2024-03-16T17:50:24.098 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_rename_overwrite 2024-03-16T17:50:24.238 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] holetest 2024-03-16T17:50:24.468 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_truncate_self 2024-03-16T17:50:24.610 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] af_unix 2024-03-16T17:50:24.767 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_stale_pmd 2024-03-16T17:50:24.920 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_cow_race 2024-03-16T17:50:25.083 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_fallocate 2024-03-16T17:50:25.226 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fsync-err 2024-03-16T17:50:25.407 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_write_ro 2024-03-16T17:50:25.559 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_ext4_dax_journal_corruption 2024-03-16T17:50:25.724 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_ext4_dax_inline_corruption 2024-03-16T17:50:25.880 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_ofd_locks 2024-03-16T17:50:26.074 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_collision 2024-03-16T17:50:26.251 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] mmap-write-concurrent 2024-03-16T17:50:26.429 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_get_file_time 2024-03-16T17:50:26.570 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_create_short_dirs 2024-03-16T17:50:26.735 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_create_long_dirs 2024-03-16T17:50:26.909 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_enospc 2024-03-16T17:50:27.099 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_writev_overlap 2024-03-16T17:50:27.273 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] checkpoint_journal 2024-03-16T17:50:27.424 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] mmap-rw-fault 2024-03-16T17:50:27.582 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] allocstale 2024-03-16T17:50:27.754 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_cow_memory_failure 2024-03-16T17:50:27.926 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fake-dump-rootino 2024-03-16T17:50:28.085 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dio-buf-fault 2024-03-16T17:50:28.239 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] rewinddir-test 2024-03-16T17:50:28.407 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] readdir-while-renames 2024-03-16T17:50:28.553 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] xfsctl 2024-03-16T17:50:28.716 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] bstat 2024-03-16T17:50:28.922 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mtab 2024-03-16T17:50:29.107 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] getdevicesize 2024-03-16T17:50:29.250 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] preallo_rw_pattern_reader 2024-03-16T17:50:29.405 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] preallo_rw_pattern_writer 2024-03-16T17:50:29.565 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] ftrunc 2024-03-16T17:50:29.717 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] trunc 2024-03-16T17:50:29.873 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fs_perms 2024-03-16T17:50:30.042 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] testx 2024-03-16T17:50:30.173 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] looptest 2024-03-16T17:50:30.363 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] locktest 2024-03-16T17:50:30.658 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] unwritten_mmap 2024-03-16T17:50:30.851 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] bulkstat_unlink_test 2024-03-16T17:50:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] deduperace 2024-03-16T17:50:31.236 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] bulkstat_unlink_test_modified 2024-03-16T17:50:31.439 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_dir_offset 2024-03-16T17:50:31.586 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_futimens 2024-03-16T17:50:31.712 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_immutable 2024-03-16T17:50:32.298 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] stale_handle 2024-03-16T17:50:32.446 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] pwrite_mmap_blocked 2024-03-16T17:50:32.587 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_dir_offset2 2024-03-16T17:50:32.788 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] seek_sanity_test 2024-03-16T17:50:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] seek_copy_test 2024-03-16T17:50:33.379 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_readdir_1 2024-03-16T17:50:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_readdir_2 2024-03-16T17:50:33.662 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fsync-tester 2024-03-16T17:50:33.912 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] nsexec 2024-03-16T17:50:34.089 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] cloner 2024-03-16T17:50:34.274 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] renameat2 2024-03-16T17:50:34.440 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_getcwd 2024-03-16T17:50:34.586 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] e4compact 2024-03-16T17:50:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] test-nextquota 2024-03-16T17:50:34.965 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] punch-alternating 2024-03-16T17:50:35.141 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] attr-list-by-handle-cursor-test 2024-03-16T17:50:35.311 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] listxattr 2024-03-16T17:50:35.441 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dio-interleaved 2024-03-16T17:50:35.596 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_dir_type 2024-03-16T17:50:35.740 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dio-invalidate-cache 2024-03-16T17:50:35.938 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] stat_test 2024-03-16T17:50:36.210 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_encrypted_d_revalidate 2024-03-16T17:50:36.379 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] attr_replace_test 2024-03-16T17:50:36.545 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] swapon 2024-03-16T17:50:36.693 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] mkswap 2024-03-16T17:50:36.842 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_attr_corruption 2024-03-16T17:50:36.982 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_open_tmpfiles 2024-03-16T17:50:37.175 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fscrypt-crypt-util 2024-03-16T17:50:37.822 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] bulkstat_null_ocount 2024-03-16T17:50:38.004 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] splice-test 2024-03-16T17:50:38.171 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] chprojid_fail 2024-03-16T17:50:38.330 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] detached_mounts_propagation 2024-03-16T17:50:38.518 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] ext4_resize 2024-03-16T17:50:38.649 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_readdir_3 2024-03-16T17:50:38.856 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] splice2pipe 2024-03-16T17:50:39.016 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] uuid_ioctl 2024-03-16T17:50:39.154 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_snapshot_deleted_subvolume 2024-03-16T17:50:39.297 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fiemap-tester 2024-03-16T17:50:39.560 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_stripealign 2024-03-16T17:50:39.712 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] open_by_handle 2024-03-16T17:50:39.948 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dbtest 2024-03-16T17:50:40.197 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_dio 2024-03-16T17:50:40.340 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] xfsfind 2024-03-16T17:50:40.536 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_reflink_read_race 2024-03-16T17:50:40.709 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fssum 2024-03-16T17:50:41.125 INFO:teuthology.orchestra.run.smithi132.stdout:Building log-writes 2024-03-16T17:50:41.130 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] replay-log 2024-03-16T17:50:41.437 INFO:teuthology.orchestra.run.smithi132.stdout:Building perf 2024-03-16T17:50:41.438 INFO:teuthology.orchestra.run.smithi132.stdout:Building aio-dio-regress 2024-03-16T17:50:41.444 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aiocp 2024-03-16T17:50:41.653 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-append-write-fallocate-race 2024-03-16T17:50:41.814 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-append-write-read-race 2024-03-16T17:50:41.976 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-cow-race 2024-03-16T17:50:42.127 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-cycle-write 2024-03-16T17:50:42.333 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-eof-race 2024-03-16T17:50:42.490 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-extend-stat 2024-03-16T17:50:42.664 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-fcntl-race 2024-03-16T17:50:42.805 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-hole-filling-race 2024-03-16T17:50:42.960 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-invalidate-failure 2024-03-16T17:50:43.118 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-invalidate-readahead 2024-03-16T17:50:43.262 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aiodio_sparse2 2024-03-16T17:50:43.470 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-subblock-eof-read 2024-03-16T17:50:43.607 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-write-verify 2024-03-16T17:50:43.820 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-03-16T17:50:43.954 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-03-16T17:50:44.091 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-last-ref-held-by-io 2024-03-16T17:50:44.254 INFO:teuthology.orchestra.run.smithi132.stdout:Building vfs 2024-03-16T17:50:44.259 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] vfstest 2024-03-16T17:50:45.082 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:50:45.085 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:50:47.790 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] mount-idmapped 2024-03-16T17:50:48.140 INFO:teuthology.orchestra.run.smithi132.stdout:Building m4 2024-03-16T17:50:48.143 INFO:teuthology.orchestra.run.smithi132.stdout:Building common 2024-03-16T17:50:48.147 INFO:teuthology.orchestra.run.smithi132.stdout:Building tests 2024-03-16T17:50:48.152 INFO:teuthology.orchestra.run.smithi132.stdout:Building btrfs 2024-03-16T17:50:48.157 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/btrfs/group.list 2024-03-16T17:50:48.218 INFO:teuthology.orchestra.run.smithi132.stdout:Building ceph 2024-03-16T17:50:48.222 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/ceph/group.list 2024-03-16T17:50:48.236 INFO:teuthology.orchestra.run.smithi132.stdout:Building cifs 2024-03-16T17:50:48.241 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/cifs/group.list 2024-03-16T17:50:48.253 INFO:teuthology.orchestra.run.smithi132.stdout:Building ext4 2024-03-16T17:50:48.258 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/ext4/group.list 2024-03-16T17:50:48.294 INFO:teuthology.orchestra.run.smithi132.stdout:Building f2fs 2024-03-16T17:50:48.299 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/f2fs/group.list 2024-03-16T17:50:48.316 INFO:teuthology.orchestra.run.smithi132.stdout:Building generic 2024-03-16T17:50:48.322 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/generic/group.list 2024-03-16T17:50:48.416 INFO:teuthology.orchestra.run.smithi132.stdout:Building nfs 2024-03-16T17:50:48.420 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/nfs/group.list 2024-03-16T17:50:48.435 INFO:teuthology.orchestra.run.smithi132.stdout:Building ocfs2 2024-03-16T17:50:48.439 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/ocfs2/group.list 2024-03-16T17:50:48.452 INFO:teuthology.orchestra.run.smithi132.stdout:Building overlay 2024-03-16T17:50:48.457 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/overlay/group.list 2024-03-16T17:50:48.496 INFO:teuthology.orchestra.run.smithi132.stdout:Building perf 2024-03-16T17:50:48.501 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/perf/group.list 2024-03-16T17:50:48.513 INFO:teuthology.orchestra.run.smithi132.stdout:Building selftest 2024-03-16T17:50:48.517 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/selftest/group.list 2024-03-16T17:50:48.530 INFO:teuthology.orchestra.run.smithi132.stdout:Building shared 2024-03-16T17:50:48.534 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/shared/group.list 2024-03-16T17:50:48.550 INFO:teuthology.orchestra.run.smithi132.stdout:Building tmpfs 2024-03-16T17:50:48.555 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/tmpfs/group.list 2024-03-16T17:50:48.568 INFO:teuthology.orchestra.run.smithi132.stdout:Building udf 2024-03-16T17:50:48.573 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/udf/group.list 2024-03-16T17:50:48.584 INFO:teuthology.orchestra.run.smithi132.stdout:Building xfs 2024-03-16T17:50:48.591 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/xfs/group.list 2024-03-16T17:50:48.686 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo make install) 2024-03-16T17:50:48.723 INFO:teuthology.orchestra.run.smithi132.stdout:Building include 2024-03-16T17:50:48.726 INFO:teuthology.orchestra.run.smithi132.stdout:Building lib 2024-03-16T17:50:48.730 INFO:teuthology.orchestra.run.smithi132.stdout:Building ltp 2024-03-16T17:50:48.734 INFO:teuthology.orchestra.run.smithi132.stdout:Building src 2024-03-16T17:50:48.766 INFO:teuthology.orchestra.run.smithi132.stdout:Building log-writes 2024-03-16T17:50:48.770 INFO:teuthology.orchestra.run.smithi132.stdout:Building perf 2024-03-16T17:50:48.773 INFO:teuthology.orchestra.run.smithi132.stdout:Building aio-dio-regress 2024-03-16T17:50:48.777 INFO:teuthology.orchestra.run.smithi132.stdout:Building vfs 2024-03-16T17:50:48.780 INFO:teuthology.orchestra.run.smithi132.stdout:Building m4 2024-03-16T17:50:48.784 INFO:teuthology.orchestra.run.smithi132.stdout:Building common 2024-03-16T17:50:48.787 INFO:teuthology.orchestra.run.smithi132.stdout:Building tests 2024-03-16T17:50:48.792 INFO:teuthology.orchestra.run.smithi132.stdout:Building btrfs 2024-03-16T17:50:48.798 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/btrfs/group.list 2024-03-16T17:50:48.855 INFO:teuthology.orchestra.run.smithi132.stdout:Building ceph 2024-03-16T17:50:48.860 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/ceph/group.list 2024-03-16T17:50:48.874 INFO:teuthology.orchestra.run.smithi132.stdout:Building cifs 2024-03-16T17:50:48.904 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/cifs/group.list 2024-03-16T17:50:48.904 INFO:teuthology.orchestra.run.smithi132.stdout:Building ext4 2024-03-16T17:50:48.905 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/ext4/group.list 2024-03-16T17:50:48.932 INFO:teuthology.orchestra.run.smithi132.stdout:Building f2fs 2024-03-16T17:50:48.937 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/f2fs/group.list 2024-03-16T17:50:48.953 INFO:teuthology.orchestra.run.smithi132.stdout:Building generic 2024-03-16T17:50:48.960 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/generic/group.list 2024-03-16T17:50:49.054 INFO:teuthology.orchestra.run.smithi132.stdout:Building nfs 2024-03-16T17:50:49.059 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/nfs/group.list 2024-03-16T17:50:49.073 INFO:teuthology.orchestra.run.smithi132.stdout:Building ocfs2 2024-03-16T17:50:49.078 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/ocfs2/group.list 2024-03-16T17:50:49.091 INFO:teuthology.orchestra.run.smithi132.stdout:Building overlay 2024-03-16T17:50:49.096 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/overlay/group.list 2024-03-16T17:50:49.135 INFO:teuthology.orchestra.run.smithi132.stdout:Building perf 2024-03-16T17:50:49.139 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/perf/group.list 2024-03-16T17:50:49.151 INFO:teuthology.orchestra.run.smithi132.stdout:Building selftest 2024-03-16T17:50:49.156 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/selftest/group.list 2024-03-16T17:50:49.168 INFO:teuthology.orchestra.run.smithi132.stdout:Building shared 2024-03-16T17:50:49.173 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/shared/group.list 2024-03-16T17:50:49.189 INFO:teuthology.orchestra.run.smithi132.stdout:Building tmpfs 2024-03-16T17:50:49.194 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/tmpfs/group.list 2024-03-16T17:50:49.207 INFO:teuthology.orchestra.run.smithi132.stdout:Building udf 2024-03-16T17:50:49.212 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/udf/group.list 2024-03-16T17:50:49.223 INFO:teuthology.orchestra.run.smithi132.stdout:Building xfs 2024-03-16T17:50:49.229 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/xfs/group.list 2024-03-16T17:50:49.326 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-03-16T17:50:49.327 INFO:teuthology.orchestra.run.smithi132.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-16T17:50:49.327 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-03-16T17:50:49.330 INFO:teuthology.orchestra.run.smithi132.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-16T17:50:49.330 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-03-16T17:50:49.332 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-03-16T17:50:49.340 INFO:teuthology.orchestra.run.smithi132.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-03-16T17:50:49.405 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-03-16T17:50:49.414 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-03-16T17:50:49.430 INFO:teuthology.orchestra.run.smithi132.stdout:Building log-writes 2024-03-16T17:50:49.433 INFO:teuthology.orchestra.run.smithi132.stdout:Building perf 2024-03-16T17:50:49.437 INFO:teuthology.orchestra.run.smithi132.stdout:Building aio-dio-regress 2024-03-16T17:50:49.440 INFO:teuthology.orchestra.run.smithi132.stdout:Building vfs 2024-03-16T17:50:49.446 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake -C log-writes install 2024-03-16T17:50:49.446 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-03-16T17:50:49.453 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-03-16T17:50:49.461 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake -C perf install 2024-03-16T17:50:49.462 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-03-16T17:50:49.470 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-03-16T17:50:49.490 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-03-16T17:50:49.492 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-03-16T17:50:49.500 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-03-16T17:50:49.546 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake -C vfs install 2024-03-16T17:50:49.547 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-03-16T17:50:49.556 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-03-16T17:50:49.568 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-03-16T17:50:49.576 INFO:teuthology.orchestra.run.smithi132.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-03-16T17:50:50.697 INFO:teuthology.orchestra.run.smithi132.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-03-16T17:50:50.789 INFO:teuthology.orchestra.run.smithi132.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-03-16T17:50:50.821 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-03-16T17:50:50.822 INFO:teuthology.orchestra.run.smithi132.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-16T17:50:50.822 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-03-16T17:50:50.824 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-03-16T17:50:50.832 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-03-16T17:50:50.956 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-03-16T17:50:50.958 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/btrfs/ install 2024-03-16T17:50:50.961 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-03-16T17:50:50.970 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 304 305 306 307 308 309 310 /var/lib/xfstests/tests/btrfs 2024-03-16T17:50:51.713 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-03-16T17:50:51.721 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out /var/lib/xfstests/tests/btrfs 2024-03-16T17:50:52.472 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/ceph/ install 2024-03-16T17:50:52.474 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-03-16T17:50:52.482 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-03-16T17:50:52.499 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-03-16T17:50:52.507 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-03-16T17:50:52.525 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/cifs/ install 2024-03-16T17:50:52.526 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-03-16T17:50:52.534 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-03-16T17:50:52.542 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-03-16T17:50:52.550 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-03-16T17:50:52.558 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/ext4/ install 2024-03-16T17:50:52.560 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-03-16T17:50:52.568 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-03-16T17:50:52.734 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-03-16T17:50:52.742 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-03-16T17:50:52.917 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/f2fs/ install 2024-03-16T17:50:52.919 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-03-16T17:50:52.927 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-03-16T17:50:52.937 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-03-16T17:50:52.947 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-03-16T17:50:52.957 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/generic/ install 2024-03-16T17:50:52.962 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-03-16T17:50:52.971 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-03-16T17:50:54.747 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-03-16T17:50:54.755 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-03-16T17:50:56.604 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/nfs/ install 2024-03-16T17:50:56.606 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-03-16T17:50:56.614 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-03-16T17:50:56.622 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-03-16T17:50:56.631 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-03-16T17:50:56.638 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/ocfs2/ install 2024-03-16T17:50:56.640 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-03-16T17:50:56.648 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-03-16T17:50:56.657 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-03-16T17:50:56.665 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-03-16T17:50:56.673 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/overlay/ install 2024-03-16T17:50:56.675 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-03-16T17:50:56.683 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-03-16T17:50:56.936 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-03-16T17:50:56.943 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-03-16T17:50:57.198 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/perf/ install 2024-03-16T17:50:57.200 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-03-16T17:50:57.208 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-03-16T17:50:57.216 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-03-16T17:50:57.225 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-03-16T17:50:57.232 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/selftest/ install 2024-03-16T17:50:57.234 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-03-16T17:50:57.242 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-03-16T17:50:57.262 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-03-16T17:50:57.271 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-03-16T17:50:57.290 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/shared/ install 2024-03-16T17:50:57.292 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-03-16T17:50:57.300 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-03-16T17:50:57.313 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-03-16T17:50:57.321 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-03-16T17:50:57.334 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/tmpfs/ install 2024-03-16T17:50:57.336 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-03-16T17:50:57.344 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-03-16T17:50:57.351 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-03-16T17:50:57.360 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-03-16T17:50:57.368 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/udf/ install 2024-03-16T17:50:57.370 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-03-16T17:50:57.378 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-03-16T17:50:57.386 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-03-16T17:50:57.394 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-03-16T17:50:57.402 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.elA9P9Bv3mxfstests-dev/tests/xfs/ install 2024-03-16T17:50:57.407 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-03-16T17:50:57.416 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-03-16T17:50:59.104 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-03-16T17:50:59.112 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-03-16T17:51:00.843 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-03-16T17:51:00.851 INFO:teuthology.orchestra.run.smithi132.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-03-16T17:51:00.859 INFO:teuthology.orchestra.run.smithi132.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-03-16T17:51:00.867 INFO:teuthology.orchestra.run.smithi132.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-03-16T17:51:00.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-16T17:51:00.878 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec ls tests/generic) 2024-03-16T17:51:00.935 INFO:teuthology.orchestra.run.smithi132.stdout:001 2024-03-16T17:51:00.935 INFO:teuthology.orchestra.run.smithi132.stdout:001.out 2024-03-16T17:51:00.935 INFO:teuthology.orchestra.run.smithi132.stdout:002 2024-03-16T17:51:00.935 INFO:teuthology.orchestra.run.smithi132.stdout:002.out 2024-03-16T17:51:00.935 INFO:teuthology.orchestra.run.smithi132.stdout:003 2024-03-16T17:51:00.935 INFO:teuthology.orchestra.run.smithi132.stdout:003.out 2024-03-16T17:51:00.935 INFO:teuthology.orchestra.run.smithi132.stdout:004 2024-03-16T17:51:00.935 INFO:teuthology.orchestra.run.smithi132.stdout:004.out 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:005 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:005.out 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:006 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:006.out 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:007 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:007.out 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:008 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:008.out 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:009 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:009.out 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:010 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:010.out 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:011 2024-03-16T17:51:00.936 INFO:teuthology.orchestra.run.smithi132.stdout:011.out 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:012 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:012.out 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:013 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:013.out 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:014 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:014.out 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:015 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:015.out 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:016 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:016.out 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:017 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:017.out 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:018 2024-03-16T17:51:00.937 INFO:teuthology.orchestra.run.smithi132.stdout:018.out 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:019 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:019.out 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:020 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:020.out 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:021 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:021.out 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:022 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:022.out 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:023 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:023.out 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:024 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:024.out 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:025 2024-03-16T17:51:00.938 INFO:teuthology.orchestra.run.smithi132.stdout:025.out 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:026 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:026.out 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:027 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:027.out 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:028 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:028.out 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:029 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:029.out 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:030 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:030.out 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:031 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:031.out 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:032 2024-03-16T17:51:00.939 INFO:teuthology.orchestra.run.smithi132.stdout:032.out 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:033 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:033.out 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:034 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:034.out 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:035 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:035.cfg 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:035.out.default 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:035.out.nfs 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:036 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:036.out 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:037 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:037.out 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:038 2024-03-16T17:51:00.940 INFO:teuthology.orchestra.run.smithi132.stdout:038.out 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:039 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:039.out 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:040 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:040.out 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:041 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:041.out 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:042 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:042.out 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:043 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:043.out 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:044 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:044.out 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:045 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:045.out 2024-03-16T17:51:00.941 INFO:teuthology.orchestra.run.smithi132.stdout:046 2024-03-16T17:51:00.942 INFO:teuthology.orchestra.run.smithi132.stdout:046.out 2024-03-16T17:51:00.942 INFO:teuthology.orchestra.run.smithi132.stdout:047 2024-03-16T17:51:00.942 INFO:teuthology.orchestra.run.smithi132.stdout:047.out 2024-03-16T17:51:00.942 INFO:teuthology.orchestra.run.smithi132.stdout:048 2024-03-16T17:51:00.942 INFO:teuthology.orchestra.run.smithi132.stdout:048.out 2024-03-16T17:51:00.942 INFO:teuthology.orchestra.run.smithi132.stdout:049 2024-03-16T17:51:00.942 INFO:teuthology.orchestra.run.smithi132.stdout:049.out 2024-03-16T17:51:00.942 INFO:teuthology.orchestra.run.smithi132.stdout:050 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:050.cfg 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:050.out.default 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:050.out.nojournal 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:050.out.xfsquota 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:051 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:051.out 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:052 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:052.out 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:053 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:053.out 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:054 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:054.out 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:055 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:055.out 2024-03-16T17:51:00.943 INFO:teuthology.orchestra.run.smithi132.stdout:056 2024-03-16T17:51:00.944 INFO:teuthology.orchestra.run.smithi132.stdout:056.out 2024-03-16T17:51:00.944 INFO:teuthology.orchestra.run.smithi132.stdout:057 2024-03-16T17:51:00.944 INFO:teuthology.orchestra.run.smithi132.stdout:057.out 2024-03-16T17:51:00.945 INFO:teuthology.orchestra.run.smithi132.stdout:058 2024-03-16T17:51:00.945 INFO:teuthology.orchestra.run.smithi132.stdout:058.out 2024-03-16T17:51:00.945 INFO:teuthology.orchestra.run.smithi132.stdout:059 2024-03-16T17:51:00.945 INFO:teuthology.orchestra.run.smithi132.stdout:059.out 2024-03-16T17:51:00.945 INFO:teuthology.orchestra.run.smithi132.stdout:060 2024-03-16T17:51:00.945 INFO:teuthology.orchestra.run.smithi132.stdout:060.out 2024-03-16T17:51:00.945 INFO:teuthology.orchestra.run.smithi132.stdout:061 2024-03-16T17:51:00.945 INFO:teuthology.orchestra.run.smithi132.stdout:061.out 2024-03-16T17:51:00.945 INFO:teuthology.orchestra.run.smithi132.stdout:062 2024-03-16T17:51:00.945 INFO:teuthology.orchestra.run.smithi132.stdout:062.out 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:063 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:063.out 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:064 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:064.out 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:065 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:065.out 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:066 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:066.out 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:067 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:067.out 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:068 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:068.out 2024-03-16T17:51:00.946 INFO:teuthology.orchestra.run.smithi132.stdout:069 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:069.out 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:070 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:070.out 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:071 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:071.out 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:072 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:072.out 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:073 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:073.out 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:074 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:074.out 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:075 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:075.out 2024-03-16T17:51:00.947 INFO:teuthology.orchestra.run.smithi132.stdout:076 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:076.out 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:077 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:077.out 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:078 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:078.out 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:079 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:079.out 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:080 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:080.out 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:081 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:081.out 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:082 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:082.out 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:083 2024-03-16T17:51:00.948 INFO:teuthology.orchestra.run.smithi132.stdout:083.out 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:084 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:084.out 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:085 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:085.out 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:086 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:086.out 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:087 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:087.out 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:088 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:088.out 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:089 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:089.out 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:090 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:090.out 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:091 2024-03-16T17:51:00.949 INFO:teuthology.orchestra.run.smithi132.stdout:091.out 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:092 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:092.out 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:093 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:093.out 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:094 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:094.out 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:095 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:095.out 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:096 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:096.out 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:097 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:097.out 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:098 2024-03-16T17:51:00.950 INFO:teuthology.orchestra.run.smithi132.stdout:098.out 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:099 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:099.out 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:100 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:100.out 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:101 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:101.out 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:102 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:102.out 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:103 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:103.out 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:104 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:104.out 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:105 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:105.out 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:106 2024-03-16T17:51:00.951 INFO:teuthology.orchestra.run.smithi132.stdout:106.out 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:107 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:107.out 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:108 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:108.out 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:109 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:109.out 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:110 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:110.out 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:111 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:111.out 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:112 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:112.out 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:113 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:113.out 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:114 2024-03-16T17:51:00.952 INFO:teuthology.orchestra.run.smithi132.stdout:114.out 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:115 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:115.out 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:116 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:116.out 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:117 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:117.out 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:118 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:118.out 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:119 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:119.out 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:120 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:120.out 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:121 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:121.out 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:122 2024-03-16T17:51:00.953 INFO:teuthology.orchestra.run.smithi132.stdout:122.out 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:123 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:123.out 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:124 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:124.out 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:125 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:125.out 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:126 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:126.out 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:127 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:127.out 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:128 2024-03-16T17:51:00.954 INFO:teuthology.orchestra.run.smithi132.stdout:128.out 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:129 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:129.out 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:130 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:130.out 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:131 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:131.out 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:132 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:132.out 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:133 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:133.out 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:134 2024-03-16T17:51:00.955 INFO:teuthology.orchestra.run.smithi132.stdout:134.out 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:135 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:135.out 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:136 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:136.out 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:137 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:137.out 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:138 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:138.out 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:139 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:139.out 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:140 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:140.out 2024-03-16T17:51:00.956 INFO:teuthology.orchestra.run.smithi132.stdout:141 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:141.out 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:142 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:142.out 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:143 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:143.out 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:144 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:144.out 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:145 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:145.out 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:146 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:146.out 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:147 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:147.out 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:148 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:148.out 2024-03-16T17:51:00.957 INFO:teuthology.orchestra.run.smithi132.stdout:149 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:149.out 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:150 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:150.out 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:151 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:151.out 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:152 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:152.out 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:153 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:153.out 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:154 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:154.out 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:155 2024-03-16T17:51:00.958 INFO:teuthology.orchestra.run.smithi132.stdout:155.out 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:156 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:156.out 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:157 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:157.out 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:158 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:158.out 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:159 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:159.out 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:160 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:160.out 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:161 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:161.out 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:162 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:162.out 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:163 2024-03-16T17:51:00.959 INFO:teuthology.orchestra.run.smithi132.stdout:163.out 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:164 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:164.out 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:165 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:165.out 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:166 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:166.out 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:167 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:167.out 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:168 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:168.out 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:169 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:169.out 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:170 2024-03-16T17:51:00.960 INFO:teuthology.orchestra.run.smithi132.stdout:170.out 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:171 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:171.out 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:172 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:172.out 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:173 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:173.out 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:174 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:174.out 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:175 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:175.out 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:176 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:176.out 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:177 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:177.out 2024-03-16T17:51:00.961 INFO:teuthology.orchestra.run.smithi132.stdout:178 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:178.out 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:179 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:179.out 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:180 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:180.out 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:181 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:181.out 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:182 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:182.out 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:183 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:183.out 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:184 2024-03-16T17:51:00.962 INFO:teuthology.orchestra.run.smithi132.stdout:184.out 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:185 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:185.out 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:186 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:186.out 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:187 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:187.out 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:188 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:188.out 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:189 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:189.out 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:190 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:190.out 2024-03-16T17:51:00.963 INFO:teuthology.orchestra.run.smithi132.stdout:191 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:191.out 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:192 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:192.out 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:193 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:193.out 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:194 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:194.out 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:195 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:195.out 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:196 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:196.out 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:197 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:197.out 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:198 2024-03-16T17:51:00.964 INFO:teuthology.orchestra.run.smithi132.stdout:198.out 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:199 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:199.out 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:200 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:200.out 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:201 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:201.out 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:202 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:202.out 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:203 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:203.out 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:204 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:204.out 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:205 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:205.out 2024-03-16T17:51:00.965 INFO:teuthology.orchestra.run.smithi132.stdout:206 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:206.out 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:207 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:207.out 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:208 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:208.out 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:209 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:209.out 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:210 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:210.out 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:211 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:211.out 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:212 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:212.out 2024-03-16T17:51:00.966 INFO:teuthology.orchestra.run.smithi132.stdout:213 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:213.out 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:214 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:214.out 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:215 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:215.out 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:216 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:216.out 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:217 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:217.out 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:218 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:218.out 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:219 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:219.out 2024-03-16T17:51:00.967 INFO:teuthology.orchestra.run.smithi132.stdout:220 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:220.out 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:221 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:221.out 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:222 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:222.out 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:223 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:223.out 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:224 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:224.out 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:225 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:225.out 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:226 2024-03-16T17:51:00.968 INFO:teuthology.orchestra.run.smithi132.stdout:226.out 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:227 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:227.out 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:228 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:228.out 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:229 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:229.out 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:230 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:230.out 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:231 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:231.out 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:232 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:232.out 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:233 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:233.out 2024-03-16T17:51:00.969 INFO:teuthology.orchestra.run.smithi132.stdout:234 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:234.out 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:235 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:235.out 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:236 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:236.out 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:237 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:237.out 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:238 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:238.out 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:239 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:239.out 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:240 2024-03-16T17:51:00.970 INFO:teuthology.orchestra.run.smithi132.stdout:240.out 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:241 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:241.out 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:242 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:242.out 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:243 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:243.out 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:244 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:244.out 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:245 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:245.out 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:246 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:246.out 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:247 2024-03-16T17:51:00.971 INFO:teuthology.orchestra.run.smithi132.stdout:247.out 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:248 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:248.out 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:249 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:249.out 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:250 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:250.out 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:251 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:251.out 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:252 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:252.out 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:253 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:253.out 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:254 2024-03-16T17:51:00.972 INFO:teuthology.orchestra.run.smithi132.stdout:254.out 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:255 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:255.out 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:256 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:256.out 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:257 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:257.out 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:258 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:258.out 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:259 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:259.out 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:260 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:260.out 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:261 2024-03-16T17:51:00.973 INFO:teuthology.orchestra.run.smithi132.stdout:261.out 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:262 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:262.out 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:263 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:263.out 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:264 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:264.out 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:265 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:265.out 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:266 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:266.out 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:267 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:267.out 2024-03-16T17:51:00.974 INFO:teuthology.orchestra.run.smithi132.stdout:268 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:268.out 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:269 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:269.out 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:270 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:270.out 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:271 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:271.out 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:272 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:272.out 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:273 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:273.out 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:274 2024-03-16T17:51:00.975 INFO:teuthology.orchestra.run.smithi132.stdout:274.out 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:275 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:275.out 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:276 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:276.out 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:277 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:277.out 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:278 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:278.out 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:279 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:279.out 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:280 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:280.out 2024-03-16T17:51:00.976 INFO:teuthology.orchestra.run.smithi132.stdout:281 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:281.out 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:282 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:282.out 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:283 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:283.out 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:284 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:284.out 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:285 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:285.out 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:286 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:286.out 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:287 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:287.out 2024-03-16T17:51:00.977 INFO:teuthology.orchestra.run.smithi132.stdout:288 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:288.out 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:289 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:289.out 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:290 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:290.out 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:291 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:291.out 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:292 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:292.out 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:293 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:293.out 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:294 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:294.out 2024-03-16T17:51:00.978 INFO:teuthology.orchestra.run.smithi132.stdout:295 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:295.out 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:296 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:296.out 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:297 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:297.out 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:298 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:298.out 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:299 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:299.out 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:300 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:300.out 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:301 2024-03-16T17:51:00.979 INFO:teuthology.orchestra.run.smithi132.stdout:301.out 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:302 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:302.out 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:303 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:303.out 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:304 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:304.out 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:305 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:305.out 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:306 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:306.out 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:307 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:307.out 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:308 2024-03-16T17:51:00.980 INFO:teuthology.orchestra.run.smithi132.stdout:308.out 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:309 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:309.out 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:310 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:310.out 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:311 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:311.out 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:312 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:312.out 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:313 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:313.out 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:314 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:314.out 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:315 2024-03-16T17:51:00.981 INFO:teuthology.orchestra.run.smithi132.stdout:315.out 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:316 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:316.out 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:317 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:317.out 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:318 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:318.out 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:319 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:319.out 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:320 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:320.out 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:321 2024-03-16T17:51:00.982 INFO:teuthology.orchestra.run.smithi132.stdout:321.out 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:322 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:322.out 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:323 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:323.out 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:324 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:324.out 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:325 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:325.out 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:326 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:326.out 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:327 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:327.out 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:328 2024-03-16T17:51:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:328.out 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:329 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:329.out 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:330 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:330.out 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:331 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:331.out 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:332 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:332.out 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:333 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:333.out 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:334 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:334.out 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:335 2024-03-16T17:51:00.984 INFO:teuthology.orchestra.run.smithi132.stdout:335.out 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:336 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:336.out 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:337 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:337.out 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:338 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:338.out 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:339 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:339.out 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:340 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:340.out 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:341 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:341.out 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:342 2024-03-16T17:51:00.985 INFO:teuthology.orchestra.run.smithi132.stdout:342.out 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:343 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:343.out 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:344 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:344.out 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:345 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:345.out 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:346 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:346.out 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:347 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:347.out 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:348 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:348.out 2024-03-16T17:51:00.986 INFO:teuthology.orchestra.run.smithi132.stdout:349 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:349.out 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:350 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:350.out 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:351 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:351.out 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:352 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:352.out 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:353 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:353.out 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:354 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:354.out 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:355 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:355.out 2024-03-16T17:51:00.987 INFO:teuthology.orchestra.run.smithi132.stdout:356 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:356.out 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:357 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:357.out 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:358 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:358.out 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:359 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:359.out 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:360 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:360.out 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:361 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:361.out 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:362 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:362.out 2024-03-16T17:51:00.988 INFO:teuthology.orchestra.run.smithi132.stdout:363 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:363.out 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:364 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:364.out 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:365 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:365.out 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:366 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:366.out 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:367 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:367.out 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:368 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:368.out 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:369 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:369.out 2024-03-16T17:51:00.989 INFO:teuthology.orchestra.run.smithi132.stdout:370 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:370.out 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:371 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:371.out 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:372 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:372.out 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:373 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:373.out 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:374 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:374.out 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:375 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:375.out 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:376 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:376.out 2024-03-16T17:51:00.990 INFO:teuthology.orchestra.run.smithi132.stdout:377 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:377.out 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:378 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:378.out 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:379 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:379.out 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:380 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:380.out 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:381 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:381.out 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:382 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:382.out 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:383 2024-03-16T17:51:00.991 INFO:teuthology.orchestra.run.smithi132.stdout:383.out 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:384 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:384.out 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:385 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:385.out 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:386 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:386.out 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:387 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:387.out 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:388 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:388.out 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:389 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:389.out 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:390 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:390.out 2024-03-16T17:51:00.992 INFO:teuthology.orchestra.run.smithi132.stdout:391 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:391.out 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:392 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:392.out 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:393 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:393.out 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:394 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:394.out 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:395 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:395.out 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:396 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:396.out 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:397 2024-03-16T17:51:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:397.out 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:398 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:398.out 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:399 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:399.out 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:400 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:400.out 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:401 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:401.out 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:402 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:402.out 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:403 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:403.out 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:404 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:404.out 2024-03-16T17:51:00.994 INFO:teuthology.orchestra.run.smithi132.stdout:405 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:405.out 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:406 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:406.out 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:407 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:407.out 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:408 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:408.out 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:409 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:409.out 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:410 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:410.out 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:411 2024-03-16T17:51:00.995 INFO:teuthology.orchestra.run.smithi132.stdout:411.out 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:412 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:412.out 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:413 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:413.out 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:414 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:414.out 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:415 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:415.out 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:416 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:416.out 2024-03-16T17:51:00.996 INFO:teuthology.orchestra.run.smithi132.stdout:417 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:417.out 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:418 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:418.out 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:419 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:419.out 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:420 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:420.out 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:421 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:421.out 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:422 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:422.out 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:423 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:423.out 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:424 2024-03-16T17:51:00.997 INFO:teuthology.orchestra.run.smithi132.stdout:424.out 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:425 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:425.out 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:426 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:426.out 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:427 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:427.out 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:428 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:428.out 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:429 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:429.out 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:430 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:430.out 2024-03-16T17:51:00.998 INFO:teuthology.orchestra.run.smithi132.stdout:431 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:431.out 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:432 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:432.out 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:433 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:433.out 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:434 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:434.out 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:435 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:435.out 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:436 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:436.out 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:437 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:437.out 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:438 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:438.out 2024-03-16T17:51:00.999 INFO:teuthology.orchestra.run.smithi132.stdout:439 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:439.out 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:440 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:440.out 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:441 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:441.out 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:442 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:442.out 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:443 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:443.out 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:444 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:444.out 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:445 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:445.out 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:446 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:446.out 2024-03-16T17:51:01.000 INFO:teuthology.orchestra.run.smithi132.stdout:447 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:447.out 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:448 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:448.out 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:449 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:449.out 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:450 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:450.out 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:451 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:451.out 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:452 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:452.out 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:453 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:453.out 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:454 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:454.out 2024-03-16T17:51:01.001 INFO:teuthology.orchestra.run.smithi132.stdout:455 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:455.out 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:456 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:456.out 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:457 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:457.out 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:458 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:458.out 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:459 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:459.out 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:460 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:460.out 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:461 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:461.out 2024-03-16T17:51:01.002 INFO:teuthology.orchestra.run.smithi132.stdout:462 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:462.out 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:463 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:463.out 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:464 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:464.out 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:465 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:465.out 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:466 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:466.out 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:467 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:467.out 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:468 2024-03-16T17:51:01.003 INFO:teuthology.orchestra.run.smithi132.stdout:468.out 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:469 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:469.out 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:470 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:470.out 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:471 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:471.out 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:472 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:472.out 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:473 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:473.out 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:474 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:474.out 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:475 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:475.out 2024-03-16T17:51:01.004 INFO:teuthology.orchestra.run.smithi132.stdout:476 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:476.out 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:477 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:477.out 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:478 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:478.out 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:479 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:479.out 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:480 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:480.out 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:481 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:481.out 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:482 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:482.out 2024-03-16T17:51:01.005 INFO:teuthology.orchestra.run.smithi132.stdout:483 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:483.out 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:484 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:484.out 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:485 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:485.out 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:486 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:486.out 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:487 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:487.out 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:488 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:488.out 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:489 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:489.out 2024-03-16T17:51:01.006 INFO:teuthology.orchestra.run.smithi132.stdout:490 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:490.out 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:491 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:491.out 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:492 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:492.out 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:493 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:493.out 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:494 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:494.out 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:495 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:495.out 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:496 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:496.out 2024-03-16T17:51:01.007 INFO:teuthology.orchestra.run.smithi132.stdout:497 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:497.out 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:498 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:498.out 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:499 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:499.out 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:500 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:500.out 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:501 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:501.out 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:502 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:502.out 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:503 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:503.out 2024-03-16T17:51:01.008 INFO:teuthology.orchestra.run.smithi132.stdout:504 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:504.out 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:505 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:505.out 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:506 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:506.out 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:507 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:507.out 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:508 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:508.out 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:509 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:509.out 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:510 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:510.out 2024-03-16T17:51:01.009 INFO:teuthology.orchestra.run.smithi132.stdout:511 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:511.out 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:512 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:512.out 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:513 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:513.out 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:514 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:514.out 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:515 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:515.out 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:516 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:516.out 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:517 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:517.out 2024-03-16T17:51:01.010 INFO:teuthology.orchestra.run.smithi132.stdout:518 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:518.out 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:519 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:519.out 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:520 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:520.out 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:521 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:521.out 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:522 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:522.out 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:523 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:523.out 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:524 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:524.out 2024-03-16T17:51:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:525 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:525.out 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:526 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:526.out 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:527 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:527.out 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:528 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:528.out 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:529 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:529.out 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:530 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:530.out 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:531 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:531.out 2024-03-16T17:51:01.012 INFO:teuthology.orchestra.run.smithi132.stdout:532 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:532.out 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:533 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:533.out 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:534 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:534.out 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:535 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:535.out 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:536 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:536.out 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:537 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:537.out 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:538 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:538.out 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:539 2024-03-16T17:51:01.013 INFO:teuthology.orchestra.run.smithi132.stdout:539.out 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:540 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:540.out 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:541 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:541.out 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:542 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:542.out 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:543 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:543.out 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:544 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:544.out 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:545 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:545.out 2024-03-16T17:51:01.014 INFO:teuthology.orchestra.run.smithi132.stdout:546 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:546.out 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:547 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:547.out 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:548 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:548.out 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:549 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:549.out 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:550 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:550.out 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:551 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:551.out 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:552 2024-03-16T17:51:01.015 INFO:teuthology.orchestra.run.smithi132.stdout:552.out 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:553 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:553.out 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:554 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:554.out 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:555 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:555.out 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:556 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:556.out 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:557 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:557.out 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:558 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:558.out 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:559 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:559.out 2024-03-16T17:51:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:560 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:560.out 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:561 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:561.out 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:562 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:562.out 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:563 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:563.out 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:564 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:564.out 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:565 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:565.out 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:566 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:566.out 2024-03-16T17:51:01.017 INFO:teuthology.orchestra.run.smithi132.stdout:567 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:567.out 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:568 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:568.out 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:569 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:569.out 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:570 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:570.out 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:571 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:571.out 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:572 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:572.out 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:573 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:573.out 2024-03-16T17:51:01.018 INFO:teuthology.orchestra.run.smithi132.stdout:574 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:574.out 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:575 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:575.out 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:576 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:576.out 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:577 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:577.out 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:578 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:578.out 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:579 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:579.out 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:580 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:580.out 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:581 2024-03-16T17:51:01.019 INFO:teuthology.orchestra.run.smithi132.stdout:581.out 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:582 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:582.out 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:583 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:583.out 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:584 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:584.out 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:585 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:585.out 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:586 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:586.out 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:587 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:587.out 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:588 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:588.out 2024-03-16T17:51:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:589 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:589.out 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:590 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:590.out 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:591 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:591.out 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:592 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:592.out 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:593 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:593.out 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:594 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:594.out 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:595 2024-03-16T17:51:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:595.out 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:596 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:596.out 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:597 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:597.out 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:598 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:598.out 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:599 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:599.out 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:600 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:600.out 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:601 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:601.out 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:602 2024-03-16T17:51:01.022 INFO:teuthology.orchestra.run.smithi132.stdout:602.out 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:603 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:603.out 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:604 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:604.out 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:605 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:605.out 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:606 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:606.out 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:607 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:607.out 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:608 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:608.out 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:609 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:609.out 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:610 2024-03-16T17:51:01.023 INFO:teuthology.orchestra.run.smithi132.stdout:610.out 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:611 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:611.out 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:612 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:612.out 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:613 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:613.out 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:614 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:614.out 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:615 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:615.out 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:616 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:616.out 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:617 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:617.out 2024-03-16T17:51:01.024 INFO:teuthology.orchestra.run.smithi132.stdout:618 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:618.out 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:619 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:619.out 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:620 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:620.out 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:621 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:621.out 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:622 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:622.out 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:623 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:623.out 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:624 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:624.out 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:625 2024-03-16T17:51:01.025 INFO:teuthology.orchestra.run.smithi132.stdout:625.out 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:626 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:626.out 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:627 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:627.out 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:628 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:628.out 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:629 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:629.out 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:630 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:630.out 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:631 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:631.out 2024-03-16T17:51:01.026 INFO:teuthology.orchestra.run.smithi132.stdout:632 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:632.out 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:633 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:633.out 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:634 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:634.out 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:635 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:635.out 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:636 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:636.out 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:637 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:637.out 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:638 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:638.out 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:639 2024-03-16T17:51:01.027 INFO:teuthology.orchestra.run.smithi132.stdout:639.out 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:640 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:640.out 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:641 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:641.out 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:642 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:642.out 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:643 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:643.out 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:644 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:644.out 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:645 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:645.out 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:646 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:646.out 2024-03-16T17:51:01.028 INFO:teuthology.orchestra.run.smithi132.stdout:647 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:647.out 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:648 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:648.out 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:649 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:649.out 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:650 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:650.out 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:651 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:651.out 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:652 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:652.out 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:653 2024-03-16T17:51:01.029 INFO:teuthology.orchestra.run.smithi132.stdout:653.out 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:654 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:654.out 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:655 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:655.out 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:656 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:656.out 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:657 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:657.out 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:658 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:658.out 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:659 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:659.out 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:660 2024-03-16T17:51:01.030 INFO:teuthology.orchestra.run.smithi132.stdout:660.out 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:661 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:661.out 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:662 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:662.out 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:663 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:663.out 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:664 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:664.out 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:665 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:665.out 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:666 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:666.out 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:667 2024-03-16T17:51:01.031 INFO:teuthology.orchestra.run.smithi132.stdout:667.out 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:668 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:668.out 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:669 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:669.out 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:670 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:670.out 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:671 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:671.out 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:672 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:672.out 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:673 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:673.out 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:674 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:674.out 2024-03-16T17:51:01.032 INFO:teuthology.orchestra.run.smithi132.stdout:675 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:675.out 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:676 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:676.out 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:677 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:677.out 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:678 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:678.out 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:679 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:679.out 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:680 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:680.out 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:681 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:681.out 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:682 2024-03-16T17:51:01.033 INFO:teuthology.orchestra.run.smithi132.stdout:682.out 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:683 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:683.out 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:684 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:684.out 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:685 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:685.out 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:686 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:686.out 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:687 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:687.out 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:688 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:688.out 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:689 2024-03-16T17:51:01.034 INFO:teuthology.orchestra.run.smithi132.stdout:689.out 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:690 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:690.out 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:691 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:691.out 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:692 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:692.out 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:693 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:693.out 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:694 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:694.out 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:695 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:695.out 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:696 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:696.out 2024-03-16T17:51:01.035 INFO:teuthology.orchestra.run.smithi132.stdout:697 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:697.out 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:698 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:698.out 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:699 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:699.out 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:700 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:700.out 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:701 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:701.out 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:702 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:702.out 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:703 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:703.out 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:704 2024-03-16T17:51:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:704.out 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:705 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:705.out 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:706 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:706.out 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:707 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:707.out 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:708 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:708.out 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:709 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:709.out 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:710 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:710.out 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:711 2024-03-16T17:51:01.037 INFO:teuthology.orchestra.run.smithi132.stdout:711.out 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:712 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:712.out 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:713 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:713.out 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:714 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:714.out 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:715 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:715.out 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:716 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:716.out 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:717 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:717.out 2024-03-16T17:51:01.038 INFO:teuthology.orchestra.run.smithi132.stdout:718 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:718.out 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:719 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:719.out 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:720 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:720.out 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:721 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:721.out 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:722 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:722.out 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:723 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:723.out 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:724 2024-03-16T17:51:01.039 INFO:teuthology.orchestra.run.smithi132.stdout:724.out 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:725 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:725.out 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:726 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:726.out 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:727 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:727.out 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:728 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:728.out 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:729 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:729.out 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:730 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:730.out 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:731 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:731.out 2024-03-16T17:51:01.040 INFO:teuthology.orchestra.run.smithi132.stdout:732 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:732.out 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:733 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:733.out 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:734 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:734.out 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:735 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:735.out 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:736 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:736.out 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:737 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:737.out 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:738 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:738.out 2024-03-16T17:51:01.041 INFO:teuthology.orchestra.run.smithi132.stdout:739 2024-03-16T17:51:01.042 INFO:teuthology.orchestra.run.smithi132.stdout:739.out 2024-03-16T17:51:01.042 INFO:teuthology.orchestra.run.smithi132.stdout:group.list 2024-03-16T17:51:01.042 INFO:teuthology.orchestra.run.smithi132.stdout:Makefile 2024-03-16T17:51:01.042 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-03-16T17:51:01.233 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:51:01.236 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:51:01.237 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:51:01.238 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:51:01.238 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:04.979 INFO:teuthology.orchestra.run.smithi132.stdout:generic/001 3s 2024-03-16T17:51:04.984 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/001 2024-03-16T17:51:04.985 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:51:04.987 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:05.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:51:05.267 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-03-16T17:51:05.450 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:51:05.454 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:51:05.455 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:51:05.456 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:51:05.456 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:05.801 INFO:teuthology.orchestra.run.smithi132.stdout:generic/002 0s 2024-03-16T17:51:05.807 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/002 2024-03-16T17:51:05.807 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:51:05.809 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:05.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:51:05.869 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-03-16T17:51:06.165 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:51:06.168 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:51:06.168 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:51:06.169 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:51:06.169 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:06.378 INFO:teuthology.orchestra.run.smithi132.stdout:generic/003 [not run] atime not maintained by ceph 2024-03-16T17:51:06.382 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/003 2024-03-16T17:51:06.382 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/003 2024-03-16T17:51:06.382 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:51:06.384 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:06.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:51:06.395 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-03-16T17:51:06.584 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:51:06.588 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:51:06.588 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:51:06.589 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:51:06.589 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:06.807 INFO:teuthology.orchestra.run.smithi132.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-03-16T17:51:06.811 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/004 2024-03-16T17:51:06.811 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/004 2024-03-16T17:51:06.811 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:51:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:06.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:51:06.824 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-03-16T17:51:07.006 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:51:07.010 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:51:07.010 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:51:07.011 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:51:07.011 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:07.369 INFO:teuthology.orchestra.run.smithi132.stdout:generic/005 0s 2024-03-16T17:51:07.375 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/005 2024-03-16T17:51:07.375 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:51:07.377 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:07.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:51:07.411 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-03-16T17:51:07.594 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:51:07.598 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:51:07.598 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:51:07.599 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:51:07.599 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:15.228 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:51:15.231 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:51:28.957 INFO:teuthology.orchestra.run.smithi132.stdout:generic/006 21s 2024-03-16T17:51:28.968 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/006 2024-03-16T17:51:28.968 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:51:28.970 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:29.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:51:29.000 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-03-16T17:51:29.357 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:51:29.361 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:51:29.361 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:51:29.362 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:51:29.362 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:51:45.922 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:51:45.924 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:52:12.399 INFO:teuthology.orchestra.run.smithi132.stdout:generic/007 43s 2024-03-16T17:52:12.473 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/007 2024-03-16T17:52:12.474 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:52:12.476 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:12.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:52:12.569 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-03-16T17:52:12.910 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:52:12.913 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:52:12.913 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:52:12.914 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:52:12.914 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:13.178 INFO:teuthology.orchestra.run.smithi132.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-16T17:52:13.182 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/008 2024-03-16T17:52:13.182 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/008 2024-03-16T17:52:13.182 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:52:13.184 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:13.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:52:13.197 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-03-16T17:52:13.385 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:52:13.389 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:52:13.389 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:52:13.390 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:52:13.390 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:13.644 INFO:teuthology.orchestra.run.smithi132.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-16T17:52:13.648 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/009 2024-03-16T17:52:13.648 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/009 2024-03-16T17:52:13.648 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:52:13.650 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:13.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:52:13.665 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-03-16T17:52:13.840 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:52:13.843 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:52:13.844 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:52:13.845 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:52:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:14.410 INFO:teuthology.orchestra.run.smithi132.stdout:generic/010 1s 2024-03-16T17:52:14.567 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/010 2024-03-16T17:52:14.568 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:52:14.570 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:14.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:52:14.610 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-03-16T17:52:14.793 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:52:14.797 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:52:14.797 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:52:14.798 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:52:14.798 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:16.088 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:52:16.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:52:41.215 INFO:teuthology.orchestra.run.smithi132.stdout:generic/011 27s 2024-03-16T17:52:41.260 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/011 2024-03-16T17:52:41.260 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:52:41.263 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:41.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:52:41.299 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-03-16T17:52:41.503 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:52:41.507 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:52:41.507 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:52:41.508 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:52:41.508 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:41.794 INFO:teuthology.orchestra.run.smithi132.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:52:41.798 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/012 2024-03-16T17:52:41.798 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/012 2024-03-16T17:52:41.798 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:52:41.800 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:41.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:52:41.847 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-03-16T17:52:42.082 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:52:42.085 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:52:42.086 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:52:42.087 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:52:42.087 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:52:46.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:52:46.422 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:53:17.035 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:53:17.038 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:53:37.576 INFO:teuthology.orchestra.run.smithi132.stdout:generic/013 55s 2024-03-16T17:53:37.584 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/013 2024-03-16T17:53:37.585 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:37.588 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:37.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:37.608 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-03-16T17:53:37.859 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:37.923 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:37.923 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:37.923 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:37.923 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:38.197 INFO:teuthology.orchestra.run.smithi132.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-03-16T17:53:38.201 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/014 2024-03-16T17:53:38.201 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/014 2024-03-16T17:53:38.201 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:38.203 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:38.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:38.225 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-03-16T17:53:38.481 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:38.487 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:38.487 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:38.488 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:38.488 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:38.785 INFO:teuthology.orchestra.run.smithi132.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T17:53:38.790 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/015 2024-03-16T17:53:38.790 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/015 2024-03-16T17:53:38.790 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:38.793 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:38.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:38.812 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-03-16T17:53:39.065 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:39.071 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:39.071 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:39.073 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:39.073 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:39.461 INFO:teuthology.orchestra.run.smithi132.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:53:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/016 2024-03-16T17:53:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/016 2024-03-16T17:53:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:39.470 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:39.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:39.504 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-03-16T17:53:39.825 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:39.834 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:39.834 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:39.834 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:39.834 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:40.133 INFO:teuthology.orchestra.run.smithi132.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-16T17:53:40.138 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/017 2024-03-16T17:53:40.138 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/017 2024-03-16T17:53:40.138 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:40.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:40.161 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-03-16T17:53:40.419 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:40.424 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:40.424 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:40.426 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:40.426 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:40.790 INFO:teuthology.orchestra.run.smithi132.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-03-16T17:53:40.800 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/018 2024-03-16T17:53:40.800 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/018 2024-03-16T17:53:40.800 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:40.803 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:40.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:40.817 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-03-16T17:53:41.078 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:41.083 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:41.083 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:41.085 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:41.085 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:41.353 INFO:teuthology.orchestra.run.smithi132.stdout:generic/019 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:53:41.358 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/019 2024-03-16T17:53:41.358 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/019 2024-03-16T17:53:41.358 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:41.362 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:41.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:41.381 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-03-16T17:53:41.633 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:41.637 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:41.637 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:41.638 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:41.638 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:45.674 INFO:teuthology.orchestra.run.smithi132.stdout:generic/020 4s 2024-03-16T17:53:45.857 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/020 2024-03-16T17:53:45.857 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:45.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:45.898 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-03-16T17:53:46.177 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:46.182 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:46.183 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:46.184 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:46.184 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:46.583 INFO:teuthology.orchestra.run.smithi132.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:53:46.589 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/021 2024-03-16T17:53:46.589 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/021 2024-03-16T17:53:46.589 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:46.592 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:46.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:46.626 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-03-16T17:53:46.914 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:46.920 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:46.921 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:46.922 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:46.922 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:47.311 INFO:teuthology.orchestra.run.smithi132.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:53:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/022 2024-03-16T17:53:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/022 2024-03-16T17:53:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:47.320 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:47.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:47.352 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-03-16T17:53:47.576 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:53:47.579 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:53:47.649 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:47.654 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:47.654 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:47.655 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:47.655 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:48.940 INFO:teuthology.orchestra.run.smithi132.stdout:generic/023 1s 2024-03-16T17:53:49.135 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/023 2024-03-16T17:53:49.135 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:49.138 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:49.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:49.195 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-03-16T17:53:49.477 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:49.482 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:49.482 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:49.483 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:49.483 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:49.785 INFO:teuthology.orchestra.run.smithi132.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-03-16T17:53:49.790 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/024 2024-03-16T17:53:49.790 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/024 2024-03-16T17:53:49.791 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:49.794 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:49.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:49.823 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-03-16T17:53:50.130 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:50.135 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:50.136 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:50.136 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:50.137 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:50.453 INFO:teuthology.orchestra.run.smithi132.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-03-16T17:53:50.459 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/025 2024-03-16T17:53:50.459 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/025 2024-03-16T17:53:50.459 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:50.463 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:50.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:50.502 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-03-16T17:53:50.780 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:50.785 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:50.785 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:50.786 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:50.786 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:51.100 INFO:teuthology.orchestra.run.smithi132.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-03-16T17:53:51.105 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/026 2024-03-16T17:53:51.105 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/026 2024-03-16T17:53:51.105 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:51.108 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:51.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:51.128 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-03-16T17:53:51.390 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:51.394 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:51.395 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:51.396 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:51.396 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:51.669 INFO:teuthology.orchestra.run.smithi132.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T17:53:51.675 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/027 2024-03-16T17:53:51.675 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/027 2024-03-16T17:53:51.675 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:51.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:51.696 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-03-16T17:53:51.956 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:51.964 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:51.964 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:51.965 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:51.965 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:57.271 INFO:teuthology.orchestra.run.smithi132.stdout:generic/028 5s 2024-03-16T17:53:57.278 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/028 2024-03-16T17:53:57.278 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:53:57.283 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:53:57.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:53:57.302 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-03-16T17:53:57.554 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:53:57.560 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:53:57.560 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:53:57.562 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:53:57.562 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:01.375 INFO:teuthology.orchestra.run.smithi132.stdout:generic/029 4s 2024-03-16T17:54:01.382 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/029 2024-03-16T17:54:01.382 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:01.385 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:01.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:01.397 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-03-16T17:54:01.659 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:01.663 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:01.664 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:01.665 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:01.665 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:02.938 INFO:teuthology.orchestra.run.smithi132.stdout:generic/030 1s 2024-03-16T17:54:02.946 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/030 2024-03-16T17:54:02.946 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:02.949 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:02.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:02.961 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-03-16T17:54:03.223 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:03.227 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:03.228 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:03.229 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:03.229 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:03.599 INFO:teuthology.orchestra.run.smithi132.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-16T17:54:03.604 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/031 2024-03-16T17:54:03.605 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/031 2024-03-16T17:54:03.605 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:03.608 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:03.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:03.628 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-03-16T17:54:03.897 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:03.903 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:03.903 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:03.904 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:03.904 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:04.199 INFO:teuthology.orchestra.run.smithi132.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:54:04.204 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/032 2024-03-16T17:54:04.204 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/032 2024-03-16T17:54:04.204 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:04.207 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:04.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:04.228 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-03-16T17:54:04.482 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:04.488 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:04.488 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:04.490 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:04.490 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:04.853 INFO:teuthology.orchestra.run.smithi132.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-16T17:54:04.859 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/033 2024-03-16T17:54:04.859 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/033 2024-03-16T17:54:04.859 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:04.862 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:04.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:04.886 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-03-16T17:54:05.143 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:05.148 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:05.149 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:05.152 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:05.152 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:05.445 INFO:teuthology.orchestra.run.smithi132.stdout:generic/034 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:54:05.450 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/034 2024-03-16T17:54:05.451 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/034 2024-03-16T17:54:05.451 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:05.454 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:05.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:05.471 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-03-16T17:54:05.742 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:05.748 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:05.749 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:05.751 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:05.751 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:06.099 INFO:teuthology.orchestra.run.smithi132.stdout:generic/035 1s 2024-03-16T17:54:06.106 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/035 2024-03-16T17:54:06.106 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:06.110 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:06.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:06.143 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-03-16T17:54:06.443 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:06.449 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:06.449 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:06.451 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:06.451 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:16.821 INFO:teuthology.orchestra.run.smithi132.stdout:generic/036 10s 2024-03-16T17:54:16.829 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/036 2024-03-16T17:54:16.829 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:16.832 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:16.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:16.859 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-03-16T17:54:17.158 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:17.163 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:17.164 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:17.165 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:17.165 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:17.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:54:17.916 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:54:22.726 INFO:teuthology.orchestra.run.smithi132.stdout:generic/037 5s 2024-03-16T17:54:22.734 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/037 2024-03-16T17:54:22.734 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:22.737 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:22.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:22.748 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-03-16T17:54:23.011 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:23.016 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:23.017 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:23.018 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:23.018 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:23.306 INFO:teuthology.orchestra.run.smithi132.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:54:23.311 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/038 2024-03-16T17:54:23.312 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/038 2024-03-16T17:54:23.312 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:23.315 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:23.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:23.334 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-03-16T17:54:23.597 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:23.604 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:23.605 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:23.606 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:23.606 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:23.924 INFO:teuthology.orchestra.run.smithi132.stdout:generic/039 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:54:23.931 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/039 2024-03-16T17:54:23.931 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/039 2024-03-16T17:54:23.931 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:23.933 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:23.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:23.953 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-03-16T17:54:24.213 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:24.220 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:24.220 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:24.221 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:24.221 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:24.520 INFO:teuthology.orchestra.run.smithi132.stdout:generic/040 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:54:24.525 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/040 2024-03-16T17:54:24.525 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/040 2024-03-16T17:54:24.526 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:24.529 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:24.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:24.548 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-03-16T17:54:24.807 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:24.812 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:24.813 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:24.814 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:24.814 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:25.123 INFO:teuthology.orchestra.run.smithi132.stdout:generic/041 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:54:25.128 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/041 2024-03-16T17:54:25.128 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/041 2024-03-16T17:54:25.128 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:25.131 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:25.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:25.153 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-03-16T17:54:25.420 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:25.424 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:25.425 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:25.426 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:25.426 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:25.791 INFO:teuthology.orchestra.run.smithi132.stdout:generic/042 [not run] ceph does not support shutdown 2024-03-16T17:54:25.805 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/042 2024-03-16T17:54:25.805 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/042 2024-03-16T17:54:25.805 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:25.809 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:25.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:25.823 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-03-16T17:54:26.074 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:26.080 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:26.081 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:26.082 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:26.082 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:26.445 INFO:teuthology.orchestra.run.smithi132.stdout:generic/043 [not run] ceph does not support shutdown 2024-03-16T17:54:26.453 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/043 2024-03-16T17:54:26.454 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/043 2024-03-16T17:54:26.454 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:26.457 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:26.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:26.472 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-03-16T17:54:26.728 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:26.733 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:26.733 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:26.734 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:26.734 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:27.106 INFO:teuthology.orchestra.run.smithi132.stdout:generic/044 [not run] ceph does not support shutdown 2024-03-16T17:54:27.116 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/044 2024-03-16T17:54:27.116 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/044 2024-03-16T17:54:27.116 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:27.119 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:27.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:27.133 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-03-16T17:54:27.393 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:27.399 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:27.400 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:27.401 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:27.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:27.764 INFO:teuthology.orchestra.run.smithi132.stdout:generic/045 [not run] ceph does not support shutdown 2024-03-16T17:54:27.775 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/045 2024-03-16T17:54:27.775 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/045 2024-03-16T17:54:27.775 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:27.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:27.793 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-03-16T17:54:28.054 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:28.060 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:28.060 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:28.061 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:28.062 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:28.429 INFO:teuthology.orchestra.run.smithi132.stdout:generic/046 [not run] ceph does not support shutdown 2024-03-16T17:54:28.444 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/046 2024-03-16T17:54:28.444 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/046 2024-03-16T17:54:28.444 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:28.447 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:28.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:28.462 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-03-16T17:54:28.729 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:28.734 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:28.735 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:28.737 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:28.737 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:29.106 INFO:teuthology.orchestra.run.smithi132.stdout:generic/047 [not run] ceph does not support shutdown 2024-03-16T17:54:29.121 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/047 2024-03-16T17:54:29.122 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/047 2024-03-16T17:54:29.122 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:29.125 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:29.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:29.142 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-03-16T17:54:29.392 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:29.399 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:29.399 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:29.400 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:29.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:29.767 INFO:teuthology.orchestra.run.smithi132.stdout:generic/048 [not run] ceph does not support shutdown 2024-03-16T17:54:29.778 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/048 2024-03-16T17:54:29.778 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/048 2024-03-16T17:54:29.778 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:29.781 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:29.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:29.799 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-03-16T17:54:30.078 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:30.083 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:30.084 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:30.085 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:30.085 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:30.461 INFO:teuthology.orchestra.run.smithi132.stdout:generic/049 [not run] ceph does not support shutdown 2024-03-16T17:54:30.482 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/049 2024-03-16T17:54:30.482 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/049 2024-03-16T17:54:30.482 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:30.485 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:30.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:30.501 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-03-16T17:54:30.779 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:30.785 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:30.786 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:30.787 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:30.787 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:31.148 INFO:teuthology.orchestra.run.smithi132.stdout:generic/050 [not run] ceph does not support shutdown 2024-03-16T17:54:31.168 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/050 2024-03-16T17:54:31.168 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/050 2024-03-16T17:54:31.168 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:31.171 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:31.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:31.186 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-03-16T17:54:31.427 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:31.432 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:31.432 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:31.434 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:31.434 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:31.814 INFO:teuthology.orchestra.run.smithi132.stdout:generic/051 [not run] ceph does not support shutdown 2024-03-16T17:54:31.819 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/051 2024-03-16T17:54:31.819 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/051 2024-03-16T17:54:31.819 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:31.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:31.836 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-03-16T17:54:32.097 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:32.102 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:32.103 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:32.108 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:32.108 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:32.514 INFO:teuthology.orchestra.run.smithi132.stdout:generic/052 [not run] ceph does not support shutdown 2024-03-16T17:54:32.529 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/052 2024-03-16T17:54:32.529 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/052 2024-03-16T17:54:32.529 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:32.532 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:32.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:32.547 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-03-16T17:54:32.799 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:32.804 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:32.804 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:32.805 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:32.805 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:33.487 INFO:teuthology.orchestra.run.smithi132.stdout:generic/053 1s 2024-03-16T17:54:33.496 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/053 2024-03-16T17:54:33.496 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:33.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:33.512 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-03-16T17:54:33.788 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:33.793 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:33.793 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:33.795 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:33.795 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:34.187 INFO:teuthology.orchestra.run.smithi132.stdout:generic/054 [not run] ceph does not support shutdown 2024-03-16T17:54:34.198 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/054 2024-03-16T17:54:34.198 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/054 2024-03-16T17:54:34.199 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:34.201 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:34.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:34.217 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-03-16T17:54:34.476 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:34.483 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:34.483 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:34.484 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:34.485 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:34.860 INFO:teuthology.orchestra.run.smithi132.stdout:generic/055 [not run] ceph does not support shutdown 2024-03-16T17:54:34.870 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/055 2024-03-16T17:54:34.870 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/055 2024-03-16T17:54:34.870 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:34.874 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:34.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:34.890 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-03-16T17:54:35.144 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:35.149 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:35.150 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:35.151 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:35.151 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:35.464 INFO:teuthology.orchestra.run.smithi132.stdout:generic/056 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:54:35.469 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/056 2024-03-16T17:54:35.470 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/056 2024-03-16T17:54:35.470 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:35.473 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:35.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:35.495 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-03-16T17:54:35.756 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:35.762 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:35.762 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:35.763 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:35.764 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:36.070 INFO:teuthology.orchestra.run.smithi132.stdout:generic/057 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:54:36.075 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/057 2024-03-16T17:54:36.075 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/057 2024-03-16T17:54:36.075 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:36.079 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:36.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:36.100 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-03-16T17:54:36.367 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:36.372 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:36.372 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:36.373 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:36.373 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:36.771 INFO:teuthology.orchestra.run.smithi132.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:54:36.777 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/058 2024-03-16T17:54:36.777 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/058 2024-03-16T17:54:36.777 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:36.780 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:36.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:36.811 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-03-16T17:54:37.137 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:37.143 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:37.144 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:37.145 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:37.145 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:37.434 INFO:teuthology.orchestra.run.smithi132.stdout:generic/059 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:54:37.439 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/059 2024-03-16T17:54:37.439 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/059 2024-03-16T17:54:37.439 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:37.442 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:37.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:37.456 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-03-16T17:54:37.713 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:37.718 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:37.718 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:37.720 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:37.720 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:38.131 INFO:teuthology.orchestra.run.smithi132.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:54:38.136 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/060 2024-03-16T17:54:38.136 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/060 2024-03-16T17:54:38.136 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:38.139 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:38.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:38.186 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-03-16T17:54:38.490 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:38.495 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:38.496 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:38.497 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:38.497 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:38.879 INFO:teuthology.orchestra.run.smithi132.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:54:38.884 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/061 2024-03-16T17:54:38.884 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/061 2024-03-16T17:54:38.884 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:38.887 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:38.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:38.923 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-03-16T17:54:39.224 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:39.229 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:39.230 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:39.232 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:39.232 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:41.088 INFO:teuthology.orchestra.run.smithi132.stdout:generic/062 2s 2024-03-16T17:54:41.099 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/062 2024-03-16T17:54:41.099 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:41.103 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:41.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:41.118 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-03-16T17:54:41.387 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:41.394 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:41.394 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:41.396 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:41.396 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:41.867 INFO:teuthology.orchestra.run.smithi132.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:54:41.872 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/063 2024-03-16T17:54:41.873 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/063 2024-03-16T17:54:41.873 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:41.876 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:41.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:41.909 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-03-16T17:54:42.219 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:42.227 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:42.228 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:42.229 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:42.229 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:42.533 INFO:teuthology.orchestra.run.smithi132.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-16T17:54:42.538 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/064 2024-03-16T17:54:42.538 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/064 2024-03-16T17:54:42.538 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:42.541 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:42.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:42.562 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-03-16T17:54:42.816 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:42.825 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:42.825 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:42.826 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:42.826 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:43.134 INFO:teuthology.orchestra.run.smithi132.stdout:generic/065 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:54:43.139 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/065 2024-03-16T17:54:43.139 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/065 2024-03-16T17:54:43.139 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:43.143 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:43.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:43.161 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-03-16T17:54:43.415 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:43.421 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:43.422 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:43.423 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:43.423 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:43.718 INFO:teuthology.orchestra.run.smithi132.stdout:generic/066 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:54:43.724 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/066 2024-03-16T17:54:43.724 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/066 2024-03-16T17:54:43.724 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:43.727 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:43.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:43.742 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-03-16T17:54:44.000 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:44.005 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:44.006 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:44.007 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:44.007 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:44.314 INFO:teuthology.orchestra.run.smithi132.stdout:generic/067 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:54:44.319 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/067 2024-03-16T17:54:44.319 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/067 2024-03-16T17:54:44.320 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:44.324 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:44.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:44.348 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-03-16T17:54:44.605 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:44.611 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:44.612 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:44.613 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:44.613 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:44.904 INFO:teuthology.orchestra.run.smithi132.stdout:generic/068 [not run] ceph does not support freezing 2024-03-16T17:54:44.908 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/068 2024-03-16T17:54:44.909 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/068 2024-03-16T17:54:44.909 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:44.911 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:44.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:44.938 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-03-16T17:54:45.204 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:45.209 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:45.209 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:45.211 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:45.211 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:47.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:54:47.986 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:54:52.521 INFO:teuthology.orchestra.run.smithi132.stdout:generic/069 7s 2024-03-16T17:54:52.530 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/069 2024-03-16T17:54:52.530 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:54:52.535 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:54:52.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:54:52.555 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-03-16T17:54:52.832 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:54:52.839 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:54:52.839 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:54:52.841 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:54:52.841 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:17.433 INFO:teuthology.orchestra.run.smithi132.stdout:generic/070 25s 2024-03-16T17:55:17.440 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/070 2024-03-16T17:55:17.440 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:55:17.444 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:17.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:55:17.528 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-03-16T17:55:17.840 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:55:17.850 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:55:17.851 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:55:17.853 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:55:17.853 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:18.087 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:55:18.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:55:18.195 INFO:teuthology.orchestra.run.smithi132.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-16T17:55:18.200 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/071 2024-03-16T17:55:18.200 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/071 2024-03-16T17:55:18.200 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:55:18.203 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:18.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:55:18.220 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-03-16T17:55:18.563 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:55:18.569 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:55:18.569 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:55:18.570 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:55:18.570 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:18.993 INFO:teuthology.orchestra.run.smithi132.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-16T17:55:19.000 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/072 2024-03-16T17:55:19.000 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/072 2024-03-16T17:55:19.000 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:55:19.003 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:19.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:55:19.023 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-03-16T17:55:19.318 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:55:19.324 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:55:19.324 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:55:19.325 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:55:19.326 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:19.646 INFO:teuthology.orchestra.run.smithi132.stdout:generic/073 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:55:19.652 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/073 2024-03-16T17:55:19.652 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/073 2024-03-16T17:55:19.652 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:55:19.655 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:19.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:55:19.671 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-03-16T17:55:19.956 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:55:19.961 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:55:19.962 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:55:19.963 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:55:19.963 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:34.889 INFO:teuthology.orchestra.run.smithi132.stdout:generic/074 14s 2024-03-16T17:55:34.961 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/074 2024-03-16T17:55:34.961 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:55:34.964 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:36.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:55:36.076 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-03-16T17:55:36.414 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:55:36.419 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:55:36.419 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:55:36.420 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:55:36.420 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:48.234 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:55:48.237 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:55:56.076 INFO:teuthology.orchestra.run.smithi132.stdout:generic/075 20s 2024-03-16T17:55:56.084 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/075 2024-03-16T17:55:56.085 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:55:56.087 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:56.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:55:56.133 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-03-16T17:55:56.489 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:55:56.495 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:55:56.495 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:55:56.496 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:55:56.496 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:56.774 INFO:teuthology.orchestra.run.smithi132.stdout:generic/076 [not run] require 172.21.15.132:6789:/scratch to be local device 2024-03-16T17:55:56.779 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/076 2024-03-16T17:55:56.779 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/076 2024-03-16T17:55:56.779 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:55:56.782 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:55:56.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:55:56.797 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-03-16T17:55:57.059 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:55:57.063 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:55:57.064 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:55:57.065 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:55:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:01.214 INFO:teuthology.orchestra.run.smithi132.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T17:56:01.222 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/077 2024-03-16T17:56:01.222 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/077 2024-03-16T17:56:01.222 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:01.222 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:01.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:01.269 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-03-16T17:56:01.616 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:01.622 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:01.623 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:01.624 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:01.625 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:01.927 INFO:teuthology.orchestra.run.smithi132.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-03-16T17:56:01.933 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/078 2024-03-16T17:56:01.933 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/078 2024-03-16T17:56:01.933 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:01.936 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:01.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:01.968 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-03-16T17:56:02.333 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:02.338 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:02.339 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:02.340 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:02.340 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:02.640 INFO:teuthology.orchestra.run.smithi132.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-03-16T17:56:02.646 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/079 2024-03-16T17:56:02.646 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/079 2024-03-16T17:56:02.646 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:02.648 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:02.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:02.673 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-03-16T17:56:02.937 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:02.942 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:02.943 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:02.944 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:02.944 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:05.281 INFO:teuthology.orchestra.run.smithi132.stdout:generic/080 2s 2024-03-16T17:56:05.292 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/080 2024-03-16T17:56:05.292 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:05.295 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:05.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:05.317 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-03-16T17:56:05.576 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:05.581 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:05.581 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:05.582 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:05.582 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:05.926 INFO:teuthology.orchestra.run.smithi132.stdout:generic/081 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:56:05.931 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/081 2024-03-16T17:56:05.932 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/081 2024-03-16T17:56:05.932 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:05.934 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:05.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:05.951 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-03-16T17:56:06.212 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:06.217 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:06.218 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:06.219 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:06.219 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:06.490 INFO:teuthology.orchestra.run.smithi132.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T17:56:06.496 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/082 2024-03-16T17:56:06.496 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/082 2024-03-16T17:56:06.497 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:06.499 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:06.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:06.514 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-03-16T17:56:06.768 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:06.774 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:06.775 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:06.776 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:06.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:07.061 INFO:teuthology.orchestra.run.smithi132.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T17:56:07.066 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/083 2024-03-16T17:56:07.066 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/083 2024-03-16T17:56:07.067 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:07.070 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:07.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:07.084 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-03-16T17:56:07.335 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:07.339 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:07.340 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:07.341 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:07.341 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:12.901 INFO:teuthology.orchestra.run.smithi132.stdout:generic/084 5s 2024-03-16T17:56:12.918 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/084 2024-03-16T17:56:12.918 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:12.921 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:12.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:12.933 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-03-16T17:56:13.221 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:13.226 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:13.227 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:13.228 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:13.228 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:13.534 INFO:teuthology.orchestra.run.smithi132.stdout:generic/085 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T17:56:13.540 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/085 2024-03-16T17:56:13.540 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/085 2024-03-16T17:56:13.540 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:13.543 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:13.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:13.577 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-03-16T17:56:13.843 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:13.849 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:13.849 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:13.850 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:14.150 INFO:teuthology.orchestra.run.smithi132.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T17:56:14.155 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/086 2024-03-16T17:56:14.156 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/086 2024-03-16T17:56:14.156 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:14.159 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:14.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:14.179 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-03-16T17:56:14.442 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:14.447 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:14.448 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:14.449 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:14.449 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:14.831 INFO:teuthology.orchestra.run.smithi132.stdout:generic/087 0s 2024-03-16T17:56:14.839 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/087 2024-03-16T17:56:14.839 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:14.842 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:14.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:14.915 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-03-16T17:56:15.249 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:15.254 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:15.255 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:15.256 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:15.256 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:15.576 INFO:teuthology.orchestra.run.smithi132.stdout:generic/088 0s 2024-03-16T17:56:15.583 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/088 2024-03-16T17:56:15.583 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T17:56:15.586 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:15.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T17:56:15.619 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-03-16T17:56:15.971 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T17:56:15.977 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T17:56:15.978 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T17:56:15.979 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T17:56:15.979 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T17:56:18.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:56:18.454 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:56:48.544 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:56:48.548 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T17:56:48.630 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T17:56:48.626+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169178) UID: 0 2024-03-16T17:56:48.635 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T17:56:48.631+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169178) UID: 0 2024-03-16T18:00:03.678 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:00:03.684 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:00:33.960 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:00:33.965 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:01:04.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:01:04.273 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:01:04.308 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T18:01:04.304+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169473) UID: 0 2024-03-16T18:01:04.308 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T18:01:04.304+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169473) UID: 0 2024-03-16T18:04:06.378 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:04:06.381 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:04:36.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:04:36.767 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:04:36.964 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T18:04:36.960+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 171528) UID: 0 2024-03-16T18:04:36.964 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T18:04:36.960+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 171528) UID: 0 2024-03-16T18:04:38.733 INFO:teuthology.orchestra.run.smithi132.stdout:generic/089 501s 2024-03-16T18:04:38.895 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/089 2024-03-16T18:04:38.895 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:04:38.897 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:04:39.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:04:39.901 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-03-16T18:04:41.781 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:04:41.785 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:04:41.785 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:04:41.786 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:04:41.786 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:04:42.094 INFO:teuthology.orchestra.run.smithi132.stdout:generic/090 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:04:42.098 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/090 2024-03-16T18:04:42.098 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/090 2024-03-16T18:04:42.098 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:04:42.100 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:04:42.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:04:42.116 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-03-16T18:04:42.298 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:04:42.302 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:04:42.302 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:04:42.303 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:04:42.303 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:15.163 INFO:teuthology.orchestra.run.smithi132.stdout:generic/091 93s 2024-03-16T18:06:15.168 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/091 2024-03-16T18:06:15.168 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:15.171 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:15.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:15.215 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-03-16T18:06:15.654 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:15.659 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:15.660 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:15.661 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:15.927 INFO:teuthology.orchestra.run.smithi132.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:06:15.930 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/092 2024-03-16T18:06:15.930 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/092 2024-03-16T18:06:15.931 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:15.933 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:15.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:15.947 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-03-16T18:06:16.132 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:16.136 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:16.136 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:16.137 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:16.137 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:19.465 INFO:teuthology.orchestra.run.smithi132.stdout:generic/093 3s 2024-03-16T18:06:19.470 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/093 2024-03-16T18:06:19.470 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:19.472 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:19.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:19.528 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-03-16T18:06:20.010 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:20.014 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:20.014 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:20.015 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:20.015 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:20.266 INFO:teuthology.orchestra.run.smithi132.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-16T18:06:20.270 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/094 2024-03-16T18:06:20.270 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/094 2024-03-16T18:06:20.270 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:20.272 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:20.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:20.320 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-03-16T18:06:20.787 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:20.790 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:20.791 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:20.792 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:20.792 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:31.306 INFO:teuthology.orchestra.run.smithi132.stdout:generic/095 11s 2024-03-16T18:06:31.313 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/095 2024-03-16T18:06:31.313 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:31.317 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:31.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:31.329 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-03-16T18:06:31.533 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:31.537 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:31.538 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:31.539 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:31.539 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:31.824 INFO:teuthology.orchestra.run.smithi132.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-16T18:06:31.828 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/096 2024-03-16T18:06:31.828 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/096 2024-03-16T18:06:31.828 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:31.830 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:31.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:31.846 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-03-16T18:06:32.032 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:32.036 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:32.036 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:32.037 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:32.037 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:32.763 INFO:teuthology.orchestra.run.smithi132.stdout:generic/097 0s 2024-03-16T18:06:32.770 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/097 2024-03-16T18:06:32.770 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:32.773 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:32.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:32.788 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-03-16T18:06:32.971 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:32.975 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:32.975 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:32.976 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:32.977 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:34.969 INFO:teuthology.orchestra.run.smithi132.stdout:generic/098 1s 2024-03-16T18:06:34.975 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/098 2024-03-16T18:06:34.975 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:34.977 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:34.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:34.985 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-03-16T18:06:35.177 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:35.181 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:35.181 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:35.182 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:35.182 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:35.982 INFO:teuthology.orchestra.run.smithi132.stdout:generic/099 0s 2024-03-16T18:06:35.988 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/099 2024-03-16T18:06:35.988 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:35.990 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:36.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:36.066 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-03-16T18:06:36.543 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:36.547 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:36.547 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:36.548 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:36.548 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:47.258 INFO:teuthology.orchestra.run.smithi132.stdout:generic/100 11s 2024-03-16T18:06:47.263 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/100 2024-03-16T18:06:47.264 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:47.266 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:51.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:51.285 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-03-16T18:06:51.703 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:51.707 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:51.707 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:51.708 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:51.708 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:51.923 INFO:teuthology.orchestra.run.smithi132.stdout:generic/101 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:06:51.927 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/101 2024-03-16T18:06:51.927 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/101 2024-03-16T18:06:51.927 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:51.930 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:51.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:51.941 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-03-16T18:06:52.124 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:52.128 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:52.128 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:52.129 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:52.129 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:52.351 INFO:teuthology.orchestra.run.smithi132.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:06:52.355 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/102 2024-03-16T18:06:52.355 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/102 2024-03-16T18:06:52.356 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:52.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:52.370 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-03-16T18:06:52.550 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:52.554 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:52.555 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:52.556 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:52.556 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:52.783 INFO:teuthology.orchestra.run.smithi132.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:06:52.787 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/103 2024-03-16T18:06:52.787 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/103 2024-03-16T18:06:52.787 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:52.789 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:52.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:52.836 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-03-16T18:06:53.254 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:53.258 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:53.259 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:53.260 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:53.260 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:53.495 INFO:teuthology.orchestra.run.smithi132.stdout:generic/104 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:06:53.499 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/104 2024-03-16T18:06:53.499 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/104 2024-03-16T18:06:53.499 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:53.501 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:53.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:53.517 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-03-16T18:06:53.700 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:53.703 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:53.704 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:53.705 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:53.705 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:54.138 INFO:teuthology.orchestra.run.smithi132.stdout:generic/105 1s 2024-03-16T18:06:54.147 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/105 2024-03-16T18:06:54.147 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:54.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:54.163 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-03-16T18:06:54.590 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:54.595 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:54.595 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:54.597 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:54.597 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:54.900 INFO:teuthology.orchestra.run.smithi132.stdout:generic/106 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:06:54.904 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/106 2024-03-16T18:06:54.904 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/106 2024-03-16T18:06:54.904 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:54.906 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:54.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:54.921 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-03-16T18:06:55.096 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:55.100 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:55.101 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:55.102 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:55.102 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:55.330 INFO:teuthology.orchestra.run.smithi132.stdout:generic/107 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:06:55.334 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/107 2024-03-16T18:06:55.334 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/107 2024-03-16T18:06:55.334 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:55.336 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:55.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:55.351 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-03-16T18:06:55.550 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:55.554 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:55.554 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:55.555 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:55.555 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:57.527 INFO:teuthology.orchestra.run.smithi132.stdout:generic/108 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:06:57.531 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/108 2024-03-16T18:06:57.531 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/108 2024-03-16T18:06:57.531 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:06:57.534 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:06:57.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:06:57.547 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-03-16T18:06:57.726 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:06:57.728 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:06:57.728 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:06:57.729 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:06:57.729 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:06.159 INFO:teuthology.orchestra.run.smithi132.stdout:generic/109 9s 2024-03-16T18:07:06.166 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/109 2024-03-16T18:07:06.167 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:07:06.169 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:06.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:07:06.184 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-03-16T18:07:07.016 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:07:07.019 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:07:07.020 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:07:07.021 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:07:07.021 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:24.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:07:24.804 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:07:25.347 INFO:teuthology.orchestra.run.smithi132.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:07:25.351 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/110 2024-03-16T18:07:25.351 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/110 2024-03-16T18:07:25.351 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:07:25.353 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:25.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:07:25.404 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-03-16T18:07:25.861 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:07:25.870 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:07:25.871 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:07:25.873 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:07:25.873 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:26.397 INFO:teuthology.orchestra.run.smithi132.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:07:26.401 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/111 2024-03-16T18:07:26.401 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/111 2024-03-16T18:07:26.401 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:07:26.404 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:26.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:07:26.450 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-03-16T18:07:26.856 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:07:26.868 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:07:26.869 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:07:26.871 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:07:26.871 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:41.732 INFO:teuthology.orchestra.run.smithi132.stdout:generic/112 15s 2024-03-16T18:07:41.737 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/112 2024-03-16T18:07:41.738 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:07:41.740 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:41.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:07:41.787 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-03-16T18:07:42.207 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:07:42.211 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:07:42.211 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:07:42.212 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:07:42.212 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:54.858 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:07:54.861 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:07:58.534 INFO:teuthology.orchestra.run.smithi132.stdout:generic/113 16s 2024-03-16T18:07:58.549 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/113 2024-03-16T18:07:58.549 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:07:58.552 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:58.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:07:58.649 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-03-16T18:07:59.026 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:07:59.030 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:07:59.031 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:07:59.031 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:07:59.031 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:59.275 INFO:teuthology.orchestra.run.smithi132.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-03-16T18:07:59.279 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/114 2024-03-16T18:07:59.279 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/114 2024-03-16T18:07:59.279 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:07:59.281 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:59.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:07:59.302 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-03-16T18:07:59.511 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:07:59.516 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:07:59.517 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:07:59.519 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:07:59.519 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:59.793 INFO:teuthology.orchestra.run.smithi132.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:07:59.797 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/115 2024-03-16T18:07:59.797 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/115 2024-03-16T18:07:59.797 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:07:59.800 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:07:59.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:07:59.849 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-03-16T18:08:00.301 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:08:00.330 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:08:00.330 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:08:00.330 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:08:00.330 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:00.544 INFO:teuthology.orchestra.run.smithi132.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:08:00.548 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/116 2024-03-16T18:08:00.548 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/116 2024-03-16T18:08:00.549 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:08:00.551 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:00.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:08:00.602 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-03-16T18:08:01.056 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:08:01.059 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:08:01.060 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:08:01.061 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:08:01.061 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:13.261 INFO:teuthology.orchestra.run.smithi132.stdout:generic/117 12s 2024-03-16T18:08:13.267 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/117 2024-03-16T18:08:13.267 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:08:13.269 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:13.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:08:13.278 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-03-16T18:08:13.459 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:08:13.463 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:08:13.464 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:08:13.465 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:08:13.465 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:14.108 INFO:teuthology.orchestra.run.smithi132.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:08:14.112 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/118 2024-03-16T18:08:14.112 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/118 2024-03-16T18:08:14.112 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:08:14.114 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:14.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:08:14.173 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-03-16T18:08:14.690 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:08:14.695 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:08:14.696 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:08:14.697 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:08:14.697 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:14.931 INFO:teuthology.orchestra.run.smithi132.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:08:14.935 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/119 2024-03-16T18:08:14.935 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/119 2024-03-16T18:08:14.935 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:08:14.937 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:15.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:08:15.000 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-03-16T18:08:15.430 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:08:15.434 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:08:15.434 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:08:15.435 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:08:15.435 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:15.653 INFO:teuthology.orchestra.run.smithi132.stdout:generic/120 [not run] atime not maintained by ceph 2024-03-16T18:08:15.657 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/120 2024-03-16T18:08:15.657 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/120 2024-03-16T18:08:15.657 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:08:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:15.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:08:15.672 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-03-16T18:08:15.855 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:08:15.859 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:08:15.859 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:08:15.860 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:08:15.860 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:16.100 INFO:teuthology.orchestra.run.smithi132.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-16T18:08:16.105 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/121 2024-03-16T18:08:16.105 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/121 2024-03-16T18:08:16.105 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:08:16.107 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:16.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:08:16.171 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-03-16T18:08:16.599 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:08:16.603 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:08:16.603 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:08:16.604 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:08:16.604 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:16.838 INFO:teuthology.orchestra.run.smithi132.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-16T18:08:16.842 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/122 2024-03-16T18:08:16.842 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/122 2024-03-16T18:08:16.842 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:08:16.844 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:16.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:08:16.902 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-03-16T18:08:17.350 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:08:17.354 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:08:17.354 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:08:17.355 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:08:17.355 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:17.870 INFO:teuthology.orchestra.run.smithi132.stdout:generic/123 0s 2024-03-16T18:08:17.875 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/123 2024-03-16T18:08:17.875 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:08:17.877 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:17.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:08:17.935 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-03-16T18:08:18.366 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:08:18.370 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:08:18.370 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:08:18.371 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:08:18.372 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:20.111 INFO:teuthology.orchestra.run.smithi132.stdout:generic/124 2s 2024-03-16T18:08:20.131 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/124 2024-03-16T18:08:20.131 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:08:20.133 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:20.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:08:20.744 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-03-16T18:08:21.166 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:08:21.170 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:08:21.170 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:08:21.171 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:08:21.171 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:08:24.986 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:08:24.988 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:08:55.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:08:55.046 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:09:22.659 INFO:teuthology.orchestra.run.smithi132.stdout:generic/125 61s 2024-03-16T18:09:22.665 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/125 2024-03-16T18:09:22.665 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:09:22.667 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:09:22.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:09:22.707 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-03-16T18:09:23.162 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:09:23.165 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:09:23.166 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:09:23.167 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:09:23.167 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:09:23.563 INFO:teuthology.orchestra.run.smithi132.stdout:generic/126 0s 2024-03-16T18:09:23.569 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/126 2024-03-16T18:09:23.569 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:09:23.571 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:09:23.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:09:23.649 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-03-16T18:09:24.072 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:09:24.076 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:09:24.076 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:09:24.077 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:09:24.077 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:09:25.175 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:09:25.178 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:09:55.293 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:09:55.296 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:10:25.415 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:10:25.417 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:10:55.838 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:10:55.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:11:25.909 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:11:25.912 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:11:55.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:11:55.999 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:12:26.111 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:12:26.114 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:12:56.265 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:12:56.268 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:13:26.396 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:13:26.399 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:13:56.482 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:13:56.485 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:14:26.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:14:26.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:14:56.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:14:56.656 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:15:26.807 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:15:26.810 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:15:56.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:15:56.932 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:16:27.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:16:27.046 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:16:57.190 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:16:57.193 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:17:27.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:17:27.306 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:17:57.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:17:57.453 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:18:22.465 INFO:teuthology.orchestra.run.smithi132.stdout:generic/127 538s 2024-03-16T18:18:22.470 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/127 2024-03-16T18:18:22.470 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:18:22.473 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:22.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:18:22.523 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-03-16T18:18:22.952 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:18:22.956 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:18:22.957 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:18:22.958 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:18:22.958 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:23.937 INFO:teuthology.orchestra.run.smithi132.stdout:generic/128 0s 2024-03-16T18:18:23.948 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/128 2024-03-16T18:18:23.948 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:18:23.952 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:23.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:18:23.963 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-03-16T18:18:24.152 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:18:24.156 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:18:24.157 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:18:24.158 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:18:24.158 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:24.386 INFO:teuthology.orchestra.run.smithi132.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-03-16T18:18:24.390 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/129 2024-03-16T18:18:24.391 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/129 2024-03-16T18:18:24.391 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:18:24.393 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:24.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:18:24.414 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-03-16T18:18:24.594 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:18:24.598 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:18:24.598 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:18:24.599 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:18:24.599 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:24.827 INFO:teuthology.orchestra.run.smithi132.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-03-16T18:18:24.831 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/130 2024-03-16T18:18:24.831 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/130 2024-03-16T18:18:24.832 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:18:24.834 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:24.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:18:24.855 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-03-16T18:18:25.035 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:18:25.038 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:18:25.039 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:18:25.040 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:18:25.040 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:26.400 INFO:teuthology.orchestra.run.smithi132.stdout:generic/131 1s 2024-03-16T18:18:26.406 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/131 2024-03-16T18:18:26.406 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:18:26.408 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:26.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:18:26.483 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-03-16T18:18:26.873 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:18:26.876 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:18:26.877 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:18:26.878 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:18:26.878 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:27.563 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:18:27.565 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:18:40.218 INFO:teuthology.orchestra.run.smithi132.stdout:generic/132 14s 2024-03-16T18:18:40.223 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/132 2024-03-16T18:18:40.223 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:18:40.225 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:40.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:18:40.234 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-03-16T18:18:40.414 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:18:40.418 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:18:40.418 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:18:40.420 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:18:40.420 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:18:57.726 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:18:57.729 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:19:27.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:19:27.858 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:19:57.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:19:57.973 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:20:28.034 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:20:28.037 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:20:58.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:20:58.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:21:28.235 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:21:28.238 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:21:58.350 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:21:58.353 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:22:16.294 INFO:teuthology.orchestra.run.smithi132.stdout:generic/133 216s 2024-03-16T18:22:16.300 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/133 2024-03-16T18:22:16.300 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:16.302 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:16.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:16.344 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-03-16T18:22:16.725 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:16.730 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:16.730 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:16.731 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:16.731 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:17.051 INFO:teuthology.orchestra.run.smithi132.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:17.056 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/134 2024-03-16T18:22:17.056 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/134 2024-03-16T18:22:17.056 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:17.059 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:17.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:17.113 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-03-16T18:22:17.499 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:17.504 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:17.504 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:17.506 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:17.506 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:18.369 INFO:teuthology.orchestra.run.smithi132.stdout:generic/135 1s 2024-03-16T18:22:18.374 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/135 2024-03-16T18:22:18.374 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:18.376 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:18.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:18.385 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-03-16T18:22:18.565 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:18.569 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:18.569 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:18.570 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:18.570 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:18.807 INFO:teuthology.orchestra.run.smithi132.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-16T18:22:18.811 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/136 2024-03-16T18:22:18.811 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/136 2024-03-16T18:22:18.811 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:18.813 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:18.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:18.859 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-03-16T18:22:19.248 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:19.253 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:19.254 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:19.255 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:19.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:19.497 INFO:teuthology.orchestra.run.smithi132.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:19.501 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/137 2024-03-16T18:22:19.502 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/137 2024-03-16T18:22:19.502 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:19.504 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:19.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:19.563 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-03-16T18:22:19.948 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:19.953 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:19.953 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:19.955 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:19.955 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:20.191 INFO:teuthology.orchestra.run.smithi132.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:20.195 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/138 2024-03-16T18:22:20.195 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/138 2024-03-16T18:22:20.195 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:20.197 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:20.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:20.262 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-03-16T18:22:20.668 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:20.671 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:20.672 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:20.673 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:20.673 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:20.912 INFO:teuthology.orchestra.run.smithi132.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:20.916 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/139 2024-03-16T18:22:20.916 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/139 2024-03-16T18:22:20.916 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:20.918 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:20.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:20.970 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-03-16T18:22:21.353 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:21.357 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:21.358 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:21.359 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:21.359 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:21.613 INFO:teuthology.orchestra.run.smithi132.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:21.617 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/140 2024-03-16T18:22:21.617 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/140 2024-03-16T18:22:21.617 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:21.620 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:21.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:21.676 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-03-16T18:22:22.061 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:22.065 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:22.065 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:22.066 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:22.067 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:22.405 INFO:teuthology.orchestra.run.smithi132.stdout:generic/141 0s 2024-03-16T18:22:22.410 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/141 2024-03-16T18:22:22.410 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:22.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:22.421 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-03-16T18:22:22.596 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:22.600 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:22.600 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:22.601 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:22.601 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:22.857 INFO:teuthology.orchestra.run.smithi132.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:22.861 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/142 2024-03-16T18:22:22.861 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/142 2024-03-16T18:22:22.861 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:22.863 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:22.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:22.915 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-03-16T18:22:23.311 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:23.316 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:23.317 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:23.318 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:23.318 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:23.557 INFO:teuthology.orchestra.run.smithi132.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:23.561 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/143 2024-03-16T18:22:23.561 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/143 2024-03-16T18:22:23.561 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:23.564 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:23.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:23.626 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-03-16T18:22:24.033 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:24.036 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:24.037 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:24.038 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:24.038 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:24.284 INFO:teuthology.orchestra.run.smithi132.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:24.288 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/144 2024-03-16T18:22:24.288 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/144 2024-03-16T18:22:24.288 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:24.290 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:24.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:24.354 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-03-16T18:22:24.727 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:24.734 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:24.735 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:24.736 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:24.736 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:24.984 INFO:teuthology.orchestra.run.smithi132.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:24.988 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/145 2024-03-16T18:22:24.988 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/145 2024-03-16T18:22:24.988 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:24.990 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:25.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:25.041 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-03-16T18:22:25.444 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:25.448 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:25.449 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:25.450 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:25.450 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:25.697 INFO:teuthology.orchestra.run.smithi132.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/146 2024-03-16T18:22:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/146 2024-03-16T18:22:25.701 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:25.703 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:25.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:25.754 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-03-16T18:22:26.107 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:26.113 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:26.117 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:26.117 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:26.117 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:26.386 INFO:teuthology.orchestra.run.smithi132.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:26.390 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/147 2024-03-16T18:22:26.390 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/147 2024-03-16T18:22:26.390 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:26.392 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:26.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:26.443 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-03-16T18:22:26.854 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:26.859 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:26.859 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:26.860 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:26.860 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:27.097 INFO:teuthology.orchestra.run.smithi132.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:27.101 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/148 2024-03-16T18:22:27.101 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/148 2024-03-16T18:22:27.102 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:27.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:27.151 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-03-16T18:22:27.499 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:27.504 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:27.504 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:27.506 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:27.506 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:27.756 INFO:teuthology.orchestra.run.smithi132.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:27.760 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/149 2024-03-16T18:22:27.760 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/149 2024-03-16T18:22:27.760 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:27.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:27.815 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-03-16T18:22:28.216 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:28.221 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:28.221 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:28.222 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:28.223 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:28.462 INFO:teuthology.orchestra.run.smithi132.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:28.466 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/150 2024-03-16T18:22:28.466 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/150 2024-03-16T18:22:28.466 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:28.468 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:28.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:28.520 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-03-16T18:22:28.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:22:28.664 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:22:28.884 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:28.890 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:28.890 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:28.891 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:28.891 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:29.277 INFO:teuthology.orchestra.run.smithi132.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:29.281 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/151 2024-03-16T18:22:29.281 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/151 2024-03-16T18:22:29.281 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:29.283 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:29.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:29.331 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-03-16T18:22:29.717 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:29.722 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:29.723 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:29.724 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:29.724 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:29.972 INFO:teuthology.orchestra.run.smithi132.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:29.976 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/152 2024-03-16T18:22:29.976 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/152 2024-03-16T18:22:29.976 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:29.979 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:30.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:30.062 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-03-16T18:22:30.442 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:30.448 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:30.448 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:30.449 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:30.450 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:30.686 INFO:teuthology.orchestra.run.smithi132.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:30.690 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/153 2024-03-16T18:22:30.690 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/153 2024-03-16T18:22:30.690 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:30.692 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:30.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:30.741 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-03-16T18:22:31.154 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:31.158 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:31.159 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:31.160 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:31.160 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:31.395 INFO:teuthology.orchestra.run.smithi132.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:31.399 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/154 2024-03-16T18:22:31.399 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/154 2024-03-16T18:22:31.399 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:31.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:31.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:31.460 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-03-16T18:22:31.835 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:31.843 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:31.843 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:31.843 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:31.843 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:32.109 INFO:teuthology.orchestra.run.smithi132.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:32.113 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/155 2024-03-16T18:22:32.113 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/155 2024-03-16T18:22:32.113 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:32.116 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:32.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:32.171 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-03-16T18:22:32.554 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:32.559 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:32.560 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:32.561 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:32.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:32.822 INFO:teuthology.orchestra.run.smithi132.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:32.826 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/156 2024-03-16T18:22:32.826 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/156 2024-03-16T18:22:32.826 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:32.828 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:32.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:32.879 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-03-16T18:22:33.276 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:33.282 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:33.282 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:33.282 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:33.282 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:33.521 INFO:teuthology.orchestra.run.smithi132.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:33.525 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/157 2024-03-16T18:22:33.525 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/157 2024-03-16T18:22:33.525 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:33.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:33.583 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-03-16T18:22:33.967 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:33.972 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:33.972 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:33.973 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:33.973 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:34.217 INFO:teuthology.orchestra.run.smithi132.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-16T18:22:34.220 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/158 2024-03-16T18:22:34.220 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/158 2024-03-16T18:22:34.221 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:34.223 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:34.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:34.299 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-03-16T18:22:34.680 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:34.684 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:34.684 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:34.685 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:34.685 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:34.929 INFO:teuthology.orchestra.run.smithi132.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-03-16T18:22:34.933 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/159 2024-03-16T18:22:34.933 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/159 2024-03-16T18:22:34.933 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:34.935 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:34.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:34.954 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-03-16T18:22:35.142 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:35.146 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:35.146 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:35.146 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:35.147 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:35.379 INFO:teuthology.orchestra.run.smithi132.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-03-16T18:22:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/160 2024-03-16T18:22:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/160 2024-03-16T18:22:35.383 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:35.385 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:35.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:35.406 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-03-16T18:22:35.601 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:35.606 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:35.606 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:35.970 INFO:teuthology.orchestra.run.smithi132.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:35.977 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/161 2024-03-16T18:22:35.977 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/161 2024-03-16T18:22:35.977 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:35.980 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:36.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:36.172 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-03-16T18:22:36.447 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:36.450 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:36.451 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:36.452 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:36.452 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:36.747 INFO:teuthology.orchestra.run.smithi132.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-16T18:22:36.789 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/162 2024-03-16T18:22:36.789 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/162 2024-03-16T18:22:36.789 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:36.793 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:36.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:36.960 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-03-16T18:22:37.259 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:37.263 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:37.263 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:37.264 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:37.264 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:37.564 INFO:teuthology.orchestra.run.smithi132.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-16T18:22:37.604 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/163 2024-03-16T18:22:37.604 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/163 2024-03-16T18:22:37.605 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:37.606 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:37.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:37.918 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-03-16T18:22:38.129 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:38.133 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:38.133 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:38.134 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:38.135 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:38.481 INFO:teuthology.orchestra.run.smithi132.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:38.486 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/164 2024-03-16T18:22:38.487 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/164 2024-03-16T18:22:38.487 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:38.491 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:38.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:38.625 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-03-16T18:22:38.939 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:38.943 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:38.944 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:38.944 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:38.945 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:39.297 INFO:teuthology.orchestra.run.smithi132.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:39.303 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/165 2024-03-16T18:22:39.303 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/165 2024-03-16T18:22:39.303 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:39.309 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:39.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:39.453 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-03-16T18:22:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:39.747 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:40.093 INFO:teuthology.orchestra.run.smithi132.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:40.100 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/166 2024-03-16T18:22:40.100 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/166 2024-03-16T18:22:40.100 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:40.101 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:40.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:40.289 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-03-16T18:22:40.572 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:40.576 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:40.576 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:40.577 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:40.577 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:40.940 INFO:teuthology.orchestra.run.smithi132.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:40.947 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/167 2024-03-16T18:22:40.947 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/167 2024-03-16T18:22:40.947 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:40.953 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:41.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:41.117 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-03-16T18:22:41.378 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:41.382 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:41.382 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:41.383 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:41.383 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:41.764 INFO:teuthology.orchestra.run.smithi132.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:41.769 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/168 2024-03-16T18:22:41.769 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/168 2024-03-16T18:22:41.769 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:41.773 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:41.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:41.928 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-03-16T18:22:42.209 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:42.213 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:42.214 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:42.214 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:42.214 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:42.643 INFO:teuthology.orchestra.run.smithi132.stdout:generic/169 0s 2024-03-16T18:22:42.648 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/169 2024-03-16T18:22:42.648 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:42.651 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:42.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:42.660 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-03-16T18:22:42.847 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:42.850 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:42.850 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:42.852 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:42.852 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:43.211 INFO:teuthology.orchestra.run.smithi132.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:43.216 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/170 2024-03-16T18:22:43.216 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/170 2024-03-16T18:22:43.216 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:43.220 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:43.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:43.369 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-03-16T18:22:43.671 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:43.675 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:43.675 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:43.676 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:43.677 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:44.033 INFO:teuthology.orchestra.run.smithi132.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:44.040 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/171 2024-03-16T18:22:44.040 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/171 2024-03-16T18:22:44.040 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:44.042 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:44.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:44.168 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-03-16T18:22:44.477 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:44.481 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:44.482 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:44.483 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:44.483 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:44.842 INFO:teuthology.orchestra.run.smithi132.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:44.849 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/172 2024-03-16T18:22:44.849 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/172 2024-03-16T18:22:44.849 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:44.852 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:45.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:45.016 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-03-16T18:22:45.305 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:45.309 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:45.309 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:45.310 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:45.310 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:45.663 INFO:teuthology.orchestra.run.smithi132.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:45.673 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/173 2024-03-16T18:22:45.674 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/173 2024-03-16T18:22:45.674 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:45.676 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:45.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:45.840 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-03-16T18:22:46.113 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:46.116 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:46.117 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:46.118 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:46.118 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:46.478 INFO:teuthology.orchestra.run.smithi132.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:46.485 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/174 2024-03-16T18:22:46.485 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/174 2024-03-16T18:22:46.485 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:46.487 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:46.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:46.630 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-03-16T18:22:46.906 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:46.910 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:46.911 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:46.912 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:46.912 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:47.263 INFO:teuthology.orchestra.run.smithi132.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:47.270 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/175 2024-03-16T18:22:47.270 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/175 2024-03-16T18:22:47.270 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:47.274 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:47.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:47.451 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-03-16T18:22:47.729 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:47.733 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:47.733 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:47.734 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:47.734 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:48.086 INFO:teuthology.orchestra.run.smithi132.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:48.091 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/176 2024-03-16T18:22:48.091 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/176 2024-03-16T18:22:48.091 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:48.094 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:48.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:48.308 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-03-16T18:22:48.579 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:48.583 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:48.584 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:48.585 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:48.586 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:48.925 INFO:teuthology.orchestra.run.smithi132.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-16T18:22:48.928 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/177 2024-03-16T18:22:48.929 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/177 2024-03-16T18:22:48.929 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:48.931 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:48.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:48.978 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-03-16T18:22:49.327 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:49.331 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:49.332 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:49.332 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:49.333 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:49.614 INFO:teuthology.orchestra.run.smithi132.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:49.618 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/178 2024-03-16T18:22:49.618 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/178 2024-03-16T18:22:49.618 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:49.620 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:49.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:49.682 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-03-16T18:22:50.106 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:50.110 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:50.110 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:50.111 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:50.111 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:50.363 INFO:teuthology.orchestra.run.smithi132.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:50.366 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/179 2024-03-16T18:22:50.366 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/179 2024-03-16T18:22:50.366 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:50.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:50.435 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-03-16T18:22:50.785 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:50.790 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:50.790 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:50.791 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:50.791 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:51.056 INFO:teuthology.orchestra.run.smithi132.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:51.060 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/180 2024-03-16T18:22:51.060 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/180 2024-03-16T18:22:51.060 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:51.062 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:51.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:51.117 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-03-16T18:22:51.489 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:51.496 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:51.497 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:51.499 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:51.499 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:51.763 INFO:teuthology.orchestra.run.smithi132.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:22:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/181 2024-03-16T18:22:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/181 2024-03-16T18:22:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:51.769 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:51.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:51.822 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-03-16T18:22:52.217 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:52.222 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:52.222 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:52.223 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:52.223 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:52.458 INFO:teuthology.orchestra.run.smithi132.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-16T18:22:52.462 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/182 2024-03-16T18:22:52.462 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/182 2024-03-16T18:22:52.462 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:52.464 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:52.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:52.514 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-03-16T18:22:52.868 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:52.873 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:52.877 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:52.877 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:52.877 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:53.231 INFO:teuthology.orchestra.run.smithi132.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:53.237 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/183 2024-03-16T18:22:53.237 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/183 2024-03-16T18:22:53.237 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:53.240 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:53.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:53.342 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-03-16T18:22:53.656 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:53.660 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:53.660 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:53.661 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:53.661 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:53.925 INFO:teuthology.orchestra.run.smithi132.stdout:generic/184 0s 2024-03-16T18:22:53.930 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/184 2024-03-16T18:22:53.930 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:53.933 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:53.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:53.949 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-03-16T18:22:54.137 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:54.141 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:54.141 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:54.142 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:54.485 INFO:teuthology.orchestra.run.smithi132.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:54.491 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/185 2024-03-16T18:22:54.492 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/185 2024-03-16T18:22:54.492 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:54.493 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:54.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:54.674 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-03-16T18:22:54.949 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:54.953 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:54.953 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:54.954 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:54.954 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:55.313 INFO:teuthology.orchestra.run.smithi132.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:55.320 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/186 2024-03-16T18:22:55.320 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/186 2024-03-16T18:22:55.320 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:55.324 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:55.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:55.525 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-03-16T18:22:55.770 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:55.773 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:55.774 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:55.774 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:55.775 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:56.120 INFO:teuthology.orchestra.run.smithi132.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:56.127 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/187 2024-03-16T18:22:56.127 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/187 2024-03-16T18:22:56.127 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:56.129 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:56.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:56.296 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-03-16T18:22:56.572 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:56.575 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:56.576 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:56.577 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:56.577 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:56.986 INFO:teuthology.orchestra.run.smithi132.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:56.991 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/188 2024-03-16T18:22:56.991 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/188 2024-03-16T18:22:56.992 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:56.995 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:57.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:57.090 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-03-16T18:22:57.428 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:57.432 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:57.432 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:57.433 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:57.433 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:57.802 INFO:teuthology.orchestra.run.smithi132.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:57.808 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/189 2024-03-16T18:22:57.808 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/189 2024-03-16T18:22:57.808 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:57.811 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:57.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:57.919 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-03-16T18:22:58.252 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:58.256 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:58.256 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:58.257 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:58.257 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:58.625 INFO:teuthology.orchestra.run.smithi132.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:58.631 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/190 2024-03-16T18:22:58.631 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/190 2024-03-16T18:22:58.631 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:58.637 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:58.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:58.824 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-03-16T18:22:59.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:22:59.017 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:22:59.094 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:59.098 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:59.099 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:59.100 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:59.100 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:59.440 INFO:teuthology.orchestra.run.smithi132.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:22:59.446 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/191 2024-03-16T18:22:59.447 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/191 2024-03-16T18:22:59.447 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:22:59.450 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:22:59.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:22:59.566 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-03-16T18:22:59.868 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:22:59.872 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:22:59.872 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:22:59.873 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:22:59.873 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:00.095 INFO:teuthology.orchestra.run.smithi132.stdout:generic/192 [not run] atime not maintained by ceph 2024-03-16T18:23:00.099 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/192 2024-03-16T18:23:00.099 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/192 2024-03-16T18:23:00.099 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:00.101 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:00.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:00.113 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-03-16T18:23:00.295 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:00.299 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:00.300 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:00.301 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:00.301 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:01.240 INFO:teuthology.orchestra.run.smithi132.stdout:generic/193 1s 2024-03-16T18:23:01.245 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/193 2024-03-16T18:23:01.245 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:01.247 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:01.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:01.315 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-03-16T18:23:01.694 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:01.699 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:01.700 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:01.701 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:01.701 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:02.065 INFO:teuthology.orchestra.run.smithi132.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:02.075 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/194 2024-03-16T18:23:02.075 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/194 2024-03-16T18:23:02.075 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:02.078 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:02.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:02.203 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-03-16T18:23:02.505 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:02.508 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:02.509 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:02.510 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:02.510 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:02.862 INFO:teuthology.orchestra.run.smithi132.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:02.870 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/195 2024-03-16T18:23:02.870 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/195 2024-03-16T18:23:02.870 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:03.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:03.066 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-03-16T18:23:03.334 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:03.337 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:03.338 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:03.339 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:03.339 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:03.692 INFO:teuthology.orchestra.run.smithi132.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:03.698 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/196 2024-03-16T18:23:03.698 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/196 2024-03-16T18:23:03.698 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:03.700 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:03.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:03.886 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-03-16T18:23:04.153 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:04.156 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:04.157 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:04.158 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:04.525 INFO:teuthology.orchestra.run.smithi132.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:04.532 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/197 2024-03-16T18:23:04.532 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/197 2024-03-16T18:23:04.532 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:04.534 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:04.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:04.709 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-03-16T18:23:05.000 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:05.004 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:05.005 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:05.005 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:05.006 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:05.681 INFO:teuthology.orchestra.run.smithi132.stdout:generic/198 0s 2024-03-16T18:23:05.686 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/198 2024-03-16T18:23:05.686 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:05.689 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:05.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:05.730 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-03-16T18:23:06.148 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:06.154 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:06.154 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:06.155 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:06.156 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:06.559 INFO:teuthology.orchestra.run.smithi132.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:06.566 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/199 2024-03-16T18:23:06.566 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/199 2024-03-16T18:23:06.566 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:06.568 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:06.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:06.777 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-03-16T18:23:07.035 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:07.039 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:07.039 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:07.041 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:07.041 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:07.402 INFO:teuthology.orchestra.run.smithi132.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:07.409 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/200 2024-03-16T18:23:07.409 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/200 2024-03-16T18:23:07.409 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:07.411 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:07.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:07.599 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-03-16T18:23:07.863 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:07.867 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:07.867 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:07.868 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:07.868 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:08.223 INFO:teuthology.orchestra.run.smithi132.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:08.230 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/201 2024-03-16T18:23:08.230 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/201 2024-03-16T18:23:08.230 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:08.232 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:08.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:08.440 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-03-16T18:23:08.704 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:08.708 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:08.708 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:08.709 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:08.710 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:09.058 INFO:teuthology.orchestra.run.smithi132.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:09.064 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/202 2024-03-16T18:23:09.064 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/202 2024-03-16T18:23:09.064 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:09.067 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:09.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:09.263 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-03-16T18:23:09.525 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:09.528 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:09.529 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:09.530 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:09.530 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:09.876 INFO:teuthology.orchestra.run.smithi132.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:09.882 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/203 2024-03-16T18:23:09.882 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/203 2024-03-16T18:23:09.882 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:09.885 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:10.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:10.109 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-03-16T18:23:10.363 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:10.366 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:10.367 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:10.368 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:10.368 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:11.667 INFO:teuthology.orchestra.run.smithi132.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:23:11.671 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/204 2024-03-16T18:23:11.671 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/204 2024-03-16T18:23:11.671 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:11.673 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:11.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:11.686 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-03-16T18:23:11.862 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:11.866 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:11.866 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:11.867 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:11.868 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:12.214 INFO:teuthology.orchestra.run.smithi132.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:12.220 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/205 2024-03-16T18:23:12.221 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/205 2024-03-16T18:23:12.221 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:12.226 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:12.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:12.485 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-03-16T18:23:12.701 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:12.704 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:12.705 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:12.706 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:12.706 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:13.065 INFO:teuthology.orchestra.run.smithi132.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:23:13.071 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/206 2024-03-16T18:23:13.071 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/206 2024-03-16T18:23:13.071 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:13.074 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:13.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:13.242 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-03-16T18:23:13.521 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:13.525 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:13.525 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:13.526 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:13.526 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:19.162 INFO:teuthology.orchestra.run.smithi132.stdout:generic/207 6s 2024-03-16T18:23:19.168 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/207 2024-03-16T18:23:19.168 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:23:19.170 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:19.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:23:19.225 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-03-16T18:23:19.605 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:23:19.609 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:23:19.610 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:23:19.611 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:23:19.611 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:23:29.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:23:29.080 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:23:59.201 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:23:59.205 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:24:29.266 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:24:29.269 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:24:59.403 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:24:59.407 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:25:29.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:25:29.711 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:25:59.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:25:59.775 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:26:29.921 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:26:29.927 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:26:40.022 INFO:teuthology.orchestra.run.smithi132.stdout:generic/208 200s 2024-03-16T18:26:40.027 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/208 2024-03-16T18:26:40.027 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:26:40.029 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:26:40.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:26:40.079 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-03-16T18:26:40.468 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:26:40.473 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:26:40.474 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:26:40.475 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:26:40.475 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:00.060 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:27:00.063 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:27:15.226 INFO:teuthology.orchestra.run.smithi132.stdout:generic/209 35s 2024-03-16T18:27:15.232 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/209 2024-03-16T18:27:15.232 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:15.234 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:15.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:15.293 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-03-16T18:27:15.683 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:15.687 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:15.687 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:15.688 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:16.026 INFO:teuthology.orchestra.run.smithi132.stdout:generic/210 1s 2024-03-16T18:27:16.031 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/210 2024-03-16T18:27:16.031 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:16.033 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:16.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:16.097 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-03-16T18:27:16.483 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:16.488 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:16.489 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:16.490 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:16.490 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:16.861 INFO:teuthology.orchestra.run.smithi132.stdout:generic/211 0s 2024-03-16T18:27:16.866 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/211 2024-03-16T18:27:16.866 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:16.869 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:16.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:16.885 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-03-16T18:27:17.064 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:17.068 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:17.068 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:17.069 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:17.069 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:17.362 INFO:teuthology.orchestra.run.smithi132.stdout:generic/212 0s 2024-03-16T18:27:17.367 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/212 2024-03-16T18:27:17.368 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:17.370 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:17.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:17.386 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-03-16T18:27:17.560 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:17.564 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:17.565 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:17.566 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:17.566 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:17.784 INFO:teuthology.orchestra.run.smithi132.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:27:17.788 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/213 2024-03-16T18:27:17.788 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/213 2024-03-16T18:27:17.788 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:17.790 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:17.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:17.803 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-03-16T18:27:17.997 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:18.001 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:18.001 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:18.002 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:18.002 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:18.241 INFO:teuthology.orchestra.run.smithi132.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:27:18.245 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/214 2024-03-16T18:27:18.245 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/214 2024-03-16T18:27:18.246 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:18.248 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:18.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:18.263 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-03-16T18:27:18.446 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:18.449 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:18.450 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:18.451 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:18.451 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:20.715 INFO:teuthology.orchestra.run.smithi132.stdout:generic/215 2s 2024-03-16T18:27:20.721 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/215 2024-03-16T18:27:20.721 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:20.723 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:20.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:20.750 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-03-16T18:27:20.928 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:20.932 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:20.932 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:20.933 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:20.933 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:21.281 INFO:teuthology.orchestra.run.smithi132.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:27:21.288 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/216 2024-03-16T18:27:21.288 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/216 2024-03-16T18:27:21.288 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:21.291 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:21.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:21.552 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-03-16T18:27:21.790 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:21.794 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:21.794 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:21.795 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:21.795 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:22.162 INFO:teuthology.orchestra.run.smithi132.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:27:22.169 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/217 2024-03-16T18:27:22.169 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/217 2024-03-16T18:27:22.170 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:22.171 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:22.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:22.368 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-03-16T18:27:22.632 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:22.636 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:22.636 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:22.637 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:22.637 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:22.987 INFO:teuthology.orchestra.run.smithi132.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:27:22.995 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/218 2024-03-16T18:27:22.995 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/218 2024-03-16T18:27:22.995 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:22.998 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:23.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:23.161 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-03-16T18:27:23.439 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:23.443 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:23.443 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:23.444 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:23.444 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:23.656 INFO:teuthology.orchestra.run.smithi132.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:27:23.659 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/219 2024-03-16T18:27:23.660 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/219 2024-03-16T18:27:23.660 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:23.662 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:23.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:23.687 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-03-16T18:27:23.864 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:23.868 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:23.868 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:23.869 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:23.870 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:24.213 INFO:teuthology.orchestra.run.smithi132.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:27:24.220 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/220 2024-03-16T18:27:24.220 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/220 2024-03-16T18:27:24.221 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:24.225 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:24.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:24.483 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-03-16T18:27:24.711 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:24.714 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:24.715 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:24.716 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:24.716 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:25.957 INFO:teuthology.orchestra.run.smithi132.stdout:generic/221 1s 2024-03-16T18:27:25.962 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/221 2024-03-16T18:27:25.962 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:25.964 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:25.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:25.985 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-03-16T18:27:26.168 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:26.172 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:26.172 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:26.173 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:26.173 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:26.544 INFO:teuthology.orchestra.run.smithi132.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:27:26.551 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/222 2024-03-16T18:27:26.551 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/222 2024-03-16T18:27:26.551 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:26.554 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:26.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:26.739 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-03-16T18:27:27.010 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:27.014 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:27.014 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:27.015 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:27.015 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:27.230 INFO:teuthology.orchestra.run.smithi132.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:27:27.234 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/223 2024-03-16T18:27:27.234 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/223 2024-03-16T18:27:27.235 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:27.237 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:27.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:27.269 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-03-16T18:27:27.456 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:27.460 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:27.460 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:27.461 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:27.461 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:27.667 INFO:teuthology.orchestra.run.smithi132.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:27:27.671 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/224 2024-03-16T18:27:27.671 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/224 2024-03-16T18:27:27.671 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:27.673 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:27.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:27.686 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-03-16T18:27:27.858 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:27.862 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:27.862 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:27.863 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:28.125 INFO:teuthology.orchestra.run.smithi132.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-16T18:27:28.129 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/225 2024-03-16T18:27:28.129 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/225 2024-03-16T18:27:28.129 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:28.132 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:28.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:28.180 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-03-16T18:27:28.599 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:28.602 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:28.603 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:28.604 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:28.604 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:28.849 INFO:teuthology.orchestra.run.smithi132.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:27:28.853 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/226 2024-03-16T18:27:28.853 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/226 2024-03-16T18:27:28.853 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:28.855 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:28.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:28.871 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-03-16T18:27:29.066 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:29.069 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:29.070 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:29.071 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:29.071 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:29.421 INFO:teuthology.orchestra.run.smithi132.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:27:29.426 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/227 2024-03-16T18:27:29.426 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/227 2024-03-16T18:27:29.427 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:29.430 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:29.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:29.664 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-03-16T18:27:29.905 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:29.909 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:29.909 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:29.910 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:29.910 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:30.144 INFO:teuthology.orchestra.run.smithi132.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:27:30.149 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/228 2024-03-16T18:27:30.149 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/228 2024-03-16T18:27:30.149 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:30.151 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:30.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:30.164 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-03-16T18:27:30.184 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:27:30.211 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:27:30.344 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:30.347 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:30.348 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:30.349 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:30.349 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:30.763 INFO:teuthology.orchestra.run.smithi132.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:27:30.773 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/229 2024-03-16T18:27:30.773 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/229 2024-03-16T18:27:30.773 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:30.775 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:30.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:30.944 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-03-16T18:27:31.211 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:31.214 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:31.215 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:31.215 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:31.215 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:31.435 INFO:teuthology.orchestra.run.smithi132.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:27:31.439 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/230 2024-03-16T18:27:31.439 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/230 2024-03-16T18:27:31.439 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:31.441 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:31.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:31.454 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-03-16T18:27:31.635 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:31.639 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:31.639 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:31.640 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:31.640 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:31.852 INFO:teuthology.orchestra.run.smithi132.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:27:31.855 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/231 2024-03-16T18:27:31.855 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/231 2024-03-16T18:27:31.856 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:31.858 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:31.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:31.878 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-03-16T18:27:32.060 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:32.064 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:32.064 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:32.065 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:32.065 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:32.283 INFO:teuthology.orchestra.run.smithi132.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:27:32.287 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/232 2024-03-16T18:27:32.287 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/232 2024-03-16T18:27:32.287 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:32.290 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:32.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:32.314 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-03-16T18:27:32.499 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:32.503 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:32.503 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:32.504 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:32.504 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:32.712 INFO:teuthology.orchestra.run.smithi132.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:27:32.716 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/233 2024-03-16T18:27:32.716 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/233 2024-03-16T18:27:32.716 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:32.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:32.733 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-03-16T18:27:32.925 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:32.928 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:32.929 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:32.930 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:32.930 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:33.136 INFO:teuthology.orchestra.run.smithi132.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:27:33.140 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/234 2024-03-16T18:27:33.140 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/234 2024-03-16T18:27:33.140 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:33.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:33.156 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-03-16T18:27:33.333 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:33.337 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:33.337 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:33.338 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:33.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:33.544 INFO:teuthology.orchestra.run.smithi132.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:27:33.548 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/235 2024-03-16T18:27:33.549 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/235 2024-03-16T18:27:33.549 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:33.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:33.564 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-03-16T18:27:33.748 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:33.751 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:33.752 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:33.753 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:33.753 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:35.029 INFO:teuthology.orchestra.run.smithi132.stdout:generic/236 2s 2024-03-16T18:27:35.034 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/236 2024-03-16T18:27:35.035 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:35.037 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:35.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:35.081 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-03-16T18:27:35.477 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:35.481 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:35.482 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:35.483 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:35.483 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:35.793 INFO:teuthology.orchestra.run.smithi132.stdout:generic/237 0s 2024-03-16T18:27:35.798 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/237 2024-03-16T18:27:35.798 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:35.800 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:35.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:35.847 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-03-16T18:27:36.234 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:36.238 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:36.239 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:36.241 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:36.241 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:36.583 INFO:teuthology.orchestra.run.smithi132.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:27:36.589 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/238 2024-03-16T18:27:36.589 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/238 2024-03-16T18:27:36.589 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:36.592 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:36.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:36.803 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-03-16T18:27:37.052 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:37.056 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:37.056 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:37.057 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:37.057 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:37.282 INFO:teuthology.orchestra.run.smithi132.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-03-16T18:27:37.285 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/239 2024-03-16T18:27:37.285 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/239 2024-03-16T18:27:37.285 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:37.287 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:37.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:37.311 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-03-16T18:27:37.490 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:37.494 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:37.494 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:37.495 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:37.495 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:37.713 INFO:teuthology.orchestra.run.smithi132.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-03-16T18:27:37.717 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/240 2024-03-16T18:27:37.717 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/240 2024-03-16T18:27:37.718 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:27:37.720 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:27:37.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:27:37.742 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-03-16T18:27:37.919 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:27:37.923 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:27:37.923 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:27:37.925 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:27:37.925 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:00.461 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:28:00.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:28:30.536 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:28:30.540 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:28:51.127 INFO:teuthology.orchestra.run.smithi132.stdout:generic/241 73s 2024-03-16T18:28:51.132 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/241 2024-03-16T18:28:51.132 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:28:51.134 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:52.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:28:52.106 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-03-16T18:28:52.447 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:28:52.451 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:28:52.451 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:28:52.452 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:28:52.452 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:53.186 INFO:teuthology.orchestra.run.smithi132.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:28:53.193 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/242 2024-03-16T18:28:53.193 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/242 2024-03-16T18:28:53.193 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:28:53.196 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:53.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:28:53.247 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-03-16T18:28:53.616 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:28:53.625 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:28:53.626 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:28:53.627 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:28:53.627 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:54.113 INFO:teuthology.orchestra.run.smithi132.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:28:54.120 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/243 2024-03-16T18:28:54.120 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/243 2024-03-16T18:28:54.120 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:28:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:54.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:28:54.178 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-03-16T18:28:54.527 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:28:54.532 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:28:54.533 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:28:54.535 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:28:54.535 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:54.995 INFO:teuthology.orchestra.run.smithi132.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:28:54.999 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/244 2024-03-16T18:28:54.999 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/244 2024-03-16T18:28:54.999 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:28:55.001 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:55.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:28:55.013 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-03-16T18:28:55.189 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:28:55.193 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:28:55.193 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:28:55.194 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:28:55.195 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:55.519 INFO:teuthology.orchestra.run.smithi132.stdout:generic/245 0s 2024-03-16T18:28:55.558 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/245 2024-03-16T18:28:55.558 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:28:55.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:55.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:28:55.620 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-03-16T18:28:56.004 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:28:56.010 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:28:56.010 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:28:56.012 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:28:56.012 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:56.307 INFO:teuthology.orchestra.run.smithi132.stdout:generic/246 0s 2024-03-16T18:28:56.313 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/246 2024-03-16T18:28:56.313 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:28:56.315 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:28:56.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:28:56.377 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-03-16T18:28:56.776 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:28:56.780 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:28:56.780 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:28:56.781 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:28:56.782 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:00.685 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:29:00.688 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:29:00.723 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T18:29:00.723+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 264428) UID: 0 2024-03-16T18:29:00.723 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T18:29:00.723+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 264428) UID: 0 2024-03-16T18:29:02.855 INFO:teuthology.orchestra.run.smithi132.stdout:generic/247 6s 2024-03-16T18:29:02.860 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/247 2024-03-16T18:29:02.860 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:02.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:02.871 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-03-16T18:29:03.095 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:03.099 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:03.099 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:03.100 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:03.100 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:03.366 INFO:teuthology.orchestra.run.smithi132.stdout:generic/248 0s 2024-03-16T18:29:03.371 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/248 2024-03-16T18:29:03.371 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:03.373 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:03.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:03.395 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-03-16T18:29:03.582 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:03.585 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:03.586 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:03.587 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:03.587 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:04.023 INFO:teuthology.orchestra.run.smithi132.stdout:generic/249 1s 2024-03-16T18:29:04.028 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/249 2024-03-16T18:29:04.029 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:04.031 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:04.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:04.092 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-03-16T18:29:04.501 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:04.510 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:04.510 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:04.512 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:04.512 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:04.810 INFO:teuthology.orchestra.run.smithi132.stdout:generic/250 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:29:04.814 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/250 2024-03-16T18:29:04.814 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/250 2024-03-16T18:29:04.814 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:04.816 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:04.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:04.828 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-03-16T18:29:05.013 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:05.017 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:05.018 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:05.018 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:05.018 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:05.302 INFO:teuthology.orchestra.run.smithi132.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:05.309 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/251 2024-03-16T18:29:05.309 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/251 2024-03-16T18:29:05.309 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:05.312 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:05.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:05.323 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-03-16T18:29:05.499 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:05.502 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:05.503 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:05.504 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:05.504 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:05.738 INFO:teuthology.orchestra.run.smithi132.stdout:generic/252 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:29:05.742 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/252 2024-03-16T18:29:05.742 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/252 2024-03-16T18:29:05.742 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:05.744 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:05.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:05.756 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-03-16T18:29:05.956 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:05.960 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:05.960 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:05.961 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:05.961 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:06.313 INFO:teuthology.orchestra.run.smithi132.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:06.320 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/253 2024-03-16T18:29:06.320 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/253 2024-03-16T18:29:06.320 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:06.324 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:06.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:06.405 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-03-16T18:29:06.797 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:06.801 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:06.801 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:06.802 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:07.134 INFO:teuthology.orchestra.run.smithi132.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:07.142 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/254 2024-03-16T18:29:07.143 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/254 2024-03-16T18:29:07.144 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:07.154 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:07.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:07.217 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-03-16T18:29:07.609 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:07.614 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:07.615 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:07.616 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:07.616 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:07.937 INFO:teuthology.orchestra.run.smithi132.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:29:07.941 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/255 2024-03-16T18:29:07.941 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/255 2024-03-16T18:29:07.941 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:07.943 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:07.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:07.991 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-03-16T18:29:08.378 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:08.384 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:08.385 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:08.386 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:08.386 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:09.112 INFO:teuthology.orchestra.run.smithi132.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:29:09.116 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/256 2024-03-16T18:29:09.116 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/256 2024-03-16T18:29:09.116 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:09.118 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:09.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:09.130 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-03-16T18:29:09.307 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:09.311 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:09.311 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:09.312 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:09.312 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:09.974 INFO:teuthology.orchestra.run.smithi132.stdout:generic/257 0s 2024-03-16T18:29:09.979 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/257 2024-03-16T18:29:09.980 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:09.982 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:10.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:10.051 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-03-16T18:29:10.402 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:10.406 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:10.406 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:10.407 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:10.407 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:10.712 INFO:teuthology.orchestra.run.smithi132.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-03-16T18:29:10.716 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/258 2024-03-16T18:29:10.716 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/258 2024-03-16T18:29:10.716 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:10.718 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:10.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:10.743 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-03-16T18:29:10.918 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:10.922 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:10.923 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:10.924 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:10.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:11.268 INFO:teuthology.orchestra.run.smithi132.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:11.275 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/259 2024-03-16T18:29:11.275 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/259 2024-03-16T18:29:11.275 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:11.277 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:11.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:11.330 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-03-16T18:29:11.699 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:11.706 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:11.707 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:11.708 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:11.709 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:12.010 INFO:teuthology.orchestra.run.smithi132.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:12.017 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/260 2024-03-16T18:29:12.017 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/260 2024-03-16T18:29:12.017 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:12.019 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:12.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:12.030 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-03-16T18:29:12.210 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:12.213 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:12.214 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:12.215 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:12.215 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:12.551 INFO:teuthology.orchestra.run.smithi132.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:12.559 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/261 2024-03-16T18:29:12.559 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/261 2024-03-16T18:29:12.559 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:12.564 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:12.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:12.705 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-03-16T18:29:13.028 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:13.033 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:13.033 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:13.035 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:13.035 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:13.394 INFO:teuthology.orchestra.run.smithi132.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:13.401 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/262 2024-03-16T18:29:13.401 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/262 2024-03-16T18:29:13.401 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:13.406 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:13.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:13.494 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-03-16T18:29:13.836 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:13.839 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:13.840 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:13.841 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:50.386 INFO:teuthology.orchestra.run.smithi132.stdout:generic/263 37s 2024-03-16T18:29:50.390 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/263 2024-03-16T18:29:50.391 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:50.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:50.438 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-03-16T18:29:50.903 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:50.907 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:50.908 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:50.910 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:50.910 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:51.267 INFO:teuthology.orchestra.run.smithi132.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:51.273 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/264 2024-03-16T18:29:51.274 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/264 2024-03-16T18:29:51.274 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:51.277 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:51.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:51.510 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-03-16T18:29:51.812 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:51.815 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:51.816 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:51.817 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:51.817 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:52.200 INFO:teuthology.orchestra.run.smithi132.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:52.206 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/265 2024-03-16T18:29:52.206 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/265 2024-03-16T18:29:52.206 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:52.216 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:52.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:52.454 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-03-16T18:29:52.767 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:52.771 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:52.771 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:52.772 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:52.772 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:53.162 INFO:teuthology.orchestra.run.smithi132.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:53.168 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/266 2024-03-16T18:29:53.168 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/266 2024-03-16T18:29:53.168 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:53.171 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:53.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:53.421 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-03-16T18:29:53.730 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:53.734 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:53.734 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:53.735 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:53.735 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:54.123 INFO:teuthology.orchestra.run.smithi132.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:54.130 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/267 2024-03-16T18:29:54.130 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/267 2024-03-16T18:29:54.130 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:54.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:54.346 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-03-16T18:29:54.656 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:54.659 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:54.660 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:54.661 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:54.661 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:55.032 INFO:teuthology.orchestra.run.smithi132.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:55.039 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/268 2024-03-16T18:29:55.039 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/268 2024-03-16T18:29:55.040 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:55.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:55.309 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-03-16T18:29:55.576 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:55.579 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:55.580 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:55.581 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:55.581 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:55.809 INFO:teuthology.orchestra.run.smithi132.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:29:55.813 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/269 2024-03-16T18:29:55.813 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/269 2024-03-16T18:29:55.813 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:55.815 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:55.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:55.841 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-03-16T18:29:56.017 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:56.021 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:56.022 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:56.023 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:56.023 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:56.228 INFO:teuthology.orchestra.run.smithi132.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:29:56.232 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/270 2024-03-16T18:29:56.232 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/270 2024-03-16T18:29:56.232 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:56.234 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:56.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:56.263 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-03-16T18:29:56.444 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:56.448 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:56.448 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:56.449 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:56.449 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:56.826 INFO:teuthology.orchestra.run.smithi132.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:56.831 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/271 2024-03-16T18:29:56.831 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/271 2024-03-16T18:29:56.831 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:56.834 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:57.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:57.024 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-03-16T18:29:57.306 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:57.309 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:57.310 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:57.311 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:57.311 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:57.676 INFO:teuthology.orchestra.run.smithi132.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:57.681 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/272 2024-03-16T18:29:57.681 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/272 2024-03-16T18:29:57.682 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:57.685 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:57.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:57.922 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-03-16T18:29:58.183 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:58.187 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:58.187 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:58.188 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:58.188 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:58.405 INFO:teuthology.orchestra.run.smithi132.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:29:58.409 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/273 2024-03-16T18:29:58.409 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/273 2024-03-16T18:29:58.409 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:58.411 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:58.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:58.424 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-03-16T18:29:58.608 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:58.612 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:58.612 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:58.614 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:58.614 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:58.839 INFO:teuthology.orchestra.run.smithi132.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-16T18:29:58.842 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/274 2024-03-16T18:29:58.842 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/274 2024-03-16T18:29:58.843 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:58.845 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:58.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:58.862 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-03-16T18:29:59.047 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:59.051 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:59.051 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:59.052 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:59.052 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:59.264 INFO:teuthology.orchestra.run.smithi132.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:29:59.268 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/275 2024-03-16T18:29:59.268 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/275 2024-03-16T18:29:59.268 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:59.270 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:59.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:29:59.293 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-03-16T18:29:59.482 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:29:59.486 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:29:59.486 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:29:59.487 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:29:59.487 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:29:59.871 INFO:teuthology.orchestra.run.smithi132.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:29:59.876 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/276 2024-03-16T18:29:59.877 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/276 2024-03-16T18:29:59.877 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:29:59.881 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:00.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:00.112 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-03-16T18:30:00.405 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:00.409 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:00.410 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:00.410 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:00.411 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:00.679 INFO:teuthology.orchestra.run.smithi132.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-03-16T18:30:00.683 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/277 2024-03-16T18:30:00.683 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/277 2024-03-16T18:30:00.683 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:00.685 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:00.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:00.704 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-03-16T18:30:00.879 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:00.882 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:00.883 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:00.884 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:00.884 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:01.259 INFO:teuthology.orchestra.run.smithi132.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:01.265 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/278 2024-03-16T18:30:01.266 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/278 2024-03-16T18:30:01.266 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:01.269 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:01.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:01.486 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-03-16T18:30:01.765 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:01.769 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:01.769 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:01.770 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:01.770 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:02.158 INFO:teuthology.orchestra.run.smithi132.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:02.169 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/279 2024-03-16T18:30:02.169 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/279 2024-03-16T18:30:02.169 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:02.172 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:02.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:02.401 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-03-16T18:30:02.650 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:02.654 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:02.654 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:02.655 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:02.655 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:03.001 INFO:teuthology.orchestra.run.smithi132.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:30:03.005 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/280 2024-03-16T18:30:03.005 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/280 2024-03-16T18:30:03.006 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:03.008 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:03.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:03.036 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-03-16T18:30:03.225 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:03.229 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:03.229 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:03.230 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:03.230 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:03.612 INFO:teuthology.orchestra.run.smithi132.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:03.618 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/281 2024-03-16T18:30:03.618 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/281 2024-03-16T18:30:03.618 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:03.620 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:03.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:03.900 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-03-16T18:30:04.168 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:04.172 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:04.172 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:04.173 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:04.173 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:04.581 INFO:teuthology.orchestra.run.smithi132.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:04.599 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/282 2024-03-16T18:30:04.600 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/282 2024-03-16T18:30:04.601 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:04.613 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:04.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:04.805 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-03-16T18:30:05.076 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:05.080 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:05.080 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:05.081 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:05.082 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:05.471 INFO:teuthology.orchestra.run.smithi132.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:05.478 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/283 2024-03-16T18:30:05.478 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/283 2024-03-16T18:30:05.478 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:05.483 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:05.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:05.705 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-03-16T18:30:06.003 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:06.007 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:06.007 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:06.008 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:06.008 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:06.389 INFO:teuthology.orchestra.run.smithi132.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:06.394 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/284 2024-03-16T18:30:06.394 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/284 2024-03-16T18:30:06.394 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:06.398 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:06.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:06.592 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-03-16T18:30:06.872 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:06.876 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:06.877 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:06.877 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:06.878 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:08.126 INFO:teuthology.orchestra.run.smithi132.stdout:generic/285 2s 2024-03-16T18:30:08.131 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/285 2024-03-16T18:30:08.131 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:08.134 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:08.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:08.529 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-03-16T18:30:09.021 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:09.027 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:09.027 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:09.028 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:09.028 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:09.337 INFO:teuthology.orchestra.run.smithi132.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:30:09.342 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/286 2024-03-16T18:30:09.342 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/286 2024-03-16T18:30:09.342 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:09.346 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:09.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:09.370 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-03-16T18:30:09.656 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:09.660 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:09.661 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:09.661 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:09.662 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:10.198 INFO:teuthology.orchestra.run.smithi132.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:10.204 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/287 2024-03-16T18:30:10.204 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/287 2024-03-16T18:30:10.204 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:10.208 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:10.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:10.444 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-03-16T18:30:10.762 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:10.768 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:10.768 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:10.769 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:10.769 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:11.182 INFO:teuthology.orchestra.run.smithi132.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:11.201 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/288 2024-03-16T18:30:11.201 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/288 2024-03-16T18:30:11.201 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:11.204 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:11.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:11.227 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-03-16T18:30:11.522 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:11.527 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:11.528 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:11.529 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:11.529 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:12.036 INFO:teuthology.orchestra.run.smithi132.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:12.043 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/289 2024-03-16T18:30:12.043 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/289 2024-03-16T18:30:12.043 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:12.045 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:12.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:12.298 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-03-16T18:30:12.642 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:12.648 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:12.648 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:12.650 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:12.650 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:13.172 INFO:teuthology.orchestra.run.smithi132.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:13.186 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/290 2024-03-16T18:30:13.186 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/290 2024-03-16T18:30:13.186 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:13.190 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:13.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:13.408 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-03-16T18:30:13.749 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:13.753 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:13.754 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:13.755 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:13.755 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:14.260 INFO:teuthology.orchestra.run.smithi132.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:14.265 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/291 2024-03-16T18:30:14.266 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/291 2024-03-16T18:30:14.266 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:14.269 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:14.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:14.598 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-03-16T18:30:14.901 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:14.908 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:14.908 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:14.910 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:15.426 INFO:teuthology.orchestra.run.smithi132.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:15.432 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/292 2024-03-16T18:30:15.433 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/292 2024-03-16T18:30:15.433 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:15.434 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:15.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:15.588 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-03-16T18:30:15.915 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:15.919 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:15.919 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:15.920 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:15.920 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:16.364 INFO:teuthology.orchestra.run.smithi132.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:16.371 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/293 2024-03-16T18:30:16.371 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/293 2024-03-16T18:30:16.371 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:16.373 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:16.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:16.543 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-03-16T18:30:16.857 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:16.860 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:16.860 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:16.861 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:16.861 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:17.512 INFO:teuthology.orchestra.run.smithi132.stdout:generic/294 1s 2024-03-16T18:30:17.520 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/294 2024-03-16T18:30:17.520 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:17.525 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:17.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:17.539 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-03-16T18:30:17.901 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:17.905 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:17.905 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:17.906 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:17.906 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:18.311 INFO:teuthology.orchestra.run.smithi132.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:18.317 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/295 2024-03-16T18:30:18.317 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/295 2024-03-16T18:30:18.318 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:18.320 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:18.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:18.533 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-03-16T18:30:18.808 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:18.812 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:18.812 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:18.813 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:18.813 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:19.176 INFO:teuthology.orchestra.run.smithi132.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:19.181 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/296 2024-03-16T18:30:19.182 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/296 2024-03-16T18:30:19.182 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:19.185 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:19.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:19.453 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-03-16T18:30:19.702 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:19.706 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:19.707 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:19.708 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:19.708 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:20.093 INFO:teuthology.orchestra.run.smithi132.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/297 2024-03-16T18:30:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/297 2024-03-16T18:30:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:20.109 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:20.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:20.379 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-03-16T18:30:20.643 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:20.647 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:20.648 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:20.648 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:20.648 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:21.048 INFO:teuthology.orchestra.run.smithi132.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:21.054 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/298 2024-03-16T18:30:21.054 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/298 2024-03-16T18:30:21.054 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:21.060 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:21.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:21.299 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-03-16T18:30:21.607 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:21.611 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:21.611 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:21.612 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:21.612 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:21.924 INFO:teuthology.orchestra.run.smithi132.stdout:generic/299 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:30:21.928 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/299 2024-03-16T18:30:21.928 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/299 2024-03-16T18:30:21.928 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:21.930 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:21.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:21.948 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-03-16T18:30:22.128 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:22.131 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:22.132 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:22.133 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:22.133 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:22.402 INFO:teuthology.orchestra.run.smithi132.stdout:generic/300 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:30:22.406 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/300 2024-03-16T18:30:22.406 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/300 2024-03-16T18:30:22.406 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:22.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:22.426 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-03-16T18:30:22.606 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:22.610 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:22.610 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:22.611 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:22.611 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:22.968 INFO:teuthology.orchestra.run.smithi132.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:22.973 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/301 2024-03-16T18:30:22.973 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/301 2024-03-16T18:30:22.973 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:22.976 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:23.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:23.302 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-03-16T18:30:23.526 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:23.573 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:23.573 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:23.573 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:23.573 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:23.906 INFO:teuthology.orchestra.run.smithi132.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:23.913 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/302 2024-03-16T18:30:23.913 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/302 2024-03-16T18:30:23.913 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:23.915 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:24.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:24.206 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-03-16T18:30:24.439 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:24.443 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:24.443 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:24.444 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:24.444 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:24.692 INFO:teuthology.orchestra.run.smithi132.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:30:24.696 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/303 2024-03-16T18:30:24.696 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/303 2024-03-16T18:30:24.696 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:24.698 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:24.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:24.763 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-03-16T18:30:25.215 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:25.219 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:25.219 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:25.220 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:25.220 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:25.475 INFO:teuthology.orchestra.run.smithi132.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-16T18:30:25.478 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/304 2024-03-16T18:30:25.478 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/304 2024-03-16T18:30:25.479 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:25.481 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:25.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:25.548 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-03-16T18:30:25.926 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:25.938 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:25.938 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:25.940 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:25.940 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:26.310 INFO:teuthology.orchestra.run.smithi132.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:30:26.315 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/305 2024-03-16T18:30:26.315 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/305 2024-03-16T18:30:26.316 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:26.319 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:26.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:26.556 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-03-16T18:30:26.838 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:26.842 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:26.842 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:26.843 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:26.843 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:27.462 INFO:teuthology.orchestra.run.smithi132.stdout:generic/306 1s 2024-03-16T18:30:27.470 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/306 2024-03-16T18:30:27.470 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:27.472 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:27.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:27.650 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-03-16T18:30:28.042 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:28.047 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:28.047 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:28.048 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:28.048 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:29.617 INFO:teuthology.orchestra.run.smithi132.stdout:generic/307 1s 2024-03-16T18:30:29.623 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/307 2024-03-16T18:30:29.623 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:29.626 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:29.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:29.634 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-03-16T18:30:29.811 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:29.815 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:29.815 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:29.816 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:29.816 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:30.056 INFO:teuthology.orchestra.run.smithi132.stdout:generic/308 1s 2024-03-16T18:30:30.062 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/308 2024-03-16T18:30:30.062 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:30.064 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:30.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:30.085 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-03-16T18:30:30.256 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:30.260 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:30.260 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:30.261 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:30.261 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:31.541 INFO:teuthology.orchestra.run.smithi132.stdout:generic/309 1s 2024-03-16T18:30:31.546 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/309 2024-03-16T18:30:31.546 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:30:31.548 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:30:31.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:30:31.591 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-03-16T18:30:31.999 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:30:32.005 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:30:32.008 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:30:32.010 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:30:32.010 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:43.594 INFO:teuthology.orchestra.run.smithi132.stdout:generic/310 71s 2024-03-16T18:31:43.599 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/310 2024-03-16T18:31:43.600 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:43.602 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:43.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:43.703 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-03-16T18:31:44.052 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:44.059 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:44.060 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:44.061 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:44.061 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:44.526 INFO:teuthology.orchestra.run.smithi132.stdout:generic/311 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:31:44.530 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/311 2024-03-16T18:31:44.530 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/311 2024-03-16T18:31:44.530 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:44.532 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:44.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:44.546 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-03-16T18:31:44.740 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:44.743 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:44.743 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:44.745 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:44.745 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:44.956 INFO:teuthology.orchestra.run.smithi132.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:31:44.960 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/312 2024-03-16T18:31:44.960 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/312 2024-03-16T18:31:44.960 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:44.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:44.977 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-03-16T18:31:45.148 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:45.151 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:45.152 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:45.153 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:45.153 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:48.150 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:31:48.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:31:49.407 INFO:teuthology.orchestra.run.smithi132.stdout:generic/313 4s 2024-03-16T18:31:49.412 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/313 2024-03-16T18:31:49.412 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:49.414 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:49.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:49.426 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-03-16T18:31:49.618 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:49.622 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:49.622 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:49.623 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:49.623 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:50.164 INFO:teuthology.orchestra.run.smithi132.stdout:generic/314 1s 2024-03-16T18:31:50.170 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/314 2024-03-16T18:31:50.170 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:50.172 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:50.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:50.187 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-03-16T18:31:50.370 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:50.373 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:50.374 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:50.375 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:50.589 INFO:teuthology.orchestra.run.smithi132.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-16T18:31:50.594 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/315 2024-03-16T18:31:50.594 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/315 2024-03-16T18:31:50.594 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:50.596 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:50.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:50.611 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-03-16T18:31:50.793 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:50.796 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:50.797 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:50.798 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:50.798 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:51.113 INFO:teuthology.orchestra.run.smithi132.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-16T18:31:51.117 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/316 2024-03-16T18:31:51.118 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/316 2024-03-16T18:31:51.118 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:51.120 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:51.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:51.167 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-03-16T18:31:51.593 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:51.596 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:51.597 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:51.598 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:51.598 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:55.342 INFO:teuthology.orchestra.run.smithi132.stdout:generic/317 4s 2024-03-16T18:31:55.349 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/317 2024-03-16T18:31:55.349 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:55.350 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:55.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:55.359 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-03-16T18:31:55.538 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:55.542 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:55.543 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:55.544 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:55.544 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:56.044 INFO:teuthology.orchestra.run.smithi132.stdout:generic/318 1s 2024-03-16T18:31:56.050 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/318 2024-03-16T18:31:56.050 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:56.052 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:56.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:56.062 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-03-16T18:31:56.237 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:56.240 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:56.241 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:56.242 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:56.242 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:56.574 INFO:teuthology.orchestra.run.smithi132.stdout:generic/319 0s 2024-03-16T18:31:56.580 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/319 2024-03-16T18:31:56.580 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:56.582 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:56.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:56.591 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-03-16T18:31:56.772 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:56.775 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:56.776 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:56.777 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:56.777 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:57.000 INFO:teuthology.orchestra.run.smithi132.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:31:57.004 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/320 2024-03-16T18:31:57.004 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/320 2024-03-16T18:31:57.004 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:57.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:57.018 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-03-16T18:31:57.192 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:57.197 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:57.198 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:57.198 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:57.198 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:57.424 INFO:teuthology.orchestra.run.smithi132.stdout:generic/321 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:31:57.428 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/321 2024-03-16T18:31:57.428 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/321 2024-03-16T18:31:57.428 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:57.430 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:57.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:57.442 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-03-16T18:31:57.623 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:57.627 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:57.627 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:57.628 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:57.628 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:57.842 INFO:teuthology.orchestra.run.smithi132.stdout:generic/322 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:31:57.846 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/322 2024-03-16T18:31:57.846 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/322 2024-03-16T18:31:57.846 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:31:57.848 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:31:57.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:31:57.861 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-03-16T18:31:58.041 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:31:58.045 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:31:58.045 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:31:58.046 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:31:58.046 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:32:18.294 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:32:18.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:32:48.433 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:32:48.436 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:33:18.726 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:33:18.729 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:33:18.766 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T18:33:18.766+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 305493) UID: 0 2024-03-16T18:33:18.766 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T18:33:18.766+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 305493) UID: 0 2024-03-16T18:33:18.766 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T18:33:18.766+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 305493) UID: 0 2024-03-16T18:33:18.767 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T18:33:18.766+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 305493) UID: 0 2024-03-16T18:33:59.233 INFO:teuthology.orchestra.run.smithi132.stdout:generic/323 121s 2024-03-16T18:33:59.297 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/323 2024-03-16T18:33:59.298 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:33:59.298 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:33:59.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:33:59.381 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-03-16T18:34:01.016 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:01.020 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:01.021 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:01.021 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:01.759 INFO:teuthology.orchestra.run.smithi132.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-03-16T18:34:01.763 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/324 2024-03-16T18:34:01.763 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/324 2024-03-16T18:34:01.763 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:01.765 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:01.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:01.777 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-03-16T18:34:01.951 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:01.955 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:01.955 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:01.956 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:01.957 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:02.379 INFO:teuthology.orchestra.run.smithi132.stdout:generic/325 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:34:02.383 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/325 2024-03-16T18:34:02.383 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/325 2024-03-16T18:34:02.383 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:02.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:02.398 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-03-16T18:34:02.580 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:02.583 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:02.584 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:02.585 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:02.585 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:02.968 INFO:teuthology.orchestra.run.smithi132.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:34:02.975 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/326 2024-03-16T18:34:02.975 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/326 2024-03-16T18:34:02.976 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:02.977 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:03.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:03.257 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-03-16T18:34:03.468 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:03.472 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:03.472 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:03.473 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:03.473 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:03.820 INFO:teuthology.orchestra.run.smithi132.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:34:03.826 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/327 2024-03-16T18:34:03.826 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/327 2024-03-16T18:34:03.826 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:03.830 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:04.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:04.143 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-03-16T18:34:04.336 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:04.340 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:04.340 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:04.341 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:04.341 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:04.702 INFO:teuthology.orchestra.run.smithi132.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:34:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/328 2024-03-16T18:34:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/328 2024-03-16T18:34:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:04.711 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:05.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:05.034 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-03-16T18:34:05.230 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:05.234 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:05.234 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:05.235 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:05.235 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:05.630 INFO:teuthology.orchestra.run.smithi132.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:34:05.635 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/329 2024-03-16T18:34:05.635 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/329 2024-03-16T18:34:05.636 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:05.639 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:05.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:05.954 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-03-16T18:34:06.145 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:06.149 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:06.150 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:06.151 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:06.151 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:06.704 INFO:teuthology.orchestra.run.smithi132.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:34:06.711 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/330 2024-03-16T18:34:06.711 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/330 2024-03-16T18:34:06.711 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:06.713 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:07.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:07.095 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-03-16T18:34:07.279 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:07.283 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:07.283 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:07.284 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:07.284 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:07.682 INFO:teuthology.orchestra.run.smithi132.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:34:07.689 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/331 2024-03-16T18:34:07.689 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/331 2024-03-16T18:34:07.689 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:07.694 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:07.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:07.998 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-03-16T18:34:08.185 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:08.189 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:08.189 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:08.190 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:08.190 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:08.891 INFO:teuthology.orchestra.run.smithi132.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:34:08.897 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/332 2024-03-16T18:34:08.897 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/332 2024-03-16T18:34:08.898 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:08.901 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:09.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:09.107 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-03-16T18:34:09.365 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:09.368 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:09.369 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:09.370 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:09.370 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:09.806 INFO:teuthology.orchestra.run.smithi132.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:34:09.812 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/333 2024-03-16T18:34:09.813 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/333 2024-03-16T18:34:09.813 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:09.818 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:10.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:10.184 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-03-16T18:34:10.377 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:10.381 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:10.381 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:10.382 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:10.382 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:10.744 INFO:teuthology.orchestra.run.smithi132.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:34:10.749 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/334 2024-03-16T18:34:10.753 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/334 2024-03-16T18:34:10.753 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:10.758 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:11.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:11.151 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-03-16T18:34:11.338 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:11.341 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:11.342 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:11.343 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:11.343 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:11.565 INFO:teuthology.orchestra.run.smithi132.stdout:generic/335 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:34:11.569 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/335 2024-03-16T18:34:11.569 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/335 2024-03-16T18:34:11.569 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:11.571 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:11.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:11.583 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-03-16T18:34:11.753 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:11.756 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:11.757 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:11.758 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:11.758 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:12.016 INFO:teuthology.orchestra.run.smithi132.stdout:generic/336 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:34:12.019 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/336 2024-03-16T18:34:12.019 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/336 2024-03-16T18:34:12.020 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:12.022 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:12.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:12.038 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-03-16T18:34:12.225 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:12.229 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:12.229 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:12.230 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:12.230 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:12.638 INFO:teuthology.orchestra.run.smithi132.stdout:generic/337 0s 2024-03-16T18:34:12.643 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/337 2024-03-16T18:34:12.643 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:12.645 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:12.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:12.654 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-03-16T18:34:12.847 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:12.850 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:12.850 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:12.851 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:12.851 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:13.090 INFO:teuthology.orchestra.run.smithi132.stdout:generic/338 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:34:13.093 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/338 2024-03-16T18:34:13.093 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/338 2024-03-16T18:34:13.093 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:34:13.096 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:34:13.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:34:13.108 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-03-16T18:34:13.281 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:34:13.284 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:34:13.285 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:34:13.286 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:34:13.286 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:08.063 INFO:teuthology.orchestra.run.smithi132.stdout:generic/339 55s 2024-03-16T18:35:08.088 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/339 2024-03-16T18:35:08.088 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:08.090 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:08.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:08.120 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-03-16T18:35:08.734 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:08.738 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:08.738 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:08.739 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:08.739 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:11.357 INFO:teuthology.orchestra.run.smithi132.stdout:generic/340 3s 2024-03-16T18:35:11.367 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/340 2024-03-16T18:35:11.367 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:11.370 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:11.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:11.400 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-03-16T18:35:11.868 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:11.875 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:11.875 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:11.877 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:11.877 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:12.267 INFO:teuthology.orchestra.run.smithi132.stdout:generic/341 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:35:12.274 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/341 2024-03-16T18:35:12.274 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/341 2024-03-16T18:35:12.274 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:12.279 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:12.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:12.296 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-03-16T18:35:12.558 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:12.562 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:12.562 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:12.563 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:12.563 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:12.777 INFO:teuthology.orchestra.run.smithi132.stdout:generic/342 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:35:12.781 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/342 2024-03-16T18:35:12.781 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/342 2024-03-16T18:35:12.781 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:12.783 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:12.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:12.796 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-03-16T18:35:12.979 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:12.983 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:12.984 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:12.984 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:12.984 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:13.220 INFO:teuthology.orchestra.run.smithi132.stdout:generic/343 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:35:13.224 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/343 2024-03-16T18:35:13.224 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/343 2024-03-16T18:35:13.224 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:13.226 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:13.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:13.244 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-03-16T18:35:13.421 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:13.423 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:13.424 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:13.425 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:13.425 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:17.752 INFO:teuthology.orchestra.run.smithi132.stdout:generic/344 4s 2024-03-16T18:35:17.766 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/344 2024-03-16T18:35:17.766 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:17.769 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:17.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:17.786 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-03-16T18:35:18.250 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:18.254 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:18.254 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:18.255 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:18.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:23.656 INFO:teuthology.orchestra.run.smithi132.stdout:generic/345 5s 2024-03-16T18:35:23.724 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/345 2024-03-16T18:35:23.724 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:23.728 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:23.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:23.740 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-03-16T18:35:24.129 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:24.133 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:24.133 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:24.134 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:24.134 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:27.315 INFO:teuthology.orchestra.run.smithi132.stdout:generic/346 3s 2024-03-16T18:35:27.351 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/346 2024-03-16T18:35:27.351 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:27.354 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:27.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:27.366 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-03-16T18:35:27.714 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:27.719 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:27.719 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:27.720 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:27.721 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:28.136 INFO:teuthology.orchestra.run.smithi132.stdout:generic/347 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:35:28.139 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/347 2024-03-16T18:35:28.140 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/347 2024-03-16T18:35:28.140 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:28.142 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:28.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:28.155 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-03-16T18:35:28.332 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:28.336 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:28.336 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:28.337 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:28.337 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:28.576 INFO:teuthology.orchestra.run.smithi132.stdout:generic/348 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:35:28.581 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/348 2024-03-16T18:35:28.582 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/348 2024-03-16T18:35:28.582 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:28.582 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:28.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:28.600 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-03-16T18:35:28.773 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:28.777 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:28.777 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:28.778 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:28.778 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:29.120 INFO:teuthology.orchestra.run.smithi132.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-16T18:35:29.124 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/349 2024-03-16T18:35:29.124 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/349 2024-03-16T18:35:29.124 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:29.126 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:29.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:29.146 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-03-16T18:35:29.326 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:29.330 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:29.330 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:29.331 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:29.332 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:30.026 INFO:teuthology.orchestra.run.smithi132.stdout:generic/350 1s 2024-03-16T18:35:30.033 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/350 2024-03-16T18:35:30.033 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:30.035 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:30.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:30.045 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-03-16T18:35:30.248 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:30.252 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:30.252 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:30.253 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:30.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:30.494 INFO:teuthology.orchestra.run.smithi132.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:35:30.498 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/351 2024-03-16T18:35:30.498 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/351 2024-03-16T18:35:30.498 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:30.500 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:30.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:30.517 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-03-16T18:35:30.691 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:30.695 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:30.695 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:30.696 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:31.053 INFO:teuthology.orchestra.run.smithi132.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:35:31.060 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/352 2024-03-16T18:35:31.060 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/352 2024-03-16T18:35:31.060 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:31.062 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:31.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:31.452 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-03-16T18:35:31.654 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:31.658 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:31.659 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:31.659 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:31.660 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:32.023 INFO:teuthology.orchestra.run.smithi132.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:35:32.030 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/353 2024-03-16T18:35:32.030 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/353 2024-03-16T18:35:32.030 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:32.032 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:32.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:32.373 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-03-16T18:35:32.631 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:32.635 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:32.635 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:32.636 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:32.636 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:37.071 INFO:teuthology.orchestra.run.smithi132.stdout:generic/354 5s 2024-03-16T18:35:37.083 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/354 2024-03-16T18:35:37.083 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:37.085 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:37.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:37.098 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-03-16T18:35:37.584 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:37.589 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:37.590 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:37.593 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:37.593 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:38.788 INFO:teuthology.orchestra.run.smithi132.stdout:generic/355 1s 2024-03-16T18:35:38.793 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/355 2024-03-16T18:35:38.793 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:38.796 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:38.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:38.852 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-03-16T18:35:39.300 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:39.306 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:39.307 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:39.311 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:39.311 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:39.772 INFO:teuthology.orchestra.run.smithi132.stdout:generic/356 [not run] swapfiles are not supported 2024-03-16T18:35:39.777 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/356 2024-03-16T18:35:39.777 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/356 2024-03-16T18:35:39.777 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:39.780 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:39.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:39.798 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-03-16T18:35:39.990 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:39.994 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:39.994 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:39.995 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:39.995 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:40.316 INFO:teuthology.orchestra.run.smithi132.stdout:generic/357 [not run] swapfiles are not supported 2024-03-16T18:35:40.320 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/357 2024-03-16T18:35:40.320 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/357 2024-03-16T18:35:40.320 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:40.322 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:40.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:40.336 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-03-16T18:35:40.529 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:40.533 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:40.533 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:40.534 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:40.534 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:40.887 INFO:teuthology.orchestra.run.smithi132.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:35:40.892 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/358 2024-03-16T18:35:40.892 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/358 2024-03-16T18:35:40.892 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:40.896 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:41.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:41.138 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-03-16T18:35:41.389 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:41.393 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:41.393 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:41.394 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:41.394 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:41.757 INFO:teuthology.orchestra.run.smithi132.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:35:41.768 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/359 2024-03-16T18:35:41.768 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/359 2024-03-16T18:35:41.768 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:41.770 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:42.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:42.115 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-03-16T18:35:42.309 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:42.313 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:42.313 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:42.314 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:42.314 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:42.577 INFO:teuthology.orchestra.run.smithi132.stdout:generic/360 0s 2024-03-16T18:35:42.583 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/360 2024-03-16T18:35:42.583 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:42.585 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:42.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:42.604 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-03-16T18:35:42.774 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:42.778 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:42.778 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:42.779 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:42.779 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:43.012 INFO:teuthology.orchestra.run.smithi132.stdout:generic/361 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:35:43.017 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/361 2024-03-16T18:35:43.017 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/361 2024-03-16T18:35:43.017 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:43.019 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:43.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:43.033 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-03-16T18:35:43.218 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:43.221 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:43.222 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:43.223 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:43.223 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:43.434 INFO:teuthology.orchestra.run.smithi132.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-16T18:35:43.438 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/362 2024-03-16T18:35:43.438 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/362 2024-03-16T18:35:43.439 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:43.441 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:43.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:43.455 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-03-16T18:35:43.636 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:43.640 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:43.640 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:43.641 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:43.641 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:43.857 INFO:teuthology.orchestra.run.smithi132.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-16T18:35:43.861 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/363 2024-03-16T18:35:43.861 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/363 2024-03-16T18:35:43.861 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:43.863 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:43.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:43.885 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-03-16T18:35:44.060 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:44.063 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:44.064 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:44.065 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:44.065 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:44.276 INFO:teuthology.orchestra.run.smithi132.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-16T18:35:44.280 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/364 2024-03-16T18:35:44.280 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/364 2024-03-16T18:35:44.280 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:44.282 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:44.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:44.296 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-03-16T18:35:44.471 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:44.475 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:44.475 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:44.476 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:44.476 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:44.682 INFO:teuthology.orchestra.run.smithi132.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-16T18:35:44.686 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/365 2024-03-16T18:35:44.686 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/365 2024-03-16T18:35:44.687 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:44.689 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:44.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:44.702 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-03-16T18:35:44.896 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:44.900 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:44.900 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:44.901 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:44.901 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:45.111 INFO:teuthology.orchestra.run.smithi132.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-16T18:35:45.115 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/366 2024-03-16T18:35:45.115 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/366 2024-03-16T18:35:45.115 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:45.117 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:45.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:45.131 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-03-16T18:35:45.308 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:45.312 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:45.312 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:45.313 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:45.313 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:45.539 INFO:teuthology.orchestra.run.smithi132.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-16T18:35:45.543 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/367 2024-03-16T18:35:45.543 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/367 2024-03-16T18:35:45.543 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:45.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:45.568 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-03-16T18:35:45.763 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:45.766 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:45.767 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:45.768 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:45.768 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:45.978 INFO:teuthology.orchestra.run.smithi132.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-16T18:35:45.981 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/368 2024-03-16T18:35:45.982 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/368 2024-03-16T18:35:45.982 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:45.984 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:46.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:46.015 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-03-16T18:35:46.206 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:46.209 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:46.210 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:46.211 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:46.211 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:46.416 INFO:teuthology.orchestra.run.smithi132.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-16T18:35:46.420 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/369 2024-03-16T18:35:46.420 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/369 2024-03-16T18:35:46.420 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:46.422 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:46.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:46.436 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-03-16T18:35:46.616 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:46.620 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:46.620 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:46.621 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:46.621 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:46.835 INFO:teuthology.orchestra.run.smithi132.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-16T18:35:46.839 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/370 2024-03-16T18:35:46.839 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/370 2024-03-16T18:35:46.839 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:46.841 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:46.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:46.854 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-03-16T18:35:47.034 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:47.038 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:47.038 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:47.039 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:47.039 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:47.268 INFO:teuthology.orchestra.run.smithi132.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:35:47.272 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/371 2024-03-16T18:35:47.272 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/371 2024-03-16T18:35:47.272 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:47.275 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:47.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:47.292 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-03-16T18:35:47.470 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:47.474 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:47.475 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:47.476 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:47.476 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:47.825 INFO:teuthology.orchestra.run.smithi132.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:35:47.833 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/372 2024-03-16T18:35:47.833 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/372 2024-03-16T18:35:47.833 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:47.841 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:48.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:48.161 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-03-16T18:35:48.355 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:48.358 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:48.359 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:48.360 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:48.360 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:48.725 INFO:teuthology.orchestra.run.smithi132.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:35:48.730 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/373 2024-03-16T18:35:48.731 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/373 2024-03-16T18:35:48.731 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:48.735 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:49.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:49.081 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-03-16T18:35:49.275 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:49.279 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:49.279 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:49.280 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:49.280 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:49.589 INFO:teuthology.orchestra.run.smithi132.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-16T18:35:49.641 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/374 2024-03-16T18:35:49.642 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/374 2024-03-16T18:35:49.642 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:49.647 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:50.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:50.012 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-03-16T18:35:50.193 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:50.197 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:50.197 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:50.198 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:50.198 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:50.506 INFO:teuthology.orchestra.run.smithi132.stdout:generic/375 0s 2024-03-16T18:35:50.511 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/375 2024-03-16T18:35:50.511 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:50.514 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:50.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:50.563 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-03-16T18:35:50.997 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:51.001 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:51.001 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:51.002 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:51.002 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:51.229 INFO:teuthology.orchestra.run.smithi132.stdout:generic/376 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:35:51.233 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/376 2024-03-16T18:35:51.233 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/376 2024-03-16T18:35:51.233 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:51.235 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:51.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:51.250 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-03-16T18:35:51.429 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:51.433 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:51.434 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:51.435 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:51.435 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:51.808 INFO:teuthology.orchestra.run.smithi132.stdout:generic/377 0s 2024-03-16T18:35:51.813 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/377 2024-03-16T18:35:51.814 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:51.816 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:51.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:51.825 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-03-16T18:35:52.008 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:52.012 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:52.012 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:52.013 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:52.014 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:52.521 INFO:teuthology.orchestra.run.smithi132.stdout:generic/378 0s 2024-03-16T18:35:52.526 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/378 2024-03-16T18:35:52.527 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:52.529 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:52.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:52.593 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-03-16T18:35:53.026 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:53.029 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:53.030 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:53.031 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:53.031 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:53.290 INFO:teuthology.orchestra.run.smithi132.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:35:53.294 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/379 2024-03-16T18:35:53.295 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/379 2024-03-16T18:35:53.295 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:53.296 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:53.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:53.309 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-03-16T18:35:53.489 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:53.493 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:53.493 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:53.494 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:53.494 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:53.736 INFO:teuthology.orchestra.run.smithi132.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:35:53.740 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/380 2024-03-16T18:35:53.740 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/380 2024-03-16T18:35:53.740 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:53.742 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:53.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:53.765 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-03-16T18:35:53.955 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:53.959 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:53.959 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:53.960 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:53.960 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:54.182 INFO:teuthology.orchestra.run.smithi132.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:35:54.186 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/381 2024-03-16T18:35:54.186 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/381 2024-03-16T18:35:54.186 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:54.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:54.202 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-03-16T18:35:54.388 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:54.392 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:54.392 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:54.393 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:54.393 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:54.606 INFO:teuthology.orchestra.run.smithi132.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:35:54.610 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/382 2024-03-16T18:35:54.610 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/382 2024-03-16T18:35:54.610 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:54.612 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:54.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:54.634 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-03-16T18:35:54.827 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:54.830 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:54.831 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:54.832 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:54.832 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:55.035 INFO:teuthology.orchestra.run.smithi132.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:35:55.039 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/383 2024-03-16T18:35:55.039 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/383 2024-03-16T18:35:55.040 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:55.042 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:55.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:55.054 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-03-16T18:35:55.249 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:55.253 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:55.254 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:55.254 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:55.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:55.462 INFO:teuthology.orchestra.run.smithi132.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:35:55.466 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/384 2024-03-16T18:35:55.466 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/384 2024-03-16T18:35:55.466 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:55.468 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:55.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:55.482 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-03-16T18:35:55.669 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:55.672 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:55.673 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:55.674 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:55.674 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:55.892 INFO:teuthology.orchestra.run.smithi132.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:35:55.897 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/385 2024-03-16T18:35:55.897 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/385 2024-03-16T18:35:55.897 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:55.898 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:55.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:55.911 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-03-16T18:35:56.094 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:56.098 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:56.098 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:56.099 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:56.099 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:56.321 INFO:teuthology.orchestra.run.smithi132.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:35:56.325 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/386 2024-03-16T18:35:56.325 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/386 2024-03-16T18:35:56.325 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:56.327 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:56.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:56.339 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-03-16T18:35:56.525 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:56.528 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:56.529 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:56.530 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:56.530 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:56.895 INFO:teuthology.orchestra.run.smithi132.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:35:56.900 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/387 2024-03-16T18:35:56.901 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/387 2024-03-16T18:35:56.901 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:56.904 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:57.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:57.177 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-03-16T18:35:57.400 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:57.403 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:57.404 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:57.405 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:57.405 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:57.647 INFO:teuthology.orchestra.run.smithi132.stdout:generic/388 [not run] require 172.21.15.132:6789:/scratch to be local device 2024-03-16T18:35:57.651 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/388 2024-03-16T18:35:57.651 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/388 2024-03-16T18:35:57.651 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:57.654 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:57.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:57.668 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-03-16T18:35:57.850 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:57.853 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:57.854 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:57.855 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:57.855 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:58.065 INFO:teuthology.orchestra.run.smithi132.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-03-16T18:35:58.069 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/389 2024-03-16T18:35:58.069 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/389 2024-03-16T18:35:58.069 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:58.071 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:58.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:58.084 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-03-16T18:35:58.263 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:58.267 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:58.267 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:58.269 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:58.269 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:58.513 INFO:teuthology.orchestra.run.smithi132.stdout:generic/390 [not run] ceph does not support freezing 2024-03-16T18:35:58.517 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/390 2024-03-16T18:35:58.517 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/390 2024-03-16T18:35:58.518 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:58.520 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:58.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:58.536 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-03-16T18:35:58.725 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:58.728 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:58.729 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:58.730 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:58.730 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:58.952 INFO:teuthology.orchestra.run.smithi132.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:35:58.956 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/391 2024-03-16T18:35:58.956 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/391 2024-03-16T18:35:58.956 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:58.958 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:58.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:58.976 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-03-16T18:35:59.161 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:59.164 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:59.165 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:59.167 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:59.167 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:59.484 INFO:teuthology.orchestra.run.smithi132.stdout:generic/392 [not run] ceph does not support shutdown 2024-03-16T18:35:59.491 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/392 2024-03-16T18:35:59.492 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/392 2024-03-16T18:35:59.492 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:35:59.494 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:35:59.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:35:59.507 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-03-16T18:35:59.686 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:35:59.690 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:35:59.690 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:35:59.691 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:35:59.691 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:00.370 INFO:teuthology.orchestra.run.smithi132.stdout:generic/393 1s 2024-03-16T18:36:00.376 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/393 2024-03-16T18:36:00.376 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:00.381 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:00.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:00.388 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-03-16T18:36:00.580 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:00.584 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:00.584 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:00.585 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:00.585 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:00.835 INFO:teuthology.orchestra.run.smithi132.stdout:generic/394 0s 2024-03-16T18:36:00.840 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/394 2024-03-16T18:36:00.840 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:00.842 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:00.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:00.893 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-03-16T18:36:01.318 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:01.321 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:01.321 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:01.322 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:01.322 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:01.785 INFO:teuthology.orchestra.run.smithi132.stdout:generic/395 [not run] kernel does not support ceph encryption 2024-03-16T18:36:01.806 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/395 2024-03-16T18:36:01.807 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/395 2024-03-16T18:36:01.807 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:01.810 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:01.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:01.825 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-03-16T18:36:02.105 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:02.111 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:02.112 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:02.113 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:02.113 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:02.573 INFO:teuthology.orchestra.run.smithi132.stdout:generic/396 [not run] kernel does not support ceph encryption 2024-03-16T18:36:02.583 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/396 2024-03-16T18:36:02.583 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/396 2024-03-16T18:36:02.583 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:02.586 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:02.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:02.605 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-03-16T18:36:02.793 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:02.797 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:02.797 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:02.798 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:02.798 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:03.141 INFO:teuthology.orchestra.run.smithi132.stdout:generic/397 [not run] kernel does not support ceph encryption 2024-03-16T18:36:03.149 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/397 2024-03-16T18:36:03.149 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/397 2024-03-16T18:36:03.149 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:03.151 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:03.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:03.164 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-03-16T18:36:03.349 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:03.352 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:03.353 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:03.354 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:03.354 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:03.713 INFO:teuthology.orchestra.run.smithi132.stdout:generic/398 [not run] kernel does not support ceph encryption 2024-03-16T18:36:03.721 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/398 2024-03-16T18:36:03.721 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/398 2024-03-16T18:36:03.721 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:03.723 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:03.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:03.735 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-03-16T18:36:03.917 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:03.921 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:03.922 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:03.923 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:03.923 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:04.258 INFO:teuthology.orchestra.run.smithi132.stdout:generic/399 [not run] kernel does not support ceph encryption 2024-03-16T18:36:04.266 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/399 2024-03-16T18:36:04.266 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/399 2024-03-16T18:36:04.266 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:04.268 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:04.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:04.293 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-03-16T18:36:04.477 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:04.481 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:04.481 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:04.482 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:04.483 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:04.690 INFO:teuthology.orchestra.run.smithi132.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T18:36:04.694 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/400 2024-03-16T18:36:04.694 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/400 2024-03-16T18:36:04.694 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:04.696 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:04.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:04.710 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-03-16T18:36:04.898 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:04.902 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:04.902 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:04.903 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:04.905 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:05.328 INFO:teuthology.orchestra.run.smithi132.stdout:generic/401 1s 2024-03-16T18:36:05.338 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/401 2024-03-16T18:36:05.338 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:05.342 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:05.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:05.354 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-03-16T18:36:05.749 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:05.753 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:05.753 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:05.754 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:05.754 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:06.077 INFO:teuthology.orchestra.run.smithi132.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-03-16T18:36:06.086 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/402 2024-03-16T18:36:06.086 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/402 2024-03-16T18:36:06.086 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:06.088 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:06.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:06.101 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-03-16T18:36:06.298 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:06.302 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:06.303 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:06.305 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:06.305 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:06.786 INFO:teuthology.orchestra.run.smithi132.stdout:generic/403 0s 2024-03-16T18:36:06.792 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/403 2024-03-16T18:36:06.792 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:06.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:06.803 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-03-16T18:36:06.992 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:06.996 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:06.997 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:06.997 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:06.998 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:07.235 INFO:teuthology.orchestra.run.smithi132.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:36:07.239 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/404 2024-03-16T18:36:07.239 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/404 2024-03-16T18:36:07.239 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:07.241 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:07.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:07.259 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-03-16T18:36:07.448 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:07.452 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:07.452 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:07.453 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:07.453 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:07.696 INFO:teuthology.orchestra.run.smithi132.stdout:generic/405 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:36:07.700 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/405 2024-03-16T18:36:07.700 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/405 2024-03-16T18:36:07.700 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:07.702 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:07.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:07.716 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-03-16T18:36:07.899 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:07.903 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:07.903 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:07.904 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:07.904 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:09.459 INFO:teuthology.orchestra.run.smithi132.stdout:generic/406 2s 2024-03-16T18:36:09.467 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/406 2024-03-16T18:36:09.467 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:09.469 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:09.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:09.477 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-03-16T18:36:09.667 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:09.671 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:09.672 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:09.673 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:09.673 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:09.960 INFO:teuthology.orchestra.run.smithi132.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:36:09.964 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/407 2024-03-16T18:36:09.965 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/407 2024-03-16T18:36:09.965 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:09.967 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:10.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:10.001 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-03-16T18:36:10.589 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:10.593 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:10.593 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:10.594 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:10.594 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:10.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:36:10.662 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:36:10.855 INFO:teuthology.orchestra.run.smithi132.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-16T18:36:10.859 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/408 2024-03-16T18:36:10.860 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/408 2024-03-16T18:36:10.860 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:10.862 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:10.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:10.923 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-03-16T18:36:11.387 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:11.391 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:11.391 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:11.392 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:11.392 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:11.614 INFO:teuthology.orchestra.run.smithi132.stdout:generic/409 [not run] require 172.21.15.132:6789:/scratch to be local device 2024-03-16T18:36:11.618 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/409 2024-03-16T18:36:11.618 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/409 2024-03-16T18:36:11.618 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:11.620 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:11.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:11.633 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-03-16T18:36:11.826 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:11.830 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:11.830 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:11.831 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:11.831 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:12.041 INFO:teuthology.orchestra.run.smithi132.stdout:generic/410 [not run] require 172.21.15.132:6789:/scratch to be local device 2024-03-16T18:36:12.044 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/410 2024-03-16T18:36:12.044 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/410 2024-03-16T18:36:12.045 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:12.047 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:12.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:12.059 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-03-16T18:36:12.235 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:12.238 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:12.239 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:12.240 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:12.240 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:12.459 INFO:teuthology.orchestra.run.smithi132.stdout:generic/411 [not run] require 172.21.15.132:6789:/scratch to be local device 2024-03-16T18:36:12.463 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/411 2024-03-16T18:36:12.463 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/411 2024-03-16T18:36:12.463 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:12.465 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:12.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:12.485 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-03-16T18:36:12.663 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:12.667 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:12.667 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:12.668 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:12.669 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:13.122 INFO:teuthology.orchestra.run.smithi132.stdout:generic/412 1s 2024-03-16T18:36:13.128 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/412 2024-03-16T18:36:13.128 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:13.131 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:13.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:13.140 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-03-16T18:36:13.323 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:13.327 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:13.327 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:13.328 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:13.328 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:13.614 INFO:teuthology.orchestra.run.smithi132.stdout:generic/413 [not run] mount 172.21.15.132:6789:/scratch with dax failed 2024-03-16T18:36:13.618 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/413 2024-03-16T18:36:13.618 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/413 2024-03-16T18:36:13.618 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:13.620 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:13.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:13.652 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-03-16T18:36:13.836 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:13.840 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:13.840 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:13.841 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:14.207 INFO:teuthology.orchestra.run.smithi132.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:36:14.213 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/414 2024-03-16T18:36:14.213 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/414 2024-03-16T18:36:14.214 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:14.217 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:14.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:14.556 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-03-16T18:36:14.741 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:14.744 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:14.744 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:14.745 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:14.745 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:15.104 INFO:teuthology.orchestra.run.smithi132.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:36:15.112 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/415 2024-03-16T18:36:15.112 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/415 2024-03-16T18:36:15.112 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:15.116 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:15.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:15.416 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-03-16T18:36:15.623 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:15.627 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:15.627 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:15.628 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:15.628 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:15.856 INFO:teuthology.orchestra.run.smithi132.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:36:15.860 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/416 2024-03-16T18:36:15.861 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/416 2024-03-16T18:36:15.861 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:15.863 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:15.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:15.876 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-03-16T18:36:16.052 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:16.056 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:16.056 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:16.057 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:16.057 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:16.341 INFO:teuthology.orchestra.run.smithi132.stdout:generic/417 [not run] ceph does not support shutdown 2024-03-16T18:36:16.349 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/417 2024-03-16T18:36:16.349 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/417 2024-03-16T18:36:16.349 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:16.351 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:16.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:16.363 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-03-16T18:36:16.562 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:16.565 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:16.566 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:16.567 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:16.567 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:16.824 INFO:teuthology.orchestra.run.smithi132.stdout:generic/418 [not run] require 172.21.15.132:6789:/test to be valid block disk 2024-03-16T18:36:16.827 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/418 2024-03-16T18:36:16.828 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/418 2024-03-16T18:36:16.828 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:16.830 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:16.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:16.847 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-03-16T18:36:17.036 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:17.039 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:17.040 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:17.041 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:17.041 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:17.366 INFO:teuthology.orchestra.run.smithi132.stdout:generic/419 [not run] kernel does not support ceph encryption 2024-03-16T18:36:17.387 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/419 2024-03-16T18:36:17.387 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/419 2024-03-16T18:36:17.388 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:17.390 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:17.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:17.405 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-03-16T18:36:17.583 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:17.587 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:17.587 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:17.588 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:17.588 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:17.917 INFO:teuthology.orchestra.run.smithi132.stdout:generic/420 0s 2024-03-16T18:36:17.922 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/420 2024-03-16T18:36:17.922 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:17.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:17.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:17.975 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-03-16T18:36:18.423 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:18.427 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:18.427 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:18.428 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:18.428 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:18.765 INFO:teuthology.orchestra.run.smithi132.stdout:generic/421 [not run] kernel does not support ceph encryption 2024-03-16T18:36:18.788 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/421 2024-03-16T18:36:18.788 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/421 2024-03-16T18:36:18.788 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:18.790 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:18.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:18.804 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-03-16T18:36:18.980 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:18.984 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:18.985 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:18.985 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:18.986 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:19.215 INFO:teuthology.orchestra.run.smithi132.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-16T18:36:19.219 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/422 2024-03-16T18:36:19.219 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/422 2024-03-16T18:36:19.219 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:19.221 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:19.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:19.238 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-03-16T18:36:19.413 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:19.417 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:19.418 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:19.419 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:19.419 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:19.726 INFO:teuthology.orchestra.run.smithi132.stdout:generic/423 0s 2024-03-16T18:36:19.732 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/423 2024-03-16T18:36:19.732 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:19.734 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:19.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:19.790 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-03-16T18:36:20.230 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:20.233 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:20.234 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:20.234 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:20.235 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:20.457 INFO:teuthology.orchestra.run.smithi132.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-03-16T18:36:20.460 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/424 2024-03-16T18:36:20.460 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/424 2024-03-16T18:36:20.461 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:20.463 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:20.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:20.481 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-03-16T18:36:20.666 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:20.670 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:20.671 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:20.672 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:20.918 INFO:teuthology.orchestra.run.smithi132.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-03-16T18:36:20.921 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/425 2024-03-16T18:36:20.921 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/425 2024-03-16T18:36:20.922 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:20.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:20.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:20.974 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-03-16T18:36:21.417 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:21.421 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:21.421 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:21.423 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:21.423 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:40.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:36:40.815 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:36:46.719 INFO:teuthology.orchestra.run.smithi132.stdout:generic/426 25s 2024-03-16T18:36:46.808 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/426 2024-03-16T18:36:46.808 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:46.810 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:46.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:46.971 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-03-16T18:36:48.617 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:48.621 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:48.623 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:48.624 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:48.624 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:48.998 INFO:teuthology.orchestra.run.smithi132.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:36:49.002 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/427 2024-03-16T18:36:49.002 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/427 2024-03-16T18:36:49.002 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:49.004 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:49.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:49.021 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-03-16T18:36:49.207 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:49.211 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:49.211 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:49.212 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:49.212 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:49.450 INFO:teuthology.orchestra.run.smithi132.stdout:generic/428 0s 2024-03-16T18:36:49.455 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/428 2024-03-16T18:36:49.455 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:49.457 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:49.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:49.476 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-03-16T18:36:49.655 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:49.658 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:49.659 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:49.660 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:49.660 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:49.995 INFO:teuthology.orchestra.run.smithi132.stdout:generic/429 [not run] kernel does not support ceph encryption 2024-03-16T18:36:50.002 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/429 2024-03-16T18:36:50.003 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/429 2024-03-16T18:36:50.003 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:50.005 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:50.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:50.017 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-03-16T18:36:50.196 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:50.200 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:50.200 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:50.201 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:50.201 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:50.516 INFO:teuthology.orchestra.run.smithi132.stdout:generic/430 0s 2024-03-16T18:36:50.521 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/430 2024-03-16T18:36:50.521 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:50.523 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:50.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:50.589 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-03-16T18:36:50.964 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:50.969 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:50.969 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:50.971 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:50.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:51.286 INFO:teuthology.orchestra.run.smithi132.stdout:generic/431 0s 2024-03-16T18:36:51.292 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/431 2024-03-16T18:36:51.292 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:51.294 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:51.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:51.372 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-03-16T18:36:51.762 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:51.768 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:51.768 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:52.056 INFO:teuthology.orchestra.run.smithi132.stdout:generic/432 1s 2024-03-16T18:36:52.063 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/432 2024-03-16T18:36:52.063 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:52.065 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:52.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:52.128 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-03-16T18:36:52.523 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:52.527 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:52.527 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:52.528 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:52.528 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:52.801 INFO:teuthology.orchestra.run.smithi132.stdout:generic/433 0s 2024-03-16T18:36:52.807 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/433 2024-03-16T18:36:52.807 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:52.809 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:52.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:52.869 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-03-16T18:36:53.268 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:53.272 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:53.272 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:53.273 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:53.273 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:53.559 INFO:teuthology.orchestra.run.smithi132.stdout:generic/434 0s 2024-03-16T18:36:53.565 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/434 2024-03-16T18:36:53.565 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:53.567 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:53.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:53.630 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-03-16T18:36:54.036 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:54.039 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:54.040 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:54.041 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:54.041 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:54.383 INFO:teuthology.orchestra.run.smithi132.stdout:generic/435 [not run] kernel does not support ceph encryption 2024-03-16T18:36:54.391 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/435 2024-03-16T18:36:54.391 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/435 2024-03-16T18:36:54.391 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:54.393 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:54.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:54.405 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-03-16T18:36:54.613 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:54.616 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:54.617 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:54.618 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:54.618 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:55.103 INFO:teuthology.orchestra.run.smithi132.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:36:55.107 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/436 2024-03-16T18:36:55.107 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/436 2024-03-16T18:36:55.107 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:55.109 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:55.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:55.136 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-03-16T18:36:55.537 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:55.543 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:55.543 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:55.544 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:55.545 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:56.368 INFO:teuthology.orchestra.run.smithi132.stdout:generic/437 1s 2024-03-16T18:36:56.374 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/437 2024-03-16T18:36:56.375 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:36:56.376 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:36:56.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:36:56.394 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-03-16T18:36:56.572 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:36:56.576 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:36:56.576 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:36:56.577 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:36:56.577 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:37:11.978 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:37:11.981 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:37:42.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:37:42.334 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:38:07.657 INFO:teuthology.orchestra.run.smithi132.stdout:generic/438 71s 2024-03-16T18:38:07.662 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/438 2024-03-16T18:38:07.662 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:07.664 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:07.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:07.680 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-03-16T18:38:07.856 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:07.860 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:07.860 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:07.861 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:07.861 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:08.706 INFO:teuthology.orchestra.run.smithi132.stdout:generic/439 1s 2024-03-16T18:38:08.715 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/439 2024-03-16T18:38:08.715 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:08.717 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:08.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:08.733 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-03-16T18:38:08.914 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:08.918 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:08.918 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:08.919 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:08.919 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:09.257 INFO:teuthology.orchestra.run.smithi132.stdout:generic/440 [not run] kernel does not support ceph encryption 2024-03-16T18:38:09.264 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/440 2024-03-16T18:38:09.264 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/440 2024-03-16T18:38:09.264 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:09.267 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:09.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:09.278 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-03-16T18:38:09.455 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:09.459 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:09.459 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:09.460 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:09.710 INFO:teuthology.orchestra.run.smithi132.stdout:generic/441 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:38:09.714 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/441 2024-03-16T18:38:09.714 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/441 2024-03-16T18:38:09.714 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:09.716 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:09.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:09.731 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-03-16T18:38:09.921 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:09.925 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:09.925 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:09.926 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:09.926 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:10.162 INFO:teuthology.orchestra.run.smithi132.stdout:generic/442 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:38:10.166 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/442 2024-03-16T18:38:10.166 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/442 2024-03-16T18:38:10.166 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:10.169 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:10.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:10.181 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-03-16T18:38:10.358 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:10.362 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:10.362 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:10.363 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:10.364 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:10.603 INFO:teuthology.orchestra.run.smithi132.stdout:generic/443 0s 2024-03-16T18:38:10.608 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/443 2024-03-16T18:38:10.608 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:10.611 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:10.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:10.628 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-03-16T18:38:10.814 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:10.817 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:10.818 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:10.819 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:10.819 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:11.101 INFO:teuthology.orchestra.run.smithi132.stdout:generic/444 1s 2024-03-16T18:38:11.106 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/444 2024-03-16T18:38:11.106 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:11.109 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:11.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:11.126 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-03-16T18:38:11.304 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:11.308 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:11.308 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:11.309 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:11.309 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:11.779 INFO:teuthology.orchestra.run.smithi132.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:38:11.783 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/445 2024-03-16T18:38:11.783 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/445 2024-03-16T18:38:11.784 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:11.785 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:11.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:11.818 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-03-16T18:38:12.211 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:12.216 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:12.216 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:12.217 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:12.218 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:12.471 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:38:12.473 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:38:27.960 INFO:teuthology.orchestra.run.smithi132.stdout:generic/446 15s 2024-03-16T18:38:27.969 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/446 2024-03-16T18:38:27.969 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:27.972 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:27.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:27.984 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-03-16T18:38:28.357 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:28.361 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:28.361 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:28.362 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:28.362 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:28.713 INFO:teuthology.orchestra.run.smithi132.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:38:28.718 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/447 2024-03-16T18:38:28.719 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/447 2024-03-16T18:38:28.720 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:28.725 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:28.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:28.921 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-03-16T18:38:29.188 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:29.192 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:29.193 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:29.194 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:29.194 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:29.970 INFO:teuthology.orchestra.run.smithi132.stdout:generic/448 0s 2024-03-16T18:38:29.975 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/448 2024-03-16T18:38:29.975 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:29.978 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:30.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:30.016 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-03-16T18:38:30.366 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:30.372 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:30.372 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:30.373 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:30.373 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:30.647 INFO:teuthology.orchestra.run.smithi132.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T18:38:30.650 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/449 2024-03-16T18:38:30.650 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/449 2024-03-16T18:38:30.651 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:30.653 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:30.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:30.700 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-03-16T18:38:31.068 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:31.074 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:31.074 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:31.075 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:31.075 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:31.645 INFO:teuthology.orchestra.run.smithi132.stdout:generic/450 0s 2024-03-16T18:38:31.650 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/450 2024-03-16T18:38:31.651 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:38:31.653 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:31.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:38:31.734 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-03-16T18:38:32.098 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:38:32.102 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:38:32.103 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:38:32.104 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:38:32.104 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:38:42.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:38:42.532 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:39:02.508 INFO:teuthology.orchestra.run.smithi132.stdout:generic/451 30s 2024-03-16T18:39:02.514 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/451 2024-03-16T18:39:02.514 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:02.516 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:02.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:02.573 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-03-16T18:39:02.945 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:02.951 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:02.951 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:02.952 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:02.952 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:03.312 INFO:teuthology.orchestra.run.smithi132.stdout:generic/452 0s 2024-03-16T18:39:03.318 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/452 2024-03-16T18:39:03.318 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:03.320 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:03.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:03.328 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-03-16T18:39:03.523 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:03.527 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:03.528 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:03.529 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:03.529 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:03.751 INFO:teuthology.orchestra.run.smithi132.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-03-16T18:39:03.755 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/453 2024-03-16T18:39:03.755 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/453 2024-03-16T18:39:03.755 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:03.757 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:03.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:03.769 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-03-16T18:39:03.959 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:03.963 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:03.964 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:03.965 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:03.965 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:04.188 INFO:teuthology.orchestra.run.smithi132.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-03-16T18:39:04.192 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/454 2024-03-16T18:39:04.192 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/454 2024-03-16T18:39:04.192 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:04.195 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:04.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:04.211 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-03-16T18:39:04.389 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:04.393 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:04.393 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:04.394 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:04.394 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:04.660 INFO:teuthology.orchestra.run.smithi132.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-16T18:39:04.664 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/455 2024-03-16T18:39:04.664 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/455 2024-03-16T18:39:04.664 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:04.666 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:04.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:04.681 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-03-16T18:39:04.858 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:04.862 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:04.863 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:04.864 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:04.864 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:05.093 INFO:teuthology.orchestra.run.smithi132.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T18:39:05.097 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/456 2024-03-16T18:39:05.097 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/456 2024-03-16T18:39:05.097 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:05.099 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:05.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:05.113 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-03-16T18:39:05.297 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:05.301 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:05.302 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:05.303 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:05.303 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:05.722 INFO:teuthology.orchestra.run.smithi132.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:39:05.727 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/457 2024-03-16T18:39:05.727 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/457 2024-03-16T18:39:05.727 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:05.731 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:05.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:05.890 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-03-16T18:39:06.149 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:06.153 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:06.153 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:06.154 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:06.154 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:06.507 INFO:teuthology.orchestra.run.smithi132.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T18:39:06.513 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/458 2024-03-16T18:39:06.513 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/458 2024-03-16T18:39:06.513 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:06.517 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:06.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:06.799 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-03-16T18:39:07.009 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:07.013 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:07.013 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:07.014 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:07.014 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:07.431 INFO:teuthology.orchestra.run.smithi132.stdout:generic/459 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:39:07.435 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/459 2024-03-16T18:39:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/459 2024-03-16T18:39:07.436 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:07.438 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:07.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:07.450 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-03-16T18:39:07.626 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:07.629 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:07.630 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:07.631 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:07.631 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:09.382 INFO:teuthology.orchestra.run.smithi132.stdout:generic/460 2s 2024-03-16T18:39:09.388 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/460 2024-03-16T18:39:09.388 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:09.390 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:09.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:09.399 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-03-16T18:39:09.577 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:09.581 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:09.581 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:09.582 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:09.582 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:09.877 INFO:teuthology.orchestra.run.smithi132.stdout:generic/461 [not run] ceph does not support shutdown 2024-03-16T18:39:09.881 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/461 2024-03-16T18:39:09.881 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/461 2024-03-16T18:39:09.881 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:09.884 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:09.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:09.905 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-03-16T18:39:10.108 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:10.112 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:10.112 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:10.113 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:10.113 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:10.403 INFO:teuthology.orchestra.run.smithi132.stdout:generic/462 [not run] mount 172.21.15.132:6789:/scratch with dax failed 2024-03-16T18:39:10.408 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/462 2024-03-16T18:39:10.408 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/462 2024-03-16T18:39:10.408 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:10.410 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:10.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:10.435 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-03-16T18:39:10.639 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:10.644 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:10.645 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:10.647 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:10.647 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:11.002 INFO:teuthology.orchestra.run.smithi132.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T18:39:11.006 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/463 2024-03-16T18:39:11.006 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/463 2024-03-16T18:39:11.006 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:39:11.008 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:11.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:39:11.063 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-03-16T18:39:11.427 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:39:11.432 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:39:11.432 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:39:11.433 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:39:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:39:12.663 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:39:12.669 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:39:42.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:39:42.822 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:40:07.382 INFO:teuthology.orchestra.run.smithi132.stdout:generic/464 56s 2024-03-16T18:40:07.388 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/464 2024-03-16T18:40:07.388 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:40:07.390 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:07.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:40:07.401 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-03-16T18:40:07.576 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:40:07.579 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:40:07.580 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:40:07.581 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:40:07.581 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:11.997 INFO:teuthology.orchestra.run.smithi132.stdout:generic/465 3s 2024-03-16T18:40:12.005 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/465 2024-03-16T18:40:12.005 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:40:12.009 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:12.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:40:12.022 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-03-16T18:40:12.383 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:40:12.387 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:40:12.387 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:40:12.388 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:40:12.388 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:12.604 INFO:teuthology.orchestra.run.smithi132.stdout:generic/466 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:40:12.609 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/466 2024-03-16T18:40:12.609 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/466 2024-03-16T18:40:12.609 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:40:12.611 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:12.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:40:12.624 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-03-16T18:40:12.836 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:40:12.840 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:40:12.840 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:40:12.841 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:40:12.841 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:12.948 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:40:12.951 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:40:19.733 INFO:teuthology.orchestra.run.smithi132.stdout:generic/467 7s 2024-03-16T18:40:19.791 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/467 2024-03-16T18:40:19.792 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:40:19.794 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:20.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:40:20.013 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-03-16T18:40:21.134 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:40:21.138 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:40:21.138 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:40:21.139 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:40:21.139 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:21.482 INFO:teuthology.orchestra.run.smithi132.stdout:generic/468 [not run] ceph does not support shutdown 2024-03-16T18:40:21.491 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/468 2024-03-16T18:40:21.491 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/468 2024-03-16T18:40:21.491 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:40:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:21.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:40:21.506 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-03-16T18:40:21.710 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:40:21.714 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:40:21.714 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:40:21.715 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:40:21.716 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:21.938 INFO:teuthology.orchestra.run.smithi132.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-16T18:40:21.942 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/469 2024-03-16T18:40:21.942 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/469 2024-03-16T18:40:21.942 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:40:21.944 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:21.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:40:21.961 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-03-16T18:40:22.147 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:40:22.151 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:40:22.151 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:40:22.152 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:40:22.153 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:22.416 INFO:teuthology.orchestra.run.smithi132.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-16T18:40:22.420 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/470 2024-03-16T18:40:22.420 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/470 2024-03-16T18:40:22.420 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:40:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:22.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:40:22.434 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-03-16T18:40:22.611 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:40:22.615 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:40:22.616 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:40:22.616 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:40:22.616 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:40:43.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:40:43.089 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:41:02.992 INFO:teuthology.orchestra.run.smithi132.stdout:generic/471 40s 2024-03-16T18:41:03.002 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/471 2024-03-16T18:41:03.002 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:41:03.005 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:41:03.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:41:03.079 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-03-16T18:41:03.487 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:41:03.497 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:41:03.498 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:41:03.499 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:41:03.499 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:41:04.430 INFO:teuthology.orchestra.run.smithi132.stdout:generic/472 [not run] swapfiles are not supported 2024-03-16T18:41:04.437 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/472 2024-03-16T18:41:04.437 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/472 2024-03-16T18:41:04.437 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:41:04.439 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:41:04.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:41:04.460 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-03-16T18:41:04.650 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:41:04.654 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:41:04.654 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:41:04.655 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:41:04.655 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:41:04.914 INFO:teuthology.orchestra.run.smithi132.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-16T18:41:04.918 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/473 2024-03-16T18:41:04.918 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/473 2024-03-16T18:41:04.918 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:41:04.921 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:41:04.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:41:04.934 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-03-16T18:41:05.117 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:41:05.121 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:41:05.121 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:41:05.122 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:41:05.122 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:41:05.399 INFO:teuthology.orchestra.run.smithi132.stdout:generic/474 [not run] ceph does not support shutdown 2024-03-16T18:41:05.405 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/474 2024-03-16T18:41:05.405 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/474 2024-03-16T18:41:05.405 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:41:05.407 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:41:05.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:41:05.418 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-03-16T18:41:05.602 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:41:05.605 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:41:05.606 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:41:05.607 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:41:05.607 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:41:05.836 INFO:teuthology.orchestra.run.smithi132.stdout:generic/475 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T18:41:05.840 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/475 2024-03-16T18:41:05.840 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/475 2024-03-16T18:41:05.840 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T18:41:05.842 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:41:05.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T18:41:05.853 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-03-16T18:41:06.040 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T18:41:06.043 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T18:41:06.044 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T18:41:06.045 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T18:41:06.045 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T18:41:13.250 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:41:13.253 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:41:43.657 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:41:43.660 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:42:13.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:42:13.772 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:42:44.051 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:42:44.054 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:43:14.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:43:14.257 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:43:44.451 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:43:44.454 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:44:14.535 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:44:14.541 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:44:44.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:44:44.656 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:44:44.719 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T18:44:44.721+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 559937) UID: 0 2024-03-16T18:44:44.721 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T18:44:44.723+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 559937) UID: 0 2024-03-16T18:49:40.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:49:40.416 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:49:40.690 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T18:49:40.691+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559998) UID: 0 2024-03-16T18:49:40.693 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T18:49:40.696+0000 7fc9fd2d4640 -1 Fail to open '/proc/559998/cmdline' error = (2) No such file or directory 2024-03-16T18:49:40.693 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T18:49:40.696+0000 7fc9fd2d4640 -1 received signal: Hangup from (PID: 559998) UID: 0 2024-03-16T18:49:40.695 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T18:49:40.691+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559998) UID: 0 2024-03-16T18:49:40.696 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T18:49:40.699+0000 7fabfe11d640 -1 Fail to open '/proc/559998/cmdline' error = (2) No such file or directory 2024-03-16T18:49:40.696 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T18:49:40.699+0000 7fabfe11d640 -1 received signal: Hangup from (PID: 559998) UID: 0 2024-03-16T18:54:27.524 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:54:27.527 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:54:27.684 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T18:54:27.689+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49921) UID: 0 2024-03-16T18:54:27.685 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T18:54:27.689+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49921) UID: 0 2024-03-16T18:54:27.685 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T18:54:27.689+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49921) UID: 0 2024-03-16T18:54:27.685 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T18:54:27.690+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49921) UID: 0 2024-03-16T18:57:31.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:57:31.626 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T18:57:31.665 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T18:57:31.672+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49966) UID: 0 2024-03-16T18:57:31.665 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T18:57:31.672+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49966) UID: 0 2024-03-16T18:57:31.665 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T18:57:31.672+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49966) UID: 0 2024-03-16T18:57:31.666 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T18:57:31.672+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49966) UID: 0 2024-03-16T19:00:50.234 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:00:50.237 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:00:50.272 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T19:00:50.281+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50029) UID: 0 2024-03-16T19:00:50.272 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T19:00:50.281+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50029) UID: 0 2024-03-16T19:00:50.272 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T19:00:50.281+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50029) UID: 0 2024-03-16T19:00:50.273 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T19:00:50.283+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50029) UID: 0 2024-03-16T19:00:50.837 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T19:00:50.846+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560170) UID: 0 2024-03-16T19:00:50.841 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T19:00:50.851+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560170) UID: 0 2024-03-16T19:06:45.018 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:06:45.022 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:06:45.379 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T19:06:45.390+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560268) UID: 0 2024-03-16T19:06:45.379 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T19:06:45.390+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560268) UID: 0 2024-03-16T19:06:45.379 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T19:06:45.390+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560268) UID: 0 2024-03-16T19:06:45.381 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T19:06:45.391+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560268) UID: 0 2024-03-16T19:11:08.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:11:08.393 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:11:08.643 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T19:11:08.656+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560347) UID: 0 2024-03-16T19:11:08.643 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T19:11:08.656+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560347) UID: 0 2024-03-16T19:15:42.569 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T19:15:42.582+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560404) UID: 0 2024-03-16T19:15:42.570 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T19:15:42.583+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560404) UID: 0 2024-03-16T19:15:42.570 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T19:15:42.584+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560404) UID: 0 2024-03-16T19:15:42.571 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T19:15:42.584+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560404) UID: 0 2024-03-16T19:20:18.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:20:18.883 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:20:19.162 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T19:20:19.178+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560464) UID: 0 2024-03-16T19:20:19.163 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T19:20:19.178+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560464) UID: 0 2024-03-16T19:25:24.938 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:25:24.942 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:25:25.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T19:25:25.150+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50338) UID: 0 2024-03-16T19:25:25.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T19:25:25.150+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50338) UID: 0 2024-03-16T19:25:25.140 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T19:25:25.150+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50338) UID: 0 2024-03-16T19:25:25.140 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T19:25:25.150+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50338) UID: 0 2024-03-16T19:28:31.693 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:28:31.696 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:28:31.788 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T19:28:31.807+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560638) UID: 0 2024-03-16T19:28:31.791 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T19:28:31.809+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560638) UID: 0 2024-03-16T19:28:31.805 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T19:28:31.807+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560638) UID: 0 2024-03-16T19:28:31.809 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T19:28:31.807+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560638) UID: 0 2024-03-16T19:37:13.347 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:37:13.353 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:37:13.641 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T19:37:13.664+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560765) UID: 0 2024-03-16T19:37:13.642 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T19:37:13.664+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560765) UID: 0 2024-03-16T19:45:07.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:45:07.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:45:07.118 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T19:45:07.134+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50648) UID: 0 2024-03-16T19:45:07.119 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T19:45:07.134+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50648) UID: 0 2024-03-16T19:45:07.119 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T19:45:07.134+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50648) UID: 0 2024-03-16T19:45:07.119 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T19:45:07.134+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50648) UID: 0 2024-03-16T19:51:30.848 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:51:30.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T19:51:31.204 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T19:51:31.230+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50776) UID: 0 2024-03-16T19:51:31.205 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T19:51:31.231+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50776) UID: 0 2024-03-16T19:51:31.205 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T19:51:31.231+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50776) UID: 0 2024-03-16T19:51:31.208 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T19:51:31.230+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50776) UID: 0 2024-03-16T19:51:31.212 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T19:51:31.238+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 561027) UID: 0 2024-03-16T19:51:31.213 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T19:51:31.238+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 561027) UID: 0 2024-03-16T19:58:21.789 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T19:58:21.816+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561068) UID: 0 2024-03-16T19:58:21.790 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T19:58:21.816+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561068) UID: 0 2024-03-16T19:58:21.790 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T19:58:21.816+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561068) UID: 0 2024-03-16T19:58:21.791 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T19:58:21.816+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561068) UID: 0 2024-03-16T20:01:00.287 INFO:teuthology.orchestra.run.smithi132.stdout:generic/476 4794s 2024-03-16T20:01:00.536 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/476 2024-03-16T20:01:00.537 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:01:00.545 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:01:00.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:01:00.697 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-03-16T20:01:06.285 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:01:06.289 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:01:06.289 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:01:06.291 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:01:06.291 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:03:14.924 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:03:14.927 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:03:15.381 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T20:03:15.398+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 561397) UID: 0 2024-03-16T20:03:15.381 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T20:03:15.399+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 561397) UID: 0 2024-03-16T20:08:16.499 INFO:teuthology.orchestra.run.smithi132.stdout:generic/477 29s 2024-03-16T20:08:16.674 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/477 2024-03-16T20:08:16.674 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:16.677 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:16.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:16.819 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-03-16T20:08:19.787 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:19.798 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:19.798 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:19.800 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:19.800 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:30.495 INFO:teuthology.orchestra.run.smithi132.stdout:generic/478 11s 2024-03-16T20:08:30.503 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/478 2024-03-16T20:08:30.503 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:30.507 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:30.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:30.545 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-03-16T20:08:30.821 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:30.827 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:30.827 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:30.829 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:30.829 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:31.340 INFO:teuthology.orchestra.run.smithi132.stdout:generic/479 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:08:31.345 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/479 2024-03-16T20:08:31.345 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/479 2024-03-16T20:08:31.345 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:31.349 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:31.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:31.384 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-03-16T20:08:31.740 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:31.745 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:31.746 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:31.748 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:31.748 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:32.116 INFO:teuthology.orchestra.run.smithi132.stdout:generic/480 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:08:32.122 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/480 2024-03-16T20:08:32.122 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/480 2024-03-16T20:08:32.122 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:32.127 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:32.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:32.164 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-03-16T20:08:32.472 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:32.478 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:32.479 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:32.480 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:32.480 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:32.835 INFO:teuthology.orchestra.run.smithi132.stdout:generic/481 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:08:32.840 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/481 2024-03-16T20:08:32.841 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/481 2024-03-16T20:08:32.841 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:32.844 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:32.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:32.869 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-03-16T20:08:33.173 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:33.178 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:33.178 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:33.179 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:33.179 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:33.602 INFO:teuthology.orchestra.run.smithi132.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-16T20:08:33.609 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/482 2024-03-16T20:08:33.609 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/482 2024-03-16T20:08:33.609 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:33.612 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:33.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:33.645 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-03-16T20:08:33.933 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:33.939 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:33.939 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:33.941 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:33.942 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:34.283 INFO:teuthology.orchestra.run.smithi132.stdout:generic/483 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:08:34.288 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/483 2024-03-16T20:08:34.288 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/483 2024-03-16T20:08:34.288 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:34.292 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:34.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:34.315 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-03-16T20:08:34.627 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:34.633 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:34.634 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:34.635 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:34.635 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:34.985 INFO:teuthology.orchestra.run.smithi132.stdout:generic/484 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:08:34.990 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/484 2024-03-16T20:08:34.990 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/484 2024-03-16T20:08:34.990 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:34.993 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:35.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:35.018 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-03-16T20:08:35.300 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:35.309 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:35.310 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:35.311 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:35.312 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:35.649 INFO:teuthology.orchestra.run.smithi132.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-16T20:08:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/485 2024-03-16T20:08:35.653 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/485 2024-03-16T20:08:35.654 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:35.657 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:35.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:35.690 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-03-16T20:08:35.996 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:36.001 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:36.001 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:36.002 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:36.003 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:36.706 INFO:teuthology.orchestra.run.smithi132.stdout:generic/486 0s 2024-03-16T20:08:36.715 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/486 2024-03-16T20:08:36.715 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:36.718 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:36.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:36.729 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-03-16T20:08:37.005 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:37.013 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:37.013 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:37.014 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:37.014 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:37.420 INFO:teuthology.orchestra.run.smithi132.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-03-16T20:08:37.425 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/487 2024-03-16T20:08:37.426 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/487 2024-03-16T20:08:37.426 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:37.428 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:37.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:37.459 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-03-16T20:08:37.730 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:37.735 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:37.736 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:37.737 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:37.737 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:38.104 INFO:teuthology.orchestra.run.smithi132.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T20:08:38.109 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/488 2024-03-16T20:08:38.110 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/488 2024-03-16T20:08:38.110 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:38.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:38.142 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-03-16T20:08:38.477 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:38.483 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:38.483 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:38.485 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:38.485 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:38.842 INFO:teuthology.orchestra.run.smithi132.stdout:generic/489 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:08:38.847 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/489 2024-03-16T20:08:38.847 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/489 2024-03-16T20:08:38.847 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:38.851 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:38.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:38.876 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-03-16T20:08:39.151 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:39.159 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:39.160 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:39.161 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:39.161 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:41.365 INFO:teuthology.orchestra.run.smithi132.stdout:generic/490 2s 2024-03-16T20:08:41.376 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/490 2024-03-16T20:08:41.376 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:41.379 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:41.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:41.479 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-03-16T20:08:41.875 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:41.884 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:41.885 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:41.886 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:41.886 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:43.125 INFO:teuthology.orchestra.run.smithi132.stdout:generic/491 [not run] ceph does not support freezing 2024-03-16T20:08:43.131 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/491 2024-03-16T20:08:43.131 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/491 2024-03-16T20:08:43.131 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:43.134 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:43.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:43.158 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-03-16T20:08:43.430 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:43.434 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:43.434 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:43.436 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:43.436 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:43.788 INFO:teuthology.orchestra.run.smithi132.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-03-16T20:08:43.793 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/492 2024-03-16T20:08:43.793 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/492 2024-03-16T20:08:43.793 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:43.796 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:43.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:43.819 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-03-16T20:08:44.155 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:44.162 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:44.162 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:44.163 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:44.164 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:44.845 INFO:teuthology.orchestra.run.smithi132.stdout:generic/493 [not run] swapfiles are not supported 2024-03-16T20:08:44.850 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/493 2024-03-16T20:08:44.850 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/493 2024-03-16T20:08:44.851 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:44.854 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:44.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:44.889 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-03-16T20:08:45.214 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:45.220 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:45.220 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:45.222 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:45.222 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:45.783 INFO:teuthology.orchestra.run.smithi132.stdout:generic/494 [not run] swapfiles are not supported 2024-03-16T20:08:45.788 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/494 2024-03-16T20:08:45.788 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/494 2024-03-16T20:08:45.788 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:45.792 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:45.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:45.821 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-03-16T20:08:46.110 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:46.116 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:46.116 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:46.118 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:46.118 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:46.665 INFO:teuthology.orchestra.run.smithi132.stdout:generic/495 [not run] swapfiles are not supported 2024-03-16T20:08:46.671 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/495 2024-03-16T20:08:46.671 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/495 2024-03-16T20:08:46.671 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:46.674 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:46.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:46.711 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-03-16T20:08:47.018 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:47.023 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:47.024 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:47.025 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:47.025 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:47.630 INFO:teuthology.orchestra.run.smithi132.stdout:generic/496 [not run] swapfiles are not supported 2024-03-16T20:08:47.634 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/496 2024-03-16T20:08:47.634 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/496 2024-03-16T20:08:47.634 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:47.638 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:47.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:47.677 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-03-16T20:08:47.986 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:47.991 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:47.992 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:47.993 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:47.993 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:48.542 INFO:teuthology.orchestra.run.smithi132.stdout:generic/497 [not run] swapfiles are not supported 2024-03-16T20:08:48.547 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/497 2024-03-16T20:08:48.547 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/497 2024-03-16T20:08:48.547 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:48.551 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:48.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:48.591 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-03-16T20:08:48.891 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:48.897 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:48.897 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:48.898 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:48.899 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:49.301 INFO:teuthology.orchestra.run.smithi132.stdout:generic/498 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:08:49.308 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/498 2024-03-16T20:08:49.309 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/498 2024-03-16T20:08:49.309 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:49.311 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:49.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:49.347 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-03-16T20:08:49.632 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:49.640 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:49.641 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:49.642 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:49.642 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:50.004 INFO:teuthology.orchestra.run.smithi132.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-16T20:08:50.009 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/499 2024-03-16T20:08:50.009 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/499 2024-03-16T20:08:50.009 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:50.013 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:50.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:50.051 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-03-16T20:08:50.330 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:50.336 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:50.337 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:50.338 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:50.727 INFO:teuthology.orchestra.run.smithi132.stdout:generic/500 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:08:50.732 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/500 2024-03-16T20:08:50.732 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/500 2024-03-16T20:08:50.732 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:50.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:50.761 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-03-16T20:08:51.037 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:51.043 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:51.044 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:51.046 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:51.046 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:51.635 INFO:teuthology.orchestra.run.smithi132.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T20:08:51.641 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/501 2024-03-16T20:08:51.641 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/501 2024-03-16T20:08:51.641 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:51.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:51.926 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-03-16T20:08:52.304 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:52.309 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:52.310 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:52.311 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:52.311 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:52.714 INFO:teuthology.orchestra.run.smithi132.stdout:generic/502 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:08:52.719 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/502 2024-03-16T20:08:52.719 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/502 2024-03-16T20:08:52.719 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:52.722 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:52.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:52.772 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-03-16T20:08:53.103 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:53.111 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:53.111 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:53.112 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:53.113 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:53.478 INFO:teuthology.orchestra.run.smithi132.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T20:08:53.484 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/503 2024-03-16T20:08:53.484 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/503 2024-03-16T20:08:53.484 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:53.487 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:53.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:53.524 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-03-16T20:08:53.806 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:53.812 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:53.812 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:53.813 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:53.813 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:54.242 INFO:teuthology.orchestra.run.smithi132.stdout:generic/504 1s 2024-03-16T20:08:54.251 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/504 2024-03-16T20:08:54.251 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:54.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:54.291 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-03-16T20:08:54.583 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:54.589 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:54.590 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:54.591 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:54.591 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:55.058 INFO:teuthology.orchestra.run.smithi132.stdout:generic/505 [not run] ceph does not support shutdown 2024-03-16T20:08:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/505 2024-03-16T20:08:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/505 2024-03-16T20:08:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:55.082 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:55.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:55.099 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-03-16T20:08:55.393 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:55.402 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:55.403 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:55.404 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:55.404 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:55.742 INFO:teuthology.orchestra.run.smithi132.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T20:08:55.747 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/506 2024-03-16T20:08:55.747 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/506 2024-03-16T20:08:55.747 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:55.750 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:55.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:55.784 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-03-16T20:08:56.089 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:56.094 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:56.097 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:56.098 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:56.098 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:56.477 INFO:teuthology.orchestra.run.smithi132.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-03-16T20:08:56.482 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/507 2024-03-16T20:08:56.482 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/507 2024-03-16T20:08:56.482 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:56.488 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:56.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:56.526 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-03-16T20:08:56.803 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:56.808 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:56.808 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:56.810 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:56.810 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:57.151 INFO:teuthology.orchestra.run.smithi132.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-03-16T20:08:57.157 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/508 2024-03-16T20:08:57.158 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/508 2024-03-16T20:08:57.158 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:57.161 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:57.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:57.203 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-03-16T20:08:57.524 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:57.529 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:57.529 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:57.530 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:57.530 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:57.895 INFO:teuthology.orchestra.run.smithi132.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-03-16T20:08:57.900 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/509 2024-03-16T20:08:57.900 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/509 2024-03-16T20:08:57.900 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:57.903 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:57.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:57.932 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-03-16T20:08:58.241 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:58.248 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:58.249 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:58.250 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:58.250 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:58.598 INFO:teuthology.orchestra.run.smithi132.stdout:generic/510 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:08:58.603 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/510 2024-03-16T20:08:58.603 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/510 2024-03-16T20:08:58.604 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:58.606 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:58.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:58.633 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-03-16T20:08:58.910 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:58.922 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:58.923 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:58.924 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:58.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:59.280 INFO:teuthology.orchestra.run.smithi132.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-16T20:08:59.285 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/511 2024-03-16T20:08:59.285 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/511 2024-03-16T20:08:59.285 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:08:59.288 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:08:59.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:08:59.318 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-03-16T20:08:59.631 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:08:59.645 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:08:59.646 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:08:59.648 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:08:59.648 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:00.024 INFO:teuthology.orchestra.run.smithi132.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T20:09:00.030 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/512 2024-03-16T20:09:00.030 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/512 2024-03-16T20:09:00.030 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:09:00.033 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:00.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:09:00.068 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-03-16T20:09:00.423 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:09:00.427 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:09:00.428 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:09:00.429 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:09:00.429 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:00.983 INFO:teuthology.orchestra.run.smithi132.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T20:09:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/513 2024-03-16T20:09:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/513 2024-03-16T20:09:00.993 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:09:00.995 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:01.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:09:01.213 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-03-16T20:09:01.587 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:09:01.597 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:09:01.597 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:09:01.598 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:09:01.598 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:02.199 INFO:teuthology.orchestra.run.smithi132.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T20:09:02.205 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/514 2024-03-16T20:09:02.205 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/514 2024-03-16T20:09:02.205 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:09:02.209 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:02.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:09:02.571 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-03-16T20:09:02.879 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:09:02.884 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:09:02.884 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:09:02.886 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:09:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:03.450 INFO:teuthology.orchestra.run.smithi132.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T20:09:03.456 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/515 2024-03-16T20:09:03.456 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/515 2024-03-16T20:09:03.456 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:09:03.460 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:03.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:09:03.846 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-03-16T20:09:04.131 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:09:04.138 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:09:04.138 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:09:04.139 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:09:04.139 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:04.568 INFO:teuthology.orchestra.run.smithi132.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-16T20:09:04.574 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/516 2024-03-16T20:09:04.574 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/516 2024-03-16T20:09:04.574 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:09:04.577 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:04.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:09:04.653 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-03-16T20:09:05.124 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:09:05.130 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:09:05.130 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:09:05.132 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:09:05.132 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:05.655 INFO:teuthology.orchestra.run.smithi132.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-16T20:09:05.729 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/517 2024-03-16T20:09:05.729 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/517 2024-03-16T20:09:05.729 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:09:05.732 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:06.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:09:06.007 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-03-16T20:09:06.357 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:09:06.373 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:09:06.373 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:09:06.375 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:09:06.375 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:06.996 INFO:teuthology.orchestra.run.smithi132.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T20:09:07.002 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/518 2024-03-16T20:09:07.002 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/518 2024-03-16T20:09:07.002 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:09:07.005 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:07.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:09:07.471 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-03-16T20:09:07.751 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:09:07.756 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:09:07.757 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:09:07.758 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:09:07.758 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:08.163 INFO:teuthology.orchestra.run.smithi132.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-03-16T20:09:08.168 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/519 2024-03-16T20:09:08.168 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/519 2024-03-16T20:09:08.168 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:09:08.171 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:08.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:09:08.251 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-03-16T20:09:08.663 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:09:08.679 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:09:08.680 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:09:08.681 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:09:08.681 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:09.055 INFO:teuthology.orchestra.run.smithi132.stdout:generic/520 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T20:09:09.060 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/520 2024-03-16T20:09:09.060 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/520 2024-03-16T20:09:09.060 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T20:09:09.063 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:09:09.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T20:09:09.091 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-03-16T20:09:09.386 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T20:09:09.392 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T20:09:09.393 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T20:09:09.395 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T20:09:09.395 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T20:10:53.231 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:10:53.233 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:10:53.322 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T20:10:53.328+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 582874) UID: 0 2024-03-16T20:10:53.323 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T20:10:53.329+0000 7f7621818640 -1 Fail to open '/proc/582874/cmdline' error = (2) No such file or directory 2024-03-16T20:10:53.323 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T20:10:53.329+0000 7f7621818640 -1 received signal: Hangup from (PID: 582874) UID: 0 2024-03-16T20:13:54.326 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T20:13:54.328+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582877) UID: 0 2024-03-16T20:13:54.327 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T20:13:54.328+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582877) UID: 0 2024-03-16T20:13:54.327 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T20:13:54.328+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582877) UID: 0 2024-03-16T20:13:54.327 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T20:13:54.330+0000 7fabfe11d640 -1 Fail to open '/proc/582877/cmdline' error = (2) No such file or directory 2024-03-16T20:13:54.327 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T20:13:54.330+0000 7fabfe11d640 -1 received signal: Hangup from (PID: 582877) UID: 0 2024-03-16T20:17:27.101 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:17:27.104 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:17:57.226 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:17:57.229 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:18:27.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:18:27.306 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:18:57.429 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:18:57.432 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:19:27.536 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:19:27.539 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:19:57.952 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:19:57.955 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:20:28.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:20:28.227 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:20:58.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:20:58.308 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:21:28.376 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:21:28.379 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:21:58.706 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:21:58.709 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:22:28.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:22:28.784 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:22:28.828 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T20:22:28.827+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583101) UID: 0 2024-03-16T20:22:28.829 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T20:22:28.827+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583101) UID: 0 2024-03-16T20:22:28.829 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T20:22:28.827+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583101) UID: 0 2024-03-16T20:22:28.830 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T20:22:28.828+0000 7f94d54a1640 -1 Fail to open '/proc/583101/cmdline' error = (2) No such file or directory 2024-03-16T20:22:28.830 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T20:22:28.828+0000 7f94d54a1640 -1 received signal: Hangup from (PID: 583101) UID: 0 2024-03-16T20:25:49.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:25:49.008 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:26:19.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:26:19.079 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:26:49.184 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:26:49.187 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:27:19.256 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:27:19.258 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:27:49.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:27:49.332 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:28:19.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:28:19.405 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:28:49.490 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:28:49.495 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:28:49.568 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T20:28:49.565+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51331) UID: 0 2024-03-16T20:28:49.569 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T20:28:49.565+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51331) UID: 0 2024-03-16T20:28:49.569 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T20:28:49.565+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51331) UID: 0 2024-03-16T20:28:49.574 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T20:28:49.565+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51331) UID: 0 2024-03-16T20:31:45.928 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:31:45.935 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:32:16.098 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:32:16.101 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:32:46.221 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:32:46.224 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:33:16.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:33:16.470 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:33:46.539 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:33:46.542 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:33:46.580 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T20:33:46.575+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51430) UID: 0 2024-03-16T20:33:46.581 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T20:33:46.575+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51430) UID: 0 2024-03-16T20:33:46.581 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T20:33:46.575+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51430) UID: 0 2024-03-16T20:33:46.581 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T20:33:46.575+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51430) UID: 0 2024-03-16T20:36:49.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:36:49.081 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:36:49.123 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T20:36:49.118+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51452) UID: 0 2024-03-16T20:36:49.124 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T20:36:49.119+0000 7ff3012c0640 -1 Fail to open '/proc/51452/cmdline' error = (2) No such file or directory 2024-03-16T20:36:49.124 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T20:36:49.119+0000 7ff3012c0640 -1 received signal: Hangup from (PID: 51452) UID: 0 2024-03-16T20:36:49.125 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T20:36:49.121+0000 7f77b3cf3640 -1 Fail to open '/proc/51452/cmdline' error = (2) No such file or directory 2024-03-16T20:36:49.125 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T20:36:49.121+0000 7f77b3cf3640 -1 received signal: Hangup from (PID: 51452) UID: 0 2024-03-16T20:36:49.128 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T20:36:49.119+0000 7fdcbc10c640 -1 received signal: Hangup from (PID: 51452) UID: 0 2024-03-16T20:39:59.023 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:39:59.027 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:40:29.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:40:29.128 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:40:59.330 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:40:59.333 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:40:59.396 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T20:40:59.391+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583407) UID: 0 2024-03-16T20:40:59.396 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T20:40:59.391+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583407) UID: 0 2024-03-16T20:40:59.406 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T20:40:59.392+0000 7f94d54a1640 -1 Fail to open '/proc/583407/cmdline' error = (2) No such file or directory 2024-03-16T20:40:59.406 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T20:40:59.392+0000 7f94d54a1640 -1 received signal: Hangup from (PID: 583407) UID: 0 2024-03-16T20:40:59.407 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T20:40:59.393+0000 7f9fd4d91640 -1 Fail to open '/proc/583407/cmdline' error = (2) No such file or directory 2024-03-16T20:40:59.407 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T20:40:59.393+0000 7f9fd4d91640 -1 received signal: Hangup from (PID: 583407) UID: 0 2024-03-16T20:44:15.724 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:44:15.727 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:44:15.768 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T20:44:15.765+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51537) UID: 0 2024-03-16T20:44:15.769 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T20:44:15.765+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51537) UID: 0 2024-03-16T20:44:15.769 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T20:44:15.765+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51537) UID: 0 2024-03-16T20:44:15.769 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T20:44:15.765+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51537) UID: 0 2024-03-16T20:47:33.296 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:47:33.299 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:48:03.582 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:48:03.584 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:48:03.632 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T20:48:03.629+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583468) UID: 0 2024-03-16T20:48:03.633 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T20:48:03.630+0000 7fc9fd2d4640 -1 Fail to open '/proc/583468/cmdline' error = (2) No such file or directory 2024-03-16T20:48:03.633 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T20:48:03.630+0000 7fc9fd2d4640 -1 received signal: Hangup from (PID: 583468) UID: 0 2024-03-16T20:48:03.634 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T20:48:03.629+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583468) UID: 0 2024-03-16T20:48:03.634 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T20:48:03.629+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583468) UID: 0 2024-03-16T20:51:21.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:51:21.453 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:51:51.598 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:51:51.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:52:21.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:52:21.803 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:52:51.909 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:52:51.912 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:53:22.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:53:22.019 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:53:52.128 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:53:52.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:54:22.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:54:22.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:54:52.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:54:52.535 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:55:23.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:55:23.019 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:55:53.095 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:55:53.098 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:56:23.186 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:56:23.189 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:56:53.558 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:56:53.561 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:57:23.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:57:23.643 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T20:57:23.754 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T20:57:23.750+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51818) UID: 0 2024-03-16T20:57:23.754 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T20:57:23.750+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51818) UID: 0 2024-03-16T20:57:23.755 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T20:57:23.750+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51818) UID: 0 2024-03-16T20:57:23.755 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T20:57:23.750+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51818) UID: 0 2024-03-16T21:00:24.664 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:00:24.668 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:00:24.711 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T21:00:24.707+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583732) UID: 0 2024-03-16T21:00:24.711 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T21:00:24.707+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583732) UID: 0 2024-03-16T21:00:24.712 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T21:00:24.707+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583732) UID: 0 2024-03-16T21:00:24.712 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T21:00:24.707+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583732) UID: 0 2024-03-16T21:03:48.130 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:03:48.133 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:04:18.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:04:18.507 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:04:48.636 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:04:48.639 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:05:18.726 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:05:18.730 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:05:48.828 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:05:48.831 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:06:18.933 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:06:18.964 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:06:49.264 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:06:49.267 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:07:19.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:07:19.481 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:07:49.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:07:49.978 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:08:20.057 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:08:20.061 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:08:50.121 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:08:50.124 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:09:20.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:09:20.238 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:09:50.312 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:09:50.317 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:10:20.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:10:20.435 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:10:50.757 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:10:50.760 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:11:20.828 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:11:20.832 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:11:50.942 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:11:50.945 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:12:21.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:12:21.345 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:12:51.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:12:51.758 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:13:22.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:13:22.106 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:13:52.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:13:52.179 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:14:22.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:14:22.370 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:14:52.465 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:14:52.474 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:15:22.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:15:22.883 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:15:52.952 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:15:52.955 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:16:23.057 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:16:23.061 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:16:53.130 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:16:53.133 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:17:23.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:17:23.418 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:17:53.491 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:17:53.494 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:18:23.571 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:18:23.577 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:18:53.701 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:18:53.705 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:19:23.856 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:19:23.859 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:19:53.945 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:19:53.948 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:20:24.200 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:20:24.205 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:20:54.306 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:20:54.309 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:20:54.374 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T21:20:54.371+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52503) UID: 0 2024-03-16T21:20:54.380 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T21:20:54.371+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52503) UID: 0 2024-03-16T21:20:54.380 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T21:20:54.371+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52503) UID: 0 2024-03-16T21:20:54.381 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T21:20:54.371+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52503) UID: 0 2024-03-16T21:24:05.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:24:05.688 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:24:05.779 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T21:24:05.776+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52526) UID: 0 2024-03-16T21:24:05.780 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T21:24:05.776+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52526) UID: 0 2024-03-16T21:24:05.780 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T21:24:05.776+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52526) UID: 0 2024-03-16T21:24:05.780 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T21:24:05.776+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52526) UID: 0 2024-03-16T21:24:05.949 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T21:24:05.947+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 584409) UID: 0 2024-03-16T21:24:05.950 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T21:24:05.947+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 584409) UID: 0 2024-03-16T21:24:05.950 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T21:24:05.947+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 584409) UID: 0 2024-03-16T21:24:05.950 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T21:24:05.948+0000 7fc9fd2d4640 -1 received signal: Hangup from (PID: 584409) UID: 0 2024-03-16T21:30:31.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:30:31.036 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:30:31.084 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T21:30:31.083+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52551) UID: 0 2024-03-16T21:30:31.085 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T21:30:31.083+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52551) UID: 0 2024-03-16T21:30:31.085 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T21:30:31.083+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52551) UID: 0 2024-03-16T21:30:31.086 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T21:30:31.085+0000 7f77b3cf3640 -1 Fail to open '/proc/52551/cmdline' error = (2) No such file or directory 2024-03-16T21:30:31.086 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T21:30:31.085+0000 7f77b3cf3640 -1 received signal: Hangup from (PID: 52551) UID: 0 2024-03-16T21:30:31.299 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T21:30:31.297+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 584435) UID: 0 2024-03-16T21:30:31.299 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T21:30:31.297+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 584435) UID: 0 2024-03-16T21:34:03.395 INFO:teuthology.orchestra.run.smithi132.stdout:generic/521 5094s 2024-03-16T21:34:03.442 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/521 2024-03-16T21:34:03.442 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T21:34:03.455 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T21:34:03.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T21:34:03.535 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-03-16T21:34:04.112 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T21:34:04.117 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T21:34:04.118 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T21:34:04.119 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T21:34:04.119 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T21:34:07.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:34:07.321 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:34:37.456 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:34:37.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:35:07.732 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:35:07.735 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:35:37.816 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:35:37.819 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:36:07.918 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:36:07.921 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:36:38.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:36:38.309 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:37:08.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:37:08.535 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:37:38.605 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:37:38.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:38:08.705 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:38:08.709 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:38:38.777 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:38:38.780 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:39:08.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:39:08.880 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:39:39.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:39:39.247 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:40:09.307 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:40:09.311 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:40:39.734 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:40:39.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:41:09.802 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:41:09.805 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:41:40.188 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:41:40.193 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:42:10.325 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:42:10.328 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:42:40.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:42:40.503 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:42:40.551 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T21:42:40.551+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585251) UID: 0 2024-03-16T21:42:40.552 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T21:42:40.551+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585251) UID: 0 2024-03-16T21:42:40.552 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T21:42:40.551+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585251) UID: 0 2024-03-16T21:42:40.552 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T21:42:40.551+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585251) UID: 0 2024-03-16T21:46:04.115 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:46:04.118 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:46:34.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:46:34.619 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:47:04.706 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:47:04.709 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:47:34.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:47:34.782 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:48:04.909 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:48:04.913 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:48:34.973 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:48:34.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:49:05.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:49:05.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:49:35.301 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:49:35.304 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:50:05.433 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:50:05.436 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:50:35.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:50:35.721 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:51:05.795 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:51:05.801 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:51:35.876 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:51:35.879 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:52:06.010 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:52:06.013 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:52:36.105 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:52:36.108 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:53:06.252 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:53:06.255 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:53:36.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:53:36.326 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:54:06.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:54:06.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:54:36.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:54:36.502 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:55:06.598 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:55:06.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:55:36.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:55:36.673 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:56:06.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:56:06.829 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:56:37.132 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:56:37.135 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:57:07.280 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:57:07.283 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T21:57:07.335 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T21:57:07.343+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585679) UID: 0 2024-03-16T21:57:07.335 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T21:57:07.343+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585679) UID: 0 2024-03-16T21:57:07.335 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T21:57:07.343+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585679) UID: 0 2024-03-16T21:57:07.336 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T21:57:07.343+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585679) UID: 0 2024-03-16T22:00:34.537 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:00:34.540 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:00:34.604 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T22:00:34.613+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53333) UID: 0 2024-03-16T22:00:34.604 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T22:00:34.613+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53333) UID: 0 2024-03-16T22:00:34.604 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T22:00:34.613+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53333) UID: 0 2024-03-16T22:00:34.612 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T22:00:34.613+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53333) UID: 0 2024-03-16T22:03:47.778 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:03:47.782 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:04:17.933 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:04:17.936 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:04:48.006 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:04:48.009 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:05:18.128 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:05:18.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:05:48.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:05:48.280 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:06:18.580 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:06:18.583 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:06:18.628 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T22:06:18.638+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585823) UID: 0 2024-03-16T22:06:18.628 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T22:06:18.638+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585823) UID: 0 2024-03-16T22:06:18.629 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T22:06:18.640+0000 7f94d54a1640 -1 Fail to open '/proc/585823/cmdline' error = (2) No such file or directory 2024-03-16T22:06:18.629 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T22:06:18.640+0000 7f94d54a1640 -1 received signal: Hangup from (PID: 585823) UID: 0 2024-03-16T22:06:18.629 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T22:06:18.638+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585823) UID: 0 2024-03-16T22:09:46.091 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:09:46.094 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:09:46.134 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T22:09:46.144+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53479) UID: 0 2024-03-16T22:09:46.134 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T22:09:46.144+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53479) UID: 0 2024-03-16T22:09:46.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T22:09:46.145+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53479) UID: 0 2024-03-16T22:09:46.139 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T22:09:46.145+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53479) UID: 0 2024-03-16T22:15:40.344 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:15:40.347 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:15:40.673 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T22:15:40.684+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53504) UID: 0 2024-03-16T22:15:40.673 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T22:15:40.684+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53504) UID: 0 2024-03-16T22:15:40.673 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T22:15:40.684+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53504) UID: 0 2024-03-16T22:15:40.677 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T22:15:40.684+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53504) UID: 0 2024-03-16T22:19:05.199 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:19:05.202 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:19:35.356 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:19:35.361 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:20:05.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:20:05.476 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:20:35.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:20:35.802 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:21:06.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:21:06.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:21:36.398 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:21:36.401 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:22:06.782 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:22:06.785 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:22:36.857 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:22:36.861 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:23:06.968 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:23:06.971 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:23:37.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:23:37.049 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:24:07.297 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:24:07.300 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:24:07.370 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T22:24:07.374+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 586086) UID: 0 2024-03-16T22:24:07.372 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T22:24:07.376+0000 7f7621818640 -1 Fail to open '/proc/586086/cmdline' error = (2) No such file or directory 2024-03-16T22:24:07.372 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T22:24:07.376+0000 7f7621818640 -1 received signal: Hangup from (PID: 586086) UID: 0 2024-03-16T22:24:55.395 INFO:teuthology.orchestra.run.smithi132.stdout:generic/522 3051s 2024-03-16T22:24:55.473 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/522 2024-03-16T22:24:55.473 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:24:55.476 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:24:55.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:24:55.533 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-03-16T22:24:56.544 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:24:56.548 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:24:56.549 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:24:56.550 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:24:56.550 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:24:57.442 INFO:teuthology.orchestra.run.smithi132.stdout:generic/523 1s 2024-03-16T22:24:57.450 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/523 2024-03-16T22:24:57.450 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:24:57.455 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:24:57.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:24:57.466 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-03-16T22:24:57.772 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:24:57.776 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:24:57.777 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:24:57.778 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:24:57.778 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:02.448 INFO:teuthology.orchestra.run.smithi132.stdout:generic/524 5s 2024-03-16T22:25:02.456 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/524 2024-03-16T22:25:02.456 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:02.461 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:02.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:02.473 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-03-16T22:25:02.746 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:02.751 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:02.751 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:02.752 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:02.752 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:03.285 INFO:teuthology.orchestra.run.smithi132.stdout:generic/525 [not run] filesystem does not support huge file size 2024-03-16T22:25:03.310 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/525 2024-03-16T22:25:03.310 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/525 2024-03-16T22:25:03.310 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:03.315 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:03.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:03.343 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-03-16T22:25:03.659 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:03.664 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:03.665 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:03.666 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:03.666 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:04.139 INFO:teuthology.orchestra.run.smithi132.stdout:generic/526 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:25:04.144 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/526 2024-03-16T22:25:04.144 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/526 2024-03-16T22:25:04.144 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:04.148 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:04.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:04.197 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-03-16T22:25:04.503 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:04.510 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:04.510 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:04.513 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:04.513 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:04.889 INFO:teuthology.orchestra.run.smithi132.stdout:generic/527 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:25:04.894 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/527 2024-03-16T22:25:04.894 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/527 2024-03-16T22:25:04.894 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:04.897 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:04.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:04.931 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-03-16T22:25:05.254 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:05.260 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:05.261 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:05.262 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:05.262 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:05.696 INFO:teuthology.orchestra.run.smithi132.stdout:generic/528 0s 2024-03-16T22:25:05.704 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/528 2024-03-16T22:25:05.704 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:05.707 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:05.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:05.747 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-03-16T22:25:06.189 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:06.195 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:06.195 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:06.197 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:06.197 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:07.306 INFO:teuthology.orchestra.run.smithi132.stdout:generic/529 1s 2024-03-16T22:25:07.357 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/529 2024-03-16T22:25:07.357 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:07.361 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:07.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:07.370 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-03-16T22:25:07.697 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:07.704 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:07.704 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:07.705 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:07.706 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:08.219 INFO:teuthology.orchestra.run.smithi132.stdout:generic/530 [not run] ceph does not support shutdown 2024-03-16T22:25:08.232 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/530 2024-03-16T22:25:08.232 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/530 2024-03-16T22:25:08.232 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:08.235 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:08.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:08.255 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-03-16T22:25:08.526 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:08.536 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:08.536 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:08.538 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:08.538 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:08.982 INFO:teuthology.orchestra.run.smithi132.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-03-16T22:25:08.987 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/531 2024-03-16T22:25:08.987 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/531 2024-03-16T22:25:08.987 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:08.990 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:09.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:09.022 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-03-16T22:25:09.287 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:09.291 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:09.292 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:09.293 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:09.293 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:09.945 INFO:teuthology.orchestra.run.smithi132.stdout:generic/532 0s 2024-03-16T22:25:10.052 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/532 2024-03-16T22:25:10.052 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:10.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:10.075 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-03-16T22:25:10.345 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:10.350 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:10.351 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:10.352 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:10.352 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:11.620 INFO:teuthology.orchestra.run.smithi132.stdout:generic/533 1s 2024-03-16T22:25:11.627 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/533 2024-03-16T22:25:11.627 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:11.629 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:11.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:11.654 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-03-16T22:25:11.960 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:11.967 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:11.967 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:11.969 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:11.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:12.366 INFO:teuthology.orchestra.run.smithi132.stdout:generic/534 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:25:12.372 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/534 2024-03-16T22:25:12.372 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/534 2024-03-16T22:25:12.372 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:12.375 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:12.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:12.400 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-03-16T22:25:12.699 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:12.704 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:12.705 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:12.707 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:12.707 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:13.051 INFO:teuthology.orchestra.run.smithi132.stdout:generic/535 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:25:13.056 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/535 2024-03-16T22:25:13.056 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/535 2024-03-16T22:25:13.056 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:13.059 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:13.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:13.095 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-03-16T22:25:13.397 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:13.403 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:13.403 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:13.409 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:13.410 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:13.915 INFO:teuthology.orchestra.run.smithi132.stdout:generic/536 [not run] ceph does not support shutdown 2024-03-16T22:25:13.937 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/536 2024-03-16T22:25:13.937 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/536 2024-03-16T22:25:13.938 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:13.939 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:13.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:13.965 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-03-16T22:25:14.263 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:14.268 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:14.268 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:14.269 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:14.269 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:14.771 INFO:teuthology.orchestra.run.smithi132.stdout:generic/537 [not run] FSTRIM not supported 2024-03-16T22:25:14.787 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/537 2024-03-16T22:25:14.787 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/537 2024-03-16T22:25:14.787 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:25:14.790 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:25:14.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:25:14.818 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-03-16T22:25:15.133 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:25:15.138 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:25:15.139 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:25:15.140 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:25:15.140 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:27:10.125 INFO:teuthology.orchestra.run.smithi132.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.a.log.1: 2024-03-16T22:27:10.126 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: stdin: file size changed while zipping 2024-03-16T22:27:12.106 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T22:27:12.108+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 595507) UID: 0 2024-03-16T22:27:12.107 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T22:27:12.108+0000 7fc9fd2d4640 -1 Fail to open '/proc/595507/cmdline' error = (2) No such file or directory 2024-03-16T22:27:12.107 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T22:27:12.108+0000 7fc9fd2d4640 -1 received signal: Hangup from (PID: 595507) UID: 0 2024-03-16T22:27:12.107 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T22:27:12.109+0000 7fabfe11d640 -1 Fail to open '/proc/595507/cmdline' error = (2) No such file or directory 2024-03-16T22:27:12.107 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T22:27:12.109+0000 7fabfe11d640 -1 received signal: Hangup from (PID: 595507) UID: 0 2024-03-16T22:27:12.108 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T22:27:12.110+0000 7f94d54a1640 -1 Fail to open '/proc/595507/cmdline' error = (2) No such file or directory 2024-03-16T22:27:12.108 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T22:27:12.110+0000 7f94d54a1640 -1 received signal: Hangup from (PID: 595507) UID: 0 2024-03-16T22:33:25.005 INFO:teuthology.orchestra.run.smithi132.stdout:generic/538 489s 2024-03-16T22:33:25.012 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/538 2024-03-16T22:33:25.012 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:25.015 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:25.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:25.056 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-03-16T22:33:25.554 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:25.560 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:25.560 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:25.562 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:25.562 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:27.704 INFO:teuthology.orchestra.run.smithi132.stdout:generic/539 2s 2024-03-16T22:33:27.714 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/539 2024-03-16T22:33:27.714 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:27.718 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:27.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:27.800 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-03-16T22:33:28.192 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:28.198 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:28.198 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:28.200 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:28.200 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:28.827 INFO:teuthology.orchestra.run.smithi132.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T22:33:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/540 2024-03-16T22:33:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/540 2024-03-16T22:33:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:28.836 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:29.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:29.040 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-03-16T22:33:29.387 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:29.392 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:29.392 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:29.393 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:29.394 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:29.937 INFO:teuthology.orchestra.run.smithi132.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T22:33:29.943 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/541 2024-03-16T22:33:29.943 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/541 2024-03-16T22:33:29.943 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:29.946 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:30.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:30.218 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-03-16T22:33:30.524 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:30.528 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:30.528 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:30.530 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:30.530 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:31.138 INFO:teuthology.orchestra.run.smithi132.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T22:33:31.145 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/542 2024-03-16T22:33:31.145 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/542 2024-03-16T22:33:31.145 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:31.147 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:31.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:31.414 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-03-16T22:33:31.735 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:31.740 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:31.740 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:31.741 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:31.742 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:32.278 INFO:teuthology.orchestra.run.smithi132.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T22:33:32.286 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/543 2024-03-16T22:33:32.286 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/543 2024-03-16T22:33:32.286 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:32.294 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:32.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:32.533 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-03-16T22:33:32.842 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:32.851 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:32.852 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:32.853 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:32.853 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:33.402 INFO:teuthology.orchestra.run.smithi132.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T22:33:33.409 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/544 2024-03-16T22:33:33.409 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/544 2024-03-16T22:33:33.409 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:33.411 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:33.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:33.651 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-03-16T22:33:33.957 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:33.962 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:33.963 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:33.964 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:33.964 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:34.416 INFO:teuthology.orchestra.run.smithi132.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-03-16T22:33:34.421 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/545 2024-03-16T22:33:34.421 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/545 2024-03-16T22:33:34.421 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:34.423 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:34.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:34.461 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-03-16T22:33:34.724 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:34.733 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:34.734 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:34.734 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:34.735 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:35.077 INFO:teuthology.orchestra.run.smithi132.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T22:33:35.083 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/546 2024-03-16T22:33:35.083 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/546 2024-03-16T22:33:35.083 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:35.088 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:35.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:35.121 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-03-16T22:33:35.381 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:35.395 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:35.396 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:35.396 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:35.707 INFO:teuthology.orchestra.run.smithi132.stdout:generic/547 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:33:35.713 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/547 2024-03-16T22:33:35.713 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/547 2024-03-16T22:33:35.713 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:35.716 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:35.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:35.743 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-03-16T22:33:36.010 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:36.014 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:36.014 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:36.016 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:36.016 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:36.762 INFO:teuthology.orchestra.run.smithi132.stdout:generic/548 [not run] kernel does not support ceph encryption 2024-03-16T22:33:36.791 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/548 2024-03-16T22:33:36.791 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/548 2024-03-16T22:33:36.791 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:36.794 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:36.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:36.814 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-03-16T22:33:37.082 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:37.087 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:37.088 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:37.089 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:37.089 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:37.574 INFO:teuthology.orchestra.run.smithi132.stdout:generic/549 [not run] kernel does not support ceph encryption 2024-03-16T22:33:37.597 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/549 2024-03-16T22:33:37.597 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/549 2024-03-16T22:33:37.598 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:37.600 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:37.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:37.623 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-03-16T22:33:37.897 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:37.902 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:37.903 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:37.904 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:37.904 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:38.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:33:38.249 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:33:38.302 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T22:33:38.302+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606000) UID: 0 2024-03-16T22:33:38.303 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T22:33:38.302+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606000) UID: 0 2024-03-16T22:33:38.303 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T22:33:38.302+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606000) UID: 0 2024-03-16T22:33:38.303 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T22:33:38.302+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606000) UID: 0 2024-03-16T22:33:38.542 INFO:teuthology.orchestra.run.smithi132.stdout:generic/550 [not run] kernel does not support ceph encryption 2024-03-16T22:33:38.567 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/550 2024-03-16T22:33:38.568 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/550 2024-03-16T22:33:38.568 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:33:38.571 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:33:38.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:33:38.591 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-03-16T22:33:38.885 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:33:38.891 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:33:38.892 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:33:38.893 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:33:38.893 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:37:28.134 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:37:28.137 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:37:58.519 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:37:58.525 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:38:28.835 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:38:28.838 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:38:58.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:38:58.986 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:39:29.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:39:29.059 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:39:59.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:39:59.155 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:40:29.473 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:40:29.476 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:40:59.557 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:40:59.564 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:41:29.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:41:29.674 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:41:59.753 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:41:59.756 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:42:29.885 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:42:29.889 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:42:59.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:42:59.987 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:43:30.173 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:43:30.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:44:00.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:44:00.249 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:44:30.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:44:30.434 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:45:00.707 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:45:00.711 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:45:30.804 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:45:30.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:46:00.951 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:46:00.954 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:46:16.808 INFO:teuthology.orchestra.run.smithi132.stdout:generic/551 757s 2024-03-16T22:46:16.845 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/551 2024-03-16T22:46:16.845 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:16.848 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:16.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:16.870 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-03-16T22:46:17.436 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:17.443 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:17.446 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:17.446 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:17.446 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:17.863 INFO:teuthology.orchestra.run.smithi132.stdout:generic/552 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:46:17.867 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/552 2024-03-16T22:46:17.867 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/552 2024-03-16T22:46:17.867 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:17.870 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:17.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:17.891 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-03-16T22:46:18.150 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:18.154 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:18.154 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:18.157 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:18.157 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:18.553 INFO:teuthology.orchestra.run.smithi132.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2024-03-16T22:46:18.560 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/553 2024-03-16T22:46:18.560 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/553 2024-03-16T22:46:18.560 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:18.564 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:18.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:18.628 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-03-16T22:46:19.060 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:19.065 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:19.066 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:19.067 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:19.067 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:19.684 INFO:teuthology.orchestra.run.smithi132.stdout:generic/554 [not run] swapfiles are not supported 2024-03-16T22:46:19.690 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/554 2024-03-16T22:46:19.690 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/554 2024-03-16T22:46:19.690 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:19.693 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:19.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:19.749 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-03-16T22:46:20.232 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:20.236 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:20.237 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:20.238 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:20.238 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:20.693 INFO:teuthology.orchestra.run.smithi132.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2024-03-16T22:46:20.698 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/555 2024-03-16T22:46:20.699 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/555 2024-03-16T22:46:20.699 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:20.702 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:20.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:20.748 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-03-16T22:46:21.176 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:21.183 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:21.183 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:21.185 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:21.536 INFO:teuthology.orchestra.run.smithi132.stdout:generic/556 [not run] ceph does not support casefold feature 2024-03-16T22:46:21.541 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/556 2024-03-16T22:46:21.541 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/556 2024-03-16T22:46:21.541 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:21.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:21.571 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-03-16T22:46:21.851 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:21.855 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:21.856 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:21.858 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:21.858 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:22.189 INFO:teuthology.orchestra.run.smithi132.stdout:generic/557 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:46:22.196 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/557 2024-03-16T22:46:22.196 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/557 2024-03-16T22:46:22.196 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:22.200 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:22.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:22.225 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-03-16T22:46:22.483 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:22.488 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:22.489 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:22.490 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:22.490 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:22.809 INFO:teuthology.orchestra.run.smithi132.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-16T22:46:22.814 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/558 2024-03-16T22:46:22.814 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/558 2024-03-16T22:46:22.814 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:22.816 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:22.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:22.841 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-03-16T22:46:23.097 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:23.102 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:23.102 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:23.103 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:23.103 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:23.428 INFO:teuthology.orchestra.run.smithi132.stdout:generic/559 [not run] duperemove utility required, skipped this test 2024-03-16T22:46:23.433 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/559 2024-03-16T22:46:23.434 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/559 2024-03-16T22:46:23.434 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:23.437 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:23.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:23.454 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-03-16T22:46:23.726 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:23.732 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:23.732 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:23.734 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:23.734 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:24.021 INFO:teuthology.orchestra.run.smithi132.stdout:generic/560 [not run] duperemove utility required, skipped this test 2024-03-16T22:46:24.031 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/560 2024-03-16T22:46:24.031 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/560 2024-03-16T22:46:24.031 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:24.034 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:24.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:24.053 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-03-16T22:46:24.326 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:24.331 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:24.332 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:24.333 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:24.333 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:24.635 INFO:teuthology.orchestra.run.smithi132.stdout:generic/561 [not run] duperemove utility required, skipped this test 2024-03-16T22:46:24.640 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/561 2024-03-16T22:46:24.641 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/561 2024-03-16T22:46:24.641 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:24.643 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:24.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:24.666 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-03-16T22:46:24.945 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:24.952 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:24.953 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:24.954 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:24.954 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:25.435 INFO:teuthology.orchestra.run.smithi132.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T22:46:25.446 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/562 2024-03-16T22:46:25.446 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/562 2024-03-16T22:46:25.446 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:25.448 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:25.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:25.752 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-03-16T22:46:26.044 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:26.050 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:26.051 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:26.052 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:26.052 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:26.412 INFO:teuthology.orchestra.run.smithi132.stdout:generic/563 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:46:26.418 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/563 2024-03-16T22:46:26.418 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/563 2024-03-16T22:46:26.418 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:26.421 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:26.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:26.443 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-03-16T22:46:26.713 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:26.718 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:26.719 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:26.720 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:26.720 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:27.244 INFO:teuthology.orchestra.run.smithi132.stdout:generic/564 1s 2024-03-16T22:46:27.250 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/564 2024-03-16T22:46:27.250 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:27.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:27.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:27.321 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-03-16T22:46:27.745 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:27.751 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:27.751 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:27.753 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:27.753 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:28.315 INFO:teuthology.orchestra.run.smithi132.stdout:generic/565 1s 2024-03-16T22:46:28.322 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/565 2024-03-16T22:46:28.323 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:28.325 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:28.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:28.374 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-03-16T22:46:28.787 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:28.794 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:28.795 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:28.796 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:28.797 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:29.109 INFO:teuthology.orchestra.run.smithi132.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T22:46:29.113 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/566 2024-03-16T22:46:29.114 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/566 2024-03-16T22:46:29.114 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:29.116 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:29.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:29.147 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-03-16T22:46:29.410 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:29.416 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:29.417 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:29.418 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:29.418 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:30.172 INFO:teuthology.orchestra.run.smithi132.stdout:generic/567 1s 2024-03-16T22:46:30.179 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/567 2024-03-16T22:46:30.179 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:30.182 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:30.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:30.193 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-03-16T22:46:30.482 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:30.487 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:30.488 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:30.489 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:30.489 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:30.814 INFO:teuthology.orchestra.run.smithi132.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T22:46:30.820 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/568 2024-03-16T22:46:30.820 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/568 2024-03-16T22:46:30.820 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:30.823 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:30.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:30.852 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-03-16T22:46:31.027 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:46:31.030 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:46:31.131 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:31.135 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:31.136 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:31.137 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:31.137 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:31.468 INFO:teuthology.orchestra.run.smithi132.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T22:46:31.473 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/569 2024-03-16T22:46:31.473 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/569 2024-03-16T22:46:31.473 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:31.481 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:31.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:31.513 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-03-16T22:46:31.814 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:31.819 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:31.819 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:31.821 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:31.821 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:32.121 INFO:teuthology.orchestra.run.smithi132.stdout:generic/570 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:46:32.129 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/570 2024-03-16T22:46:32.130 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/570 2024-03-16T22:46:32.130 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:32.134 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:32.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:32.157 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-03-16T22:46:32.417 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:32.433 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:32.434 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:32.435 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:32.435 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:32.795 INFO:teuthology.orchestra.run.smithi132.stdout:generic/571 [not run] Require fcntl setlease support 2024-03-16T22:46:32.799 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/571 2024-03-16T22:46:32.799 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/571 2024-03-16T22:46:32.799 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:32.802 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:32.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:32.835 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-03-16T22:46:33.103 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:33.109 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:33.110 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:33.111 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:33.111 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:33.411 INFO:teuthology.orchestra.run.smithi132.stdout:generic/572 [not run] fsverity utility required, skipped this test 2024-03-16T22:46:33.416 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/572 2024-03-16T22:46:33.416 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/572 2024-03-16T22:46:33.416 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:33.419 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:33.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:33.440 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-03-16T22:46:33.713 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:33.719 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:33.719 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:33.721 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:34.013 INFO:teuthology.orchestra.run.smithi132.stdout:generic/573 [not run] fsverity utility required, skipped this test 2024-03-16T22:46:34.018 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/573 2024-03-16T22:46:34.018 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/573 2024-03-16T22:46:34.018 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:34.022 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:34.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:34.043 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-03-16T22:46:34.309 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:34.314 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:34.314 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:34.315 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:34.315 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:34.616 INFO:teuthology.orchestra.run.smithi132.stdout:generic/574 [not run] fsverity utility required, skipped this test 2024-03-16T22:46:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/574 2024-03-16T22:46:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/574 2024-03-16T22:46:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:34.625 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:34.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:34.645 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-03-16T22:46:34.919 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:34.923 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:34.923 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:34.925 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:34.925 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:35.230 INFO:teuthology.orchestra.run.smithi132.stdout:generic/575 [not run] fsverity utility required, skipped this test 2024-03-16T22:46:35.237 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/575 2024-03-16T22:46:35.237 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/575 2024-03-16T22:46:35.237 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:35.239 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:35.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:35.264 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-03-16T22:46:35.532 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:35.541 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:35.543 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:35.543 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:35.874 INFO:teuthology.orchestra.run.smithi132.stdout:generic/576 [not run] fsverity utility required, skipped this test 2024-03-16T22:46:35.879 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/576 2024-03-16T22:46:35.879 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/576 2024-03-16T22:46:35.879 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:35.882 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:35.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:35.901 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-03-16T22:46:36.159 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:36.163 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:36.164 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:36.165 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:36.165 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:36.471 INFO:teuthology.orchestra.run.smithi132.stdout:generic/577 [not run] fsverity utility required, skipped this test 2024-03-16T22:46:36.476 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/577 2024-03-16T22:46:36.476 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/577 2024-03-16T22:46:36.476 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:36.479 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:36.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:36.496 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-03-16T22:46:36.767 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:36.771 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:36.772 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:36.773 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:36.773 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:37.109 INFO:teuthology.orchestra.run.smithi132.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-16T22:46:37.113 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/578 2024-03-16T22:46:37.114 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/578 2024-03-16T22:46:37.114 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:37.116 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:37.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:37.142 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-03-16T22:46:37.409 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:37.413 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:37.413 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:37.415 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:37.415 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:37.734 INFO:teuthology.orchestra.run.smithi132.stdout:generic/579 [not run] fsverity utility required, skipped this test 2024-03-16T22:46:37.740 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/579 2024-03-16T22:46:37.740 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/579 2024-03-16T22:46:37.740 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:37.744 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:37.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:37.765 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-03-16T22:46:38.021 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:38.026 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:38.027 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:38.028 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:38.029 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:38.480 INFO:teuthology.orchestra.run.smithi132.stdout:generic/580 [not run] kernel does not support ceph encryption 2024-03-16T22:46:38.493 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/580 2024-03-16T22:46:38.493 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/580 2024-03-16T22:46:38.493 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:38.497 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:38.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:38.529 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-03-16T22:46:38.805 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:38.809 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:38.810 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:38.811 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:38.811 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:40.351 INFO:teuthology.orchestra.run.smithi132.stdout:generic/581 [not run] kernel does not support ceph encryption 2024-03-16T22:46:40.368 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/581 2024-03-16T22:46:40.368 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/581 2024-03-16T22:46:40.368 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:40.372 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:40.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:40.397 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-03-16T22:46:40.659 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:40.666 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:40.666 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:40.667 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:40.667 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:41.212 INFO:teuthology.orchestra.run.smithi132.stdout:generic/582 [not run] kernel does not support ceph encryption 2024-03-16T22:46:41.235 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/582 2024-03-16T22:46:41.235 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/582 2024-03-16T22:46:41.235 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:41.238 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:41.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:41.260 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-03-16T22:46:41.525 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:41.534 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:41.535 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:41.536 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:41.537 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:42.106 INFO:teuthology.orchestra.run.smithi132.stdout:generic/583 [not run] kernel does not support ceph encryption 2024-03-16T22:46:42.133 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/583 2024-03-16T22:46:42.133 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/583 2024-03-16T22:46:42.133 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:42.136 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:42.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:42.156 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-03-16T22:46:42.419 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:42.423 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:42.424 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:42.425 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:42.425 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:42.930 INFO:teuthology.orchestra.run.smithi132.stdout:generic/584 [not run] kernel does not support ceph encryption 2024-03-16T22:46:42.953 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/584 2024-03-16T22:46:42.953 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/584 2024-03-16T22:46:42.953 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:42.956 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:42.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:42.978 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-03-16T22:46:43.243 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:43.248 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:43.249 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:43.250 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:43.250 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:43.653 INFO:teuthology.orchestra.run.smithi132.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2024-03-16T22:46:43.659 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/585 2024-03-16T22:46:43.659 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/585 2024-03-16T22:46:43.659 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:43.662 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:43.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:43.705 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-03-16T22:46:44.149 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:44.154 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:44.154 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:44.156 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:44.156 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:44.592 INFO:teuthology.orchestra.run.smithi132.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T22:46:44.598 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/586 2024-03-16T22:46:44.598 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/586 2024-03-16T22:46:44.598 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:44.602 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:44.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:44.659 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-03-16T22:46:45.087 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:45.092 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:45.092 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:45.094 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:45.094 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:45.426 INFO:teuthology.orchestra.run.smithi132.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T22:46:45.430 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/587 2024-03-16T22:46:45.430 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/587 2024-03-16T22:46:45.430 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:45.433 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:45.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:45.453 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-03-16T22:46:45.718 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:45.723 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:45.724 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:45.725 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:45.725 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:46.247 INFO:teuthology.orchestra.run.smithi132.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T22:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/588 2024-03-16T22:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/588 2024-03-16T22:46:46.254 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:46.257 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:46.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:46.587 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-03-16T22:46:46.851 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:46.857 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:46.858 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:46.859 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:46.859 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:47.206 INFO:teuthology.orchestra.run.smithi132.stdout:generic/589 [not run] require 172.21.15.132:6789:/scratch to be local device 2024-03-16T22:46:47.211 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/589 2024-03-16T22:46:47.211 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/589 2024-03-16T22:46:47.211 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:47.215 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:47.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:47.239 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-03-16T22:46:47.515 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:47.522 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:47.523 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:47.524 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:47.524 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:47.916 INFO:teuthology.orchestra.run.smithi132.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T22:46:47.921 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/590 2024-03-16T22:46:47.921 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/590 2024-03-16T22:46:47.921 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:47.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:47.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:47.957 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-03-16T22:46:48.252 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:48.258 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:48.258 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:48.260 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:48.260 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:48.831 INFO:teuthology.orchestra.run.smithi132.stdout:generic/591 0s 2024-03-16T22:46:48.842 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/591 2024-03-16T22:46:48.842 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:48.847 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:48.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:48.887 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-03-16T22:46:49.351 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:49.356 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:49.356 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:49.358 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:49.358 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:49.837 INFO:teuthology.orchestra.run.smithi132.stdout:generic/592 [not run] kernel does not support ceph encryption 2024-03-16T22:46:49.855 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/592 2024-03-16T22:46:49.855 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/592 2024-03-16T22:46:49.855 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:49.858 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:49.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:49.879 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-03-16T22:46:50.143 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:50.149 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:50.149 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:50.151 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:50.151 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:50.647 INFO:teuthology.orchestra.run.smithi132.stdout:generic/593 [not run] kernel does not support ceph encryption 2024-03-16T22:46:50.676 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/593 2024-03-16T22:46:50.676 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/593 2024-03-16T22:46:50.677 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:50.679 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:50.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:50.699 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-03-16T22:46:50.961 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:50.965 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:50.966 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:50.967 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:50.967 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:51.302 INFO:teuthology.orchestra.run.smithi132.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T22:46:51.306 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/594 2024-03-16T22:46:51.310 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/594 2024-03-16T22:46:51.310 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:51.311 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:51.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:51.335 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-03-16T22:46:51.598 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:51.604 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:51.604 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:51.606 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:51.606 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:52.103 INFO:teuthology.orchestra.run.smithi132.stdout:generic/595 [not run] kernel does not support ceph encryption 2024-03-16T22:46:52.116 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/595 2024-03-16T22:46:52.116 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/595 2024-03-16T22:46:52.116 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:52.119 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:52.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:52.139 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-03-16T22:46:52.411 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:52.415 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:52.416 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:52.417 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:52.417 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:52.829 INFO:teuthology.orchestra.run.smithi132.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-03-16T22:46:52.834 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/596 2024-03-16T22:46:52.834 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/596 2024-03-16T22:46:52.834 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:52.837 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:52.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:52.878 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-03-16T22:46:53.149 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:53.154 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:53.155 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:53.155 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:53.155 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:54.064 INFO:teuthology.orchestra.run.smithi132.stdout:generic/597 1s 2024-03-16T22:46:54.073 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/597 2024-03-16T22:46:54.073 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:54.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:54.132 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-03-16T22:46:54.595 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:54.601 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:54.601 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:54.603 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:54.603 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:55.513 INFO:teuthology.orchestra.run.smithi132.stdout:generic/598 1s 2024-03-16T22:46:55.520 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/598 2024-03-16T22:46:55.520 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:55.523 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:55.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:55.589 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-03-16T22:46:56.047 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:56.051 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:56.052 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:56.053 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:56.053 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:56.458 INFO:teuthology.orchestra.run.smithi132.stdout:generic/599 [not run] ceph does not support shutdown 2024-03-16T22:46:56.471 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/599 2024-03-16T22:46:56.472 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/599 2024-03-16T22:46:56.472 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:56.475 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:56.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:56.495 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-03-16T22:46:56.757 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:56.762 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:56.763 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:56.763 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:56.764 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:57.073 INFO:teuthology.orchestra.run.smithi132.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T22:46:57.077 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/600 2024-03-16T22:46:57.077 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/600 2024-03-16T22:46:57.077 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:57.079 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:57.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:57.100 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-03-16T22:46:57.367 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:57.372 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:57.373 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:57.374 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:57.374 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:57.659 INFO:teuthology.orchestra.run.smithi132.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T22:46:57.664 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/601 2024-03-16T22:46:57.665 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/601 2024-03-16T22:46:57.665 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:57.668 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:57.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:57.689 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-03-16T22:46:57.954 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:57.959 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:57.959 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:57.961 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:57.961 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:58.459 INFO:teuthology.orchestra.run.smithi132.stdout:generic/602 [not run] kernel does not support ceph encryption 2024-03-16T22:46:58.473 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/602 2024-03-16T22:46:58.473 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/602 2024-03-16T22:46:58.473 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:58.478 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:58.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:58.497 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-03-16T22:46:58.795 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:58.801 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:58.801 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:58.803 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:58.803 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:59.106 INFO:teuthology.orchestra.run.smithi132.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-16T22:46:59.112 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/603 2024-03-16T22:46:59.112 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/603 2024-03-16T22:46:59.112 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:46:59.116 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:46:59.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:46:59.143 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-03-16T22:46:59.400 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:46:59.405 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:46:59.405 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:46:59.408 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:46:59.408 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:01.105 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:47:01.109 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:47:03.231 INFO:teuthology.orchestra.run.smithi132.stdout:generic/604 4s 2024-03-16T22:47:03.241 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/604 2024-03-16T22:47:03.241 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:03.247 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:03.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:03.265 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-03-16T22:47:03.547 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:03.551 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:03.551 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:03.552 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:03.552 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:05.332 INFO:teuthology.orchestra.run.smithi132.stdout:generic/605 [not run] mount 172.21.15.132:6789:/scratch with dax=always failed 2024-03-16T22:47:05.337 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/605 2024-03-16T22:47:05.337 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/605 2024-03-16T22:47:05.337 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:05.341 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:05.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:05.363 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-03-16T22:47:05.644 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:05.649 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:05.649 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:05.650 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:05.650 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:06.104 INFO:teuthology.orchestra.run.smithi132.stdout:generic/606 [not run] mount 172.21.15.132:6789:/scratch with dax=always failed 2024-03-16T22:47:06.111 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/606 2024-03-16T22:47:06.112 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/606 2024-03-16T22:47:06.112 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:06.115 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:06.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:06.139 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-03-16T22:47:06.393 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:06.400 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:06.402 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:06.403 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:06.403 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:06.755 INFO:teuthology.orchestra.run.smithi132.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2024-03-16T22:47:06.761 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/607 2024-03-16T22:47:06.761 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/607 2024-03-16T22:47:06.761 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:06.764 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:06.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:06.811 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-03-16T22:47:07.280 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:07.286 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:07.286 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:07.288 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:07.288 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:07.714 INFO:teuthology.orchestra.run.smithi132.stdout:generic/608 [not run] mount 172.21.15.132:6789:/scratch with dax=always failed 2024-03-16T22:47:07.720 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/608 2024-03-16T22:47:07.720 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/608 2024-03-16T22:47:07.720 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:07.725 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:07.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:07.747 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-03-16T22:47:08.039 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:08.044 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:08.048 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:08.049 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:08.050 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:08.663 INFO:teuthology.orchestra.run.smithi132.stdout:generic/609 0s 2024-03-16T22:47:08.671 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/609 2024-03-16T22:47:08.671 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:08.675 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:08.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:08.722 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-03-16T22:47:09.183 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:09.189 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:09.191 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:09.191 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:09.639 INFO:teuthology.orchestra.run.smithi132.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-16T22:47:09.644 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/610 2024-03-16T22:47:09.644 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/610 2024-03-16T22:47:09.645 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:09.647 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:09.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:09.681 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-03-16T22:47:09.936 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:09.940 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:09.941 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:09.942 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:09.942 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:10.578 INFO:teuthology.orchestra.run.smithi132.stdout:generic/611 0s 2024-03-16T22:47:10.587 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/611 2024-03-16T22:47:10.587 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:10.590 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:10.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:10.602 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-03-16T22:47:10.879 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:10.884 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:10.885 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:10.886 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:10.886 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:11.272 INFO:teuthology.orchestra.run.smithi132.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T22:47:11.278 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/612 2024-03-16T22:47:11.278 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/612 2024-03-16T22:47:11.278 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:11.280 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:11.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:11.347 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-03-16T22:47:11.775 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:11.781 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:11.782 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:11.784 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:11.784 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:12.245 INFO:teuthology.orchestra.run.smithi132.stdout:generic/613 [not run] kernel does not support ceph encryption 2024-03-16T22:47:12.267 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/613 2024-03-16T22:47:12.267 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/613 2024-03-16T22:47:12.267 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:12.270 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:12.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:12.289 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-03-16T22:47:12.561 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:12.568 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:12.569 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:12.570 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:12.570 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:13.277 INFO:teuthology.orchestra.run.smithi132.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2024-03-16T22:47:13.306 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/614 2024-03-16T22:47:13.306 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/614 2024-03-16T22:47:13.306 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:47:13.309 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:13.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:47:13.338 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-03-16T22:47:13.649 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:47:13.655 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:47:13.656 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:47:13.657 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:47:13.657 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:47:31.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:47:31.183 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:48:01.258 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:48:01.262 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:48:11.013 INFO:teuthology.orchestra.run.smithi132.stdout:generic/615 57s 2024-03-16T22:48:11.019 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/615 2024-03-16T22:48:11.019 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:11.023 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:11.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:11.033 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-03-16T22:48:11.290 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:11.295 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:11.296 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:11.298 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:11.298 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:11.610 INFO:teuthology.orchestra.run.smithi132.stdout:generic/616 [not run] kernel does not support IO_URING 2024-03-16T22:48:11.616 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/616 2024-03-16T22:48:11.616 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/616 2024-03-16T22:48:11.616 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:11.619 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:11.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:11.635 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-03-16T22:48:11.902 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:11.906 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:11.907 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:11.908 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:11.908 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:12.283 INFO:teuthology.orchestra.run.smithi132.stdout:generic/617 [not run] kernel does not support IO_URING 2024-03-16T22:48:12.288 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/617 2024-03-16T22:48:12.288 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/617 2024-03-16T22:48:12.288 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:12.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:12.311 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-03-16T22:48:12.564 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:12.569 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:12.569 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:12.571 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:12.571 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:13.174 INFO:teuthology.orchestra.run.smithi132.stdout:generic/618 1s 2024-03-16T22:48:13.183 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/618 2024-03-16T22:48:13.183 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:13.187 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:13.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:13.199 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-03-16T22:48:13.448 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:13.454 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:13.454 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:13.456 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:13.770 INFO:teuthology.orchestra.run.smithi132.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-16T22:48:13.775 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/619 2024-03-16T22:48:13.775 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/619 2024-03-16T22:48:13.775 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:13.778 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:13.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:13.805 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-03-16T22:48:14.062 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:14.067 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:14.067 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:14.069 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:14.069 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:14.417 INFO:teuthology.orchestra.run.smithi132.stdout:generic/620 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:48:14.422 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/620 2024-03-16T22:48:14.422 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/620 2024-03-16T22:48:14.422 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:14.425 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:14.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:14.448 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-03-16T22:48:14.725 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:14.730 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:14.731 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:14.732 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:14.732 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:15.213 INFO:teuthology.orchestra.run.smithi132.stdout:generic/621 [not run] kernel does not support ceph encryption 2024-03-16T22:48:15.227 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/621 2024-03-16T22:48:15.227 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/621 2024-03-16T22:48:15.227 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:15.229 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:15.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:15.250 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-03-16T22:48:15.502 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:15.507 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:15.507 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:15.509 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:15.509 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:15.931 INFO:teuthology.orchestra.run.smithi132.stdout:generic/622 [not run] ceph does not support shutdown 2024-03-16T22:48:15.946 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/622 2024-03-16T22:48:15.946 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/622 2024-03-16T22:48:15.946 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:15.949 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:15.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:15.968 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-03-16T22:48:16.242 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:16.248 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:16.249 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:16.250 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:16.250 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:16.677 INFO:teuthology.orchestra.run.smithi132.stdout:generic/623 [not run] ceph does not support shutdown 2024-03-16T22:48:16.690 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/623 2024-03-16T22:48:16.691 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/623 2024-03-16T22:48:16.691 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:16.696 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:16.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:16.717 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-03-16T22:48:16.979 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:16.985 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:16.986 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:16.987 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:16.987 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:17.300 INFO:teuthology.orchestra.run.smithi132.stdout:generic/624 [not run] fsverity utility required, skipped this test 2024-03-16T22:48:17.305 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/624 2024-03-16T22:48:17.305 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/624 2024-03-16T22:48:17.305 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:17.308 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:17.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:17.327 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-03-16T22:48:17.595 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:17.600 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:17.601 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:17.601 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:17.602 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:17.893 INFO:teuthology.orchestra.run.smithi132.stdout:generic/625 [not run] fsverity utility required, skipped this test 2024-03-16T22:48:17.899 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/625 2024-03-16T22:48:17.899 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/625 2024-03-16T22:48:17.899 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:17.902 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:17.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:17.923 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-03-16T22:48:18.215 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:18.219 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:18.220 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:18.221 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:18.221 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:18.772 INFO:teuthology.orchestra.run.smithi132.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2024-03-16T22:48:18.777 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/626 2024-03-16T22:48:18.777 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/626 2024-03-16T22:48:18.777 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:18.780 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:18.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:18.821 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-03-16T22:48:19.331 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:19.336 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:19.337 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:19.338 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:19.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:19.745 INFO:teuthology.orchestra.run.smithi132.stdout:generic/627 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:48:19.750 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/627 2024-03-16T22:48:19.750 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/627 2024-03-16T22:48:19.750 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:19.753 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:19.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:19.780 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-03-16T22:48:20.044 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:20.049 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:20.049 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:20.050 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:20.050 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:20.610 INFO:teuthology.orchestra.run.smithi132.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T22:48:20.621 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/628 2024-03-16T22:48:20.621 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/628 2024-03-16T22:48:20.621 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:20.623 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:20.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:20.891 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-03-16T22:48:21.196 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:21.203 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:21.203 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:21.204 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:21.205 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:21.531 INFO:teuthology.orchestra.run.smithi132.stdout:generic/629 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:48:21.536 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/629 2024-03-16T22:48:21.536 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/629 2024-03-16T22:48:21.536 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:21.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:21.560 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-03-16T22:48:21.835 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:21.840 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:21.840 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:21.842 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:21.842 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:22.287 INFO:teuthology.orchestra.run.smithi132.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-16T22:48:22.350 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/630 2024-03-16T22:48:22.350 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/630 2024-03-16T22:48:22.350 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:22.354 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:22.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:22.728 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-03-16T22:48:23.015 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:23.019 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:23.019 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:23.020 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:23.021 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:31.545 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:48:31.549 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:48:54.039 INFO:teuthology.orchestra.run.smithi132.stdout:generic/631 - output mismatch (see /tmp/tmp.elA9P9Bv3mxfstests-dev/results//generic/631.out.bad) 2024-03-16T22:48:54.048 INFO:teuthology.orchestra.run.smithi132.stdout: --- tests/generic/631.out 2024-03-16 17:48:54.248713602 +0000 2024-03-16T22:48:54.048 INFO:teuthology.orchestra.run.smithi132.stdout: +++ /tmp/tmp.elA9P9Bv3mxfstests-dev/results//generic/631.out.bad 2024-03-16 22:48:54.011327850 +0000 2024-03-16T22:48:54.048 INFO:teuthology.orchestra.run.smithi132.stdout: @@ -1,2 +1,4178 @@ 2024-03-16T22:48:54.048 INFO:teuthology.orchestra.run.smithi132.stdout: QA output created by 631 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.049 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.050 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.051 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +: No such file or directory 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.052 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.053 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.054 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.055 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.056 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +/tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.057 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.058 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.059 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.060 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.061 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.062 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.063 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.064 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.065 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.066 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +/tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.067 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.068 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.069 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.071 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.072 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted./tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.073 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.076 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: mv: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.077 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.078 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.079 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.080 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.081 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.083 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.084 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.085 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.086 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.087 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.088 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.089 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted./tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.090 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.091 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.092 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.093 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.094 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.095 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.096 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.097 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.098 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.099 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.100 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.101 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +/tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.103 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +: No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.104 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.105 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.106 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.107 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.108 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.109 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.110 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.111 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.111 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.111 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.111 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.111 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.111 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.111 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-16T22:48:54.122 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.122 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.122 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.122 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.122 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.122 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.122 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.122 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.122 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: touch: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +: No such file or directory 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.123 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.124 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.125 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.126 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.127 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.128 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.129 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +: No such file or directory 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.130 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.131 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.132 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.133 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.134 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.135 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted./tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.136 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.137 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.138 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.139 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.140 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.141 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.142 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.143 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.144 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.145 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.146 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.147 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted.mv: 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.148 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.149 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.150 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.151 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.152 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.153 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.154 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.155 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.156 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.157 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.158 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.160 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted./tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.161 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.163 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.164 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.166 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: mv: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +: No such file or directory 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.167 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.168 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.169 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.170 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.171 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.172 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.173 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.174 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.175 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.176 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directorymv: 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf'touch: : No such file or directory 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.177 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf' 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +: No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.178 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: mount: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf'/tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.: No such file or directory 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.179 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.181 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.182 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.183 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.184 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.185 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.186 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.187 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.188 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.189 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.190 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.191 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.192 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.193 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.195 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.196 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.197 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.198 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +/tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.199 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.201 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.202 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.203 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.204 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.205 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.206 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.207 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.208 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.umount: 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +/tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.209 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.210 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.212 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.213 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.214 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.215 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.216 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.217 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.218 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.220 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.221 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.222 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.223 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: +/tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.224 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.225 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted./tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.226 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.227 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.228 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.229 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.230 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.231 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.232 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.233 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.234 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.235 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.236 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted./tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.237 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: touch: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf' 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +: No such file or directory 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.238 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.239 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.240 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.241 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.242 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.243 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.244 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.245 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.246 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted./tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.247 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.248 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.249 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.250 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.251 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.252 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.253 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.255 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.256 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.257 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.258 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.259 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.260 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.261 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.262 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.263 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.264 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted./tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.265 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.266 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.267 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: umount: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf'/tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +: No such file or directory 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.268 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.270 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.271 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.272 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.273 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.274 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.275 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.276 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.277 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.278 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.279 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.280 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.281 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: umount: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf'/tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted.: No such file or directory 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.282 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.283 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf'mount: : No such file or directory/tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.284 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.285 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.287 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.288 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.289 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.290 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.291 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.292 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.293 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.294 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.295 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.296 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.297 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.298 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.299 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.300 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.301 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.302 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.303 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.304 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.305 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.306 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.307 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.308 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.309 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.310 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.311 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.312 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.313 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.315 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.316 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.317 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.318 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.319 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.320 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: umount: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf'/tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted.: No such file or directory 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.321 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.322 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.323 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.324 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +: No such file or directory 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.325 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted./tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.326 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.327 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.328 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.329 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.330 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.331 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.332 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: mv: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directorycannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf' 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +: No such file or directory 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.333 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.334 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.335 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.336 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.337 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.338 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.339 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.340 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.341 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.342 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.343 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.344 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.345 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: + 2024-03-16T22:48:54.346 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.348 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.349 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.350 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.351 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.352 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged2/etc/access.conf': No such file or directory 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged2: not mounted. 2024-03-16T22:48:54.353 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged5/etc/access.conf': No such file or directory 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged5: not mounted. 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged1/etc/access.conf': No such file or directory 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged1: not mounted. 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged4/etc/access.conf': No such file or directory 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged3/etc/access.conf': No such file or directory 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged3: not mounted. 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +mount: /tmp/tmp.ZUDwMxKonOscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged4: not mounted. 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +mv: cannot stat '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: +touch: cannot touch '/tmp/tmp.ZUDwMxKonOscratch/merged0/etc/access.conf': No such file or directory 2024-03-16T22:48:54.356 INFO:teuthology.orchestra.run.smithi132.stdout: +umount: /tmp/tmp.ZUDwMxKonOscratch/merged0: not mounted. 2024-03-16T22:48:54.356 INFO:teuthology.orchestra.run.smithi132.stdout: Silence is golden. 2024-03-16T22:48:54.356 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:54.356 INFO:teuthology.orchestra.run.smithi132.stdout:HINT: You _MAY_ be missing kernel fix: 2024-03-16T22:48:54.356 INFO:teuthology.orchestra.run.smithi132.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2024-03-16T22:48:54.356 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:54.356 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/631 2024-03-16T22:48:54.356 INFO:teuthology.orchestra.run.smithi132.stdout:Failures: generic/631 2024-03-16T22:48:54.356 INFO:teuthology.orchestra.run.smithi132.stdout:Failed 1 of 1 tests 2024-03-16T22:48:54.356 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:54.356 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-16T22:48:54.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-16T22:48:54.357 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-03-16T22:48:54.611 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:54.615 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:54.615 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:54.616 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:54.616 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:55.741 INFO:teuthology.orchestra.run.smithi132.stdout:generic/632 1s 2024-03-16T22:48:55.749 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/632 2024-03-16T22:48:55.750 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:55.752 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:55.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:55.782 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-03-16T22:48:56.053 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:56.059 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:56.060 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:56.061 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:56.061 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:57.080 INFO:teuthology.orchestra.run.smithi132.stdout:generic/633 1s 2024-03-16T22:48:57.087 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/633 2024-03-16T22:48:57.088 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:57.091 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:57.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:57.161 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-03-16T22:48:57.624 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:57.632 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:57.632 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:57.633 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:57.633 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:58.827 INFO:teuthology.orchestra.run.smithi132.stdout:generic/634 1s 2024-03-16T22:48:58.891 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/634 2024-03-16T22:48:58.892 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:58.894 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:58.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:58.904 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-03-16T22:48:59.169 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:59.177 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:59.177 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:59.179 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:59.179 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:59.606 INFO:teuthology.orchestra.run.smithi132.stdout:generic/635 [not run] ceph does not support shutdown 2024-03-16T22:48:59.622 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/635 2024-03-16T22:48:59.622 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/635 2024-03-16T22:48:59.622 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:48:59.626 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:48:59.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:48:59.648 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-03-16T22:48:59.912 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:48:59.920 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:48:59.920 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:48:59.922 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:48:59.922 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:00.410 INFO:teuthology.orchestra.run.smithi132.stdout:generic/636 [not run] swapfiles are not supported 2024-03-16T22:49:00.415 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/636 2024-03-16T22:49:00.415 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/636 2024-03-16T22:49:00.415 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:49:00.418 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:00.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:49:00.443 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-03-16T22:49:00.706 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:49:00.711 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:49:00.712 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:49:00.713 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:49:00.713 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:01.478 INFO:teuthology.orchestra.run.smithi132.stdout:generic/637 1s 2024-03-16T22:49:01.485 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/637 2024-03-16T22:49:01.485 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:49:01.488 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:01.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:49:01.648 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:49:01.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:49:01.753 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-03-16T22:49:02.143 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:49:02.149 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:49:02.149 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:49:02.150 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:49:02.151 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:02.518 INFO:teuthology.orchestra.run.smithi132.stdout:generic/638 0s 2024-03-16T22:49:02.525 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/638 2024-03-16T22:49:02.525 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:49:02.528 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:02.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:49:02.570 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-03-16T22:49:02.822 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:49:02.827 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:49:02.828 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:49:02.829 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:49:02.829 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:03.287 INFO:teuthology.orchestra.run.smithi132.stdout:generic/639 1s 2024-03-16T22:49:03.294 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/639 2024-03-16T22:49:03.294 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:49:03.297 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:03.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:49:03.336 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-03-16T22:49:03.583 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:49:03.587 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:49:03.588 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:49:03.589 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:49:03.589 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:03.905 INFO:teuthology.orchestra.run.smithi132.stdout:generic/640 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-16T22:49:03.910 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/640 2024-03-16T22:49:03.910 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/640 2024-03-16T22:49:03.910 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:49:03.913 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:03.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:49:03.933 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-03-16T22:49:04.210 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:49:04.216 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:49:04.216 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:49:04.218 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:49:04.218 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:04.718 INFO:teuthology.orchestra.run.smithi132.stdout:generic/641 [not run] swapfiles are not supported 2024-03-16T22:49:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/641 2024-03-16T22:49:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/641 2024-03-16T22:49:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T22:49:04.730 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:04.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T22:49:04.756 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-03-16T22:49:05.017 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T22:49:05.022 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T22:49:05.023 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T22:49:05.024 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T22:49:05.024 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T22:49:31.732 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:49:31.734 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:50:01.871 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:50:01.874 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:50:31.950 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:50:31.952 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:51:02.065 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:51:02.068 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:51:32.154 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:51:32.157 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:52:02.572 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:52:02.576 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:52:32.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:52:32.665 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:52:32.862 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T22:52:32.859+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 701693) UID: 0 2024-03-16T22:52:32.862 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T22:52:32.859+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 701693) UID: 0 2024-03-16T22:56:14.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:56:14.894 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:56:45.317 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:56:45.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:57:15.401 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:57:15.404 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:57:45.556 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:57:45.560 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T22:57:45.608 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T22:57:45.606+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 701785) UID: 0 2024-03-16T22:57:45.609 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T22:57:45.606+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 701785) UID: 0 2024-03-16T23:00:56.909 INFO:teuthology.orchestra.run.smithi132.stdout:generic/642 711s 2024-03-16T23:00:56.952 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/642 2024-03-16T23:00:56.952 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T23:00:56.954 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:00:56.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T23:00:56.971 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-03-16T23:00:58.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:00:58.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:01:00.770 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T23:01:00.775 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T23:01:00.776 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T23:01:00.778 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T23:01:00.778 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:01:29.031 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:01:29.034 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:01:59.117 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:01:59.119 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:01:59.182 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T23:01:59.180+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54576) UID: 0 2024-03-16T23:01:59.183 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T23:01:59.180+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54576) UID: 0 2024-03-16T23:01:59.183 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T23:01:59.180+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54576) UID: 0 2024-03-16T23:01:59.183 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T23:01:59.180+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54576) UID: 0 2024-03-16T23:04:15.213 INFO:teuthology.orchestra.run.smithi132.stdout:generic/643 [not run] swapfiles are not supported 2024-03-16T23:04:15.217 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/643 2024-03-16T23:04:15.217 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/643 2024-03-16T23:04:15.217 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T23:04:15.219 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:15.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T23:04:15.238 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-03-16T23:04:15.423 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T23:04:15.427 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T23:04:15.427 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T23:04:15.428 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T23:04:15.428 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:16.396 INFO:teuthology.orchestra.run.smithi132.stdout:generic/644 [not run] vfstest not support by ceph 2024-03-16T23:04:16.400 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/644 2024-03-16T23:04:16.400 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/644 2024-03-16T23:04:16.400 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T23:04:16.403 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:16.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T23:04:16.425 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-03-16T23:04:16.622 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T23:04:16.625 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T23:04:16.626 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T23:04:16.627 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T23:04:16.627 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:16.834 INFO:teuthology.orchestra.run.smithi132.stdout:generic/645 [not run] vfstest not support by ceph 2024-03-16T23:04:16.837 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/645 2024-03-16T23:04:16.837 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/645 2024-03-16T23:04:16.838 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T23:04:16.840 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:16.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T23:04:16.857 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-03-16T23:04:17.046 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T23:04:17.050 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T23:04:17.050 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T23:04:17.051 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T23:04:17.051 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:17.346 INFO:teuthology.orchestra.run.smithi132.stdout:generic/646 [not run] ceph does not support shutdown 2024-03-16T23:04:17.358 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/646 2024-03-16T23:04:17.358 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/646 2024-03-16T23:04:17.358 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T23:04:17.360 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:17.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T23:04:17.376 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-03-16T23:04:17.553 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T23:04:17.557 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T23:04:17.558 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T23:04:17.559 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T23:04:17.559 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:18.000 INFO:teuthology.orchestra.run.smithi132.stdout:generic/647 0s 2024-03-16T23:04:18.005 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/647 2024-03-16T23:04:18.006 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T23:04:18.008 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:18.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T23:04:18.062 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-03-16T23:04:18.464 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T23:04:18.469 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T23:04:18.470 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T23:04:18.472 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T23:04:18.472 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:18.921 INFO:teuthology.orchestra.run.smithi132.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-16T23:04:18.931 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/648 2024-03-16T23:04:18.931 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/648 2024-03-16T23:04:18.932 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T23:04:18.934 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:19.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T23:04:19.155 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-03-16T23:04:19.405 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T23:04:19.409 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T23:04:19.409 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T23:04:19.410 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T23:04:19.410 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:19.675 INFO:teuthology.orchestra.run.smithi132.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2024-03-16T23:04:19.679 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/649 2024-03-16T23:04:19.679 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/649 2024-03-16T23:04:19.679 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-16T23:04:19.681 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:19.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-16T23:04:19.743 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-03-16T23:04:20.173 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-16T23:04:20.180 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-16T23:04:20.180 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-16T23:04:20.181 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-16T23:04:20.181 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-16T23:04:29.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:04:29.638 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:04:29.719 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T23:04:29.717+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 705591) UID: 0 2024-03-16T23:04:29.720 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T23:04:29.717+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 705591) UID: 0 2024-03-16T23:11:14.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:11:14.796 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:11:14.828 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T23:11:14.826+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54623) UID: 0 2024-03-16T23:11:14.828 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T23:11:14.826+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54623) UID: 0 2024-03-16T23:11:14.829 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T23:11:14.826+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54623) UID: 0 2024-03-16T23:11:14.829 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T23:11:14.826+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54623) UID: 0 2024-03-16T23:14:00.256 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:14:00.260 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:14:30.429 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:14:30.433 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:15:00.626 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:15:00.635 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:15:30.778 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:15:30.781 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:16:00.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:16:00.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:16:31.048 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:16:31.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:17:01.205 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:17:01.210 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:17:31.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:17:31.548 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:17:31.610 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T23:17:31.604+0000 7f77b3cf3640 -1 Fail to open '/proc/54773/cmdline' error = (2) No such file or directory 2024-03-16T23:17:31.610 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T23:17:31.604+0000 7f77b3cf3640 -1 received signal: Hangup from (PID: 54773) UID: 0 2024-03-16T23:17:31.611 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T23:17:31.604+0000 7fdcbc10c640 -1 Fail to open '/proc/54773/cmdline' error = (2) No such file or directory 2024-03-16T23:17:31.611 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T23:17:31.604+0000 7fdcbc10c640 -1 received signal: Hangup from (PID: 54773) UID: 0 2024-03-16T23:17:31.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T23:17:31.604+0000 7fbaf41b9640 -1 Fail to open '/proc/54773/cmdline' error = (2) No such file or directory 2024-03-16T23:17:31.611 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T23:17:31.604+0000 7fbaf41b9640 -1 received signal: Hangup from (PID: 54773) UID: 0 2024-03-16T23:17:31.612 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T23:17:31.606+0000 7ff3012c0640 -1 Fail to open '/proc/54773/cmdline' error = (2) No such file or directory 2024-03-16T23:17:31.612 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T23:17:31.606+0000 7ff3012c0640 -1 received signal: Hangup from (PID: 54773) UID: 0 2024-03-16T23:20:11.608 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:20:11.612 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:20:41.788 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:20:41.796 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:21:11.943 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:21:11.946 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:21:42.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:21:42.227 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:22:12.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:22:12.340 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:22:42.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:22:42.475 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:23:12.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:23:12.597 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:23:42.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:23:42.828 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:24:12.994 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:24:13.002 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:24:43.143 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:24:43.148 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:25:13.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:25:13.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:25:43.621 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:25:43.625 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:26:13.828 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:26:13.832 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:26:43.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:26:43.988 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:27:14.089 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:27:14.092 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:27:44.473 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:27:44.476 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:28:14.637 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:28:14.641 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:28:44.807 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:28:44.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:29:15.053 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:29:15.057 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:29:45.208 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:29:45.219 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:30:15.334 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:30:15.338 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:30:45.474 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:30:45.478 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:31:15.636 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:31:15.639 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:31:15.804 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T23:31:15.803+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 709624) UID: 0 2024-03-16T23:31:15.805 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T23:31:15.803+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 709624) UID: 0 2024-03-16T23:31:15.806 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T23:31:15.805+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 709624) UID: 0 2024-03-16T23:31:15.813 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T23:31:15.805+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 709624) UID: 0 2024-03-16T23:36:07.174 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:36:07.178 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:36:37.493 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:36:37.496 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:37:07.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:37:07.688 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:37:37.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:37:37.894 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:38:08.009 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:38:08.013 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:38:38.225 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:38:38.229 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:39:08.522 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:39:08.526 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:39:38.642 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:39:38.645 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:40:08.802 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:40:08.806 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:40:39.358 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:40:39.362 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:41:09.525 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:41:09.529 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:41:39.707 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:41:39.712 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:42:09.816 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:42:09.819 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:42:39.956 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:42:39.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:43:10.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:43:10.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:43:40.308 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:43:40.313 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:44:10.427 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:44:10.431 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:44:40.585 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:44:40.589 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:45:10.737 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:45:10.740 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:45:40.963 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:45:40.966 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:46:11.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:46:11.114 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:46:11.146 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-16T23:46:11.148+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55614) UID: 0 2024-03-16T23:46:11.147 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-16T23:46:11.148+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55614) UID: 0 2024-03-16T23:46:11.147 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-16T23:46:11.148+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55614) UID: 0 2024-03-16T23:46:11.147 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-16T23:46:11.148+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55614) UID: 0 2024-03-16T23:48:51.018 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:48:51.022 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:49:21.319 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:49:21.323 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:49:51.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:49:51.438 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:50:21.561 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:50:21.565 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:50:51.973 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:50:51.977 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:50:52.109 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-16T23:50:52.111+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 712653) UID: 0 2024-03-16T23:50:52.109 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-16T23:50:52.111+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 712653) UID: 0 2024-03-16T23:50:52.113 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-16T23:50:52.112+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 712653) UID: 0 2024-03-16T23:50:52.119 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-16T23:50:52.111+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 712653) UID: 0 2024-03-16T23:55:49.471 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:55:49.475 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:56:19.682 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:56:19.686 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-16T23:56:19.790 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-16T23:56:19.792+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 713379) UID: 0 2024-03-16T23:56:19.790 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-16T23:56:19.793+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 713379) UID: 0 2024-03-17T00:02:05.075 INFO:teuthology.orchestra.run.smithi132.stdout:generic/650 3465s 2024-03-17T00:02:05.136 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/650 2024-03-17T00:02:05.136 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:05.142 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:05.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:05.238 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-03-17T00:02:06.367 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:06.379 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:06.381 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:06.385 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:06.385 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:07.744 INFO:teuthology.orchestra.run.smithi132.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:07.770 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/651 2024-03-17T00:02:07.770 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/651 2024-03-17T00:02:07.770 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:07.780 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:07.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:07.882 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-03-17T00:02:08.773 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:08.789 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:08.790 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:08.795 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:08.795 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:10.005 INFO:teuthology.orchestra.run.smithi132.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:10.019 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/652 2024-03-17T00:02:10.020 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/652 2024-03-17T00:02:10.020 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:10.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:10.164 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-03-17T00:02:10.956 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:10.968 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:10.969 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:10.971 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:10.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:12.283 INFO:teuthology.orchestra.run.smithi132.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:12.295 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/653 2024-03-17T00:02:12.295 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/653 2024-03-17T00:02:12.298 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:12.308 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:12.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:12.375 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-03-17T00:02:13.153 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:13.169 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:13.169 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:13.172 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:13.172 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:14.473 INFO:teuthology.orchestra.run.smithi132.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:14.486 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/654 2024-03-17T00:02:14.486 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/654 2024-03-17T00:02:14.486 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:14.496 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:14.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:14.656 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-03-17T00:02:15.477 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:15.496 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:15.498 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:15.502 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:15.502 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:16.569 INFO:teuthology.orchestra.run.smithi132.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:16.585 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/655 2024-03-17T00:02:16.585 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/655 2024-03-17T00:02:16.586 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:16.600 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:16.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:16.740 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-03-17T00:02:17.444 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:17.456 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:17.457 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:17.460 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:17.460 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:18.259 INFO:teuthology.orchestra.run.smithi132.stdout:generic/656 [not run] vfstest not support by ceph 2024-03-17T00:02:18.281 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/656 2024-03-17T00:02:18.285 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/656 2024-03-17T00:02:18.285 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:18.295 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:18.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:18.327 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-03-17T00:02:19.062 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:19.077 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:19.079 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:19.082 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:19.082 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:20.263 INFO:teuthology.orchestra.run.smithi132.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:20.270 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/657 2024-03-17T00:02:20.270 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/657 2024-03-17T00:02:20.271 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:20.278 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:20.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:20.493 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-03-17T00:02:21.352 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:21.366 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:21.367 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:21.369 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:21.370 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:22.507 INFO:teuthology.orchestra.run.smithi132.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:22.517 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/658 2024-03-17T00:02:22.517 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/658 2024-03-17T00:02:22.517 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:22.523 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:22.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:22.656 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-03-17T00:02:23.349 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:23.363 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:23.364 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:23.367 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:23.367 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:24.509 INFO:teuthology.orchestra.run.smithi132.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:24.525 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/659 2024-03-17T00:02:24.525 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/659 2024-03-17T00:02:24.525 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:24.534 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:24.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:24.620 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-03-17T00:02:25.422 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:25.430 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:25.430 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:25.432 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:25.432 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:26.532 INFO:teuthology.orchestra.run.smithi132.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:26.546 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/660 2024-03-17T00:02:26.546 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/660 2024-03-17T00:02:26.547 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:26.556 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:26.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:26.676 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-03-17T00:02:27.411 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:27.429 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:27.430 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:27.434 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:27.434 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:28.609 INFO:teuthology.orchestra.run.smithi132.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:28.623 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/661 2024-03-17T00:02:28.623 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/661 2024-03-17T00:02:28.623 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:28.635 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:28.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:28.717 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-03-17T00:02:29.408 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:29.420 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:29.421 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:29.425 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:29.425 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:30.523 INFO:teuthology.orchestra.run.smithi132.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:30.540 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/662 2024-03-17T00:02:30.540 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/662 2024-03-17T00:02:30.540 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:30.553 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:30.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:30.746 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-03-17T00:02:31.579 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:31.597 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:31.599 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:31.602 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:31.602 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:32.754 INFO:teuthology.orchestra.run.smithi132.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:32.762 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/663 2024-03-17T00:02:32.762 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/663 2024-03-17T00:02:32.762 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:32.765 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:32.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:32.905 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-03-17T00:02:33.511 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:33.539 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:33.541 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:33.550 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:34.688 INFO:teuthology.orchestra.run.smithi132.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/664 2024-03-17T00:02:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/664 2024-03-17T00:02:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:34.721 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:34.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:34.802 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-03-17T00:02:35.451 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:35.466 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:35.469 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:35.472 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:35.472 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:36.571 INFO:teuthology.orchestra.run.smithi132.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:36.584 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/665 2024-03-17T00:02:36.585 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/665 2024-03-17T00:02:36.585 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:36.596 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:36.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:36.700 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-03-17T00:02:37.480 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:37.494 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:37.496 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:37.498 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:37.498 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:38.672 INFO:teuthology.orchestra.run.smithi132.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:38.686 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/666 2024-03-17T00:02:38.686 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/666 2024-03-17T00:02:38.686 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:38.696 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:38.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:38.786 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-03-17T00:02:39.576 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:39.582 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:39.582 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:39.588 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:40.694 INFO:teuthology.orchestra.run.smithi132.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:40.730 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/667 2024-03-17T00:02:40.732 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/667 2024-03-17T00:02:40.732 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:40.767 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:40.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:40.812 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-03-17T00:02:41.558 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:41.574 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:41.576 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:41.580 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:41.580 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:42.801 INFO:teuthology.orchestra.run.smithi132.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:42.815 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/668 2024-03-17T00:02:42.815 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/668 2024-03-17T00:02:42.815 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:42.825 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:42.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:42.934 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-03-17T00:02:43.863 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:43.877 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:43.878 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:43.881 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:43.882 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:45.031 INFO:teuthology.orchestra.run.smithi132.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:45.039 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/669 2024-03-17T00:02:45.040 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/669 2024-03-17T00:02:45.040 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:45.046 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:45.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:45.125 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-03-17T00:02:45.687 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:45.706 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:45.709 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:45.717 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:45.717 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:46.889 INFO:teuthology.orchestra.run.smithi132.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:46.905 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/670 2024-03-17T00:02:46.906 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/670 2024-03-17T00:02:46.906 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:46.916 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:47.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:47.065 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-03-17T00:02:47.897 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:47.918 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:47.919 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:47.923 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:47.923 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:49.154 INFO:teuthology.orchestra.run.smithi132.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:49.169 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/671 2024-03-17T00:02:49.169 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/671 2024-03-17T00:02:49.169 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:49.184 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:49.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:49.332 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-03-17T00:02:50.133 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:50.150 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:50.151 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:50.156 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:50.156 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:51.295 INFO:teuthology.orchestra.run.smithi132.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:51.311 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/672 2024-03-17T00:02:51.312 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/672 2024-03-17T00:02:51.312 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:51.322 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:51.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:51.462 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-03-17T00:02:52.340 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:52.353 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:52.353 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:52.359 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:54.058 INFO:teuthology.orchestra.run.smithi132.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:54.076 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/673 2024-03-17T00:02:54.076 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/673 2024-03-17T00:02:54.077 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:54.082 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:54.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:54.208 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-03-17T00:02:54.988 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:55.002 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:55.004 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:55.008 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:55.008 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:56.039 INFO:teuthology.orchestra.run.smithi132.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-17T00:02:56.212 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/674 2024-03-17T00:02:56.212 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/674 2024-03-17T00:02:56.212 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:56.215 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:56.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:56.311 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-03-17T00:02:57.108 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:57.121 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:57.123 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:57.126 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:57.126 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:58.428 INFO:teuthology.orchestra.run.smithi132.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:02:58.442 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/675 2024-03-17T00:02:58.443 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/675 2024-03-17T00:02:58.443 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:02:58.454 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:02:58.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:02:58.555 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-03-17T00:02:59.385 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:02:59.405 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:02:59.407 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:02:59.410 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:02:59.410 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:03:29.889 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-17T00:03:29.889+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 725997) UID: 0 2024-03-17T00:03:29.890 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-17T00:03:29.889+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 725997) UID: 0 2024-03-17T00:03:29.890 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-17T00:03:29.890+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 725997) UID: 0 2024-03-17T00:03:29.893 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-17T00:03:29.890+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 725997) UID: 0 2024-03-17T00:11:17.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T00:11:17.219 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T00:11:17.545 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-17T00:11:17.545+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 726073) UID: 0 2024-03-17T00:11:17.548 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-17T00:11:17.545+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 726073) UID: 0 2024-03-17T00:24:18.390 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-17T00:24:18.388+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 726081) UID: 0 2024-03-17T00:24:18.390 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-17T00:24:18.388+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 726081) UID: 0 2024-03-17T00:24:18.390 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-17T00:24:18.388+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 726081) UID: 0 2024-03-17T00:24:18.391 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-17T00:24:18.391+0000 7fc9fd2d4640 -1 Fail to open '/proc/726081/cmdline' error = (2) No such file or directory 2024-03-17T00:24:18.392 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-17T00:24:18.391+0000 7fc9fd2d4640 -1 received signal: Hangup from (PID: 726081) UID: 0 2024-03-17T00:27:27.960 INFO:teuthology.orchestra.run.smithi132.stdout:generic/676 1468s 2024-03-17T00:27:28.075 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/676 2024-03-17T00:27:28.075 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:28.079 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:28.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:28.434 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-03-17T00:27:30.079 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:30.084 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:30.086 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:30.089 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:30.089 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:31.088 INFO:teuthology.orchestra.run.smithi132.stdout:generic/677 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-17T00:27:31.098 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/677 2024-03-17T00:27:31.098 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/677 2024-03-17T00:27:31.098 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:31.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:31.138 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-03-17T00:27:31.808 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:31.825 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:31.828 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:31.831 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:31.831 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:32.679 INFO:teuthology.orchestra.run.smithi132.stdout:generic/678 [not run] kernel does not support IO_URING 2024-03-17T00:27:32.692 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/678 2024-03-17T00:27:32.693 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/678 2024-03-17T00:27:32.693 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:32.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:32.735 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-03-17T00:27:33.413 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:33.427 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:33.429 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:33.432 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:33.432 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:34.153 INFO:teuthology.orchestra.run.smithi132.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-17T00:27:34.167 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/679 2024-03-17T00:27:34.167 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/679 2024-03-17T00:27:34.167 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:34.174 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:34.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:34.226 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-03-17T00:27:34.848 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:34.862 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:34.864 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:34.866 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:34.866 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:37.305 INFO:teuthology.orchestra.run.smithi132.stdout:generic/680 2s 2024-03-17T00:27:37.329 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/680 2024-03-17T00:27:37.329 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:37.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:37.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:37.418 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-03-17T00:27:38.467 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:38.480 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:38.481 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:38.483 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:38.483 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:39.179 INFO:teuthology.orchestra.run.smithi132.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-17T00:27:39.184 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/681 2024-03-17T00:27:39.184 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/681 2024-03-17T00:27:39.184 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:39.188 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:39.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:39.238 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-03-17T00:27:39.964 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:39.977 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:39.978 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:39.980 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:39.980 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:40.749 INFO:teuthology.orchestra.run.smithi132.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-17T00:27:40.757 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/682 2024-03-17T00:27:40.757 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/682 2024-03-17T00:27:40.757 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:40.759 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:40.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:40.812 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-03-17T00:27:41.475 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:41.493 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:41.497 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:41.500 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:41.500 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:42.381 INFO:teuthology.orchestra.run.smithi132.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-17T00:27:42.393 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/683 2024-03-17T00:27:42.394 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/683 2024-03-17T00:27:42.394 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:42.406 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:42.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:42.457 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-03-17T00:27:43.126 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:43.149 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:43.151 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:43.154 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:43.154 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:52.629 INFO:teuthology.orchestra.run.smithi132.stdout:generic/684 - output mismatch (see /tmp/tmp.elA9P9Bv3mxfstests-dev/results//generic/684.out.bad) 2024-03-17T00:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout: --- tests/generic/684.out 2024-03-16 17:48:54.251713524 +0000 2024-03-17T00:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout: +++ /tmp/tmp.elA9P9Bv3mxfstests-dev/results//generic/684.out.bad 2024-03-17 00:27:52.616398518 +0000 2024-03-17T00:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout: @@ -1,7 +1,7 @@ 2024-03-17T00:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout: QA output created by 684 2024-03-17T00:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout: Test 1 - qa_user, non-exec file fpunch 2024-03-17T00:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2024-03-17T00:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout: -666 -rw-rw-rw- TEST_DIR/684/a 2024-03-17T00:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout: +2666 -rw-rwSrw- TEST_DIR/684/a 2024-03-17T00:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:52.634 INFO:teuthology.orchestra.run.smithi132.stdout: Test 2 - qa_user, group-exec file fpunch 2024-03-17T00:27:52.635 INFO:teuthology.orchestra.run.smithi132.stdout: 6676 -rwSrwsrw- TEST_DIR/684/a 2024-03-17T00:27:52.635 INFO:teuthology.orchestra.run.smithi132.stdout: @@ -9,7 +9,7 @@ 2024-03-17T00:27:52.635 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:52.635 INFO:teuthology.orchestra.run.smithi132.stdout: Test 3 - qa_user, user-exec file fpunch 2024-03-17T00:27:52.635 INFO:teuthology.orchestra.run.smithi132.stdout: 6766 -rwsrwSrw- TEST_DIR/684/a 2024-03-17T00:27:52.635 INFO:teuthology.orchestra.run.smithi132.stdout: -766 -rwxrw-rw- TEST_DIR/684/a 2024-03-17T00:27:52.635 INFO:teuthology.orchestra.run.smithi132.stdout: +2766 -rwxrwSrw- TEST_DIR/684/a 2024-03-17T00:27:52.635 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:52.635 INFO:teuthology.orchestra.run.smithi132.stdout: Test 4 - qa_user, all-exec file fpunch 2024-03-17T00:27:52.635 INFO:teuthology.orchestra.run.smithi132.stdout: 6777 -rwsrwsrwx TEST_DIR/684/a 2024-03-17T00:27:52.646 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/684 2024-03-17T00:27:52.646 INFO:teuthology.orchestra.run.smithi132.stdout:Failures: generic/684 2024-03-17T00:27:52.646 INFO:teuthology.orchestra.run.smithi132.stdout:Failed 1 of 1 tests 2024-03-17T00:27:52.656 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:52.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-17T00:27:52.732 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-17T00:27:52.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-17T00:27:52.733 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-03-17T00:27:53.704 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:53.713 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:53.715 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:53.717 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:53.717 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:54.684 INFO:teuthology.orchestra.run.smithi132.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-17T00:27:54.698 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/685 2024-03-17T00:27:54.698 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/685 2024-03-17T00:27:54.698 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:54.712 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:54.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:54.797 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-03-17T00:27:55.507 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:55.522 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:55.524 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:55.529 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:55.530 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:56.598 INFO:teuthology.orchestra.run.smithi132.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-03-17T00:27:56.605 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/686 2024-03-17T00:27:56.605 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/686 2024-03-17T00:27:56.605 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:56.614 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:56.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:56.689 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-03-17T00:27:57.348 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:57.360 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:57.365 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:57.366 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:57.366 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:58.547 INFO:teuthology.orchestra.run.smithi132.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-17T00:27:58.562 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/687 2024-03-17T00:27:58.562 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/687 2024-03-17T00:27:58.562 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:27:58.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:27:58.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:27:58.660 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-03-17T00:27:59.469 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:27:59.484 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:27:59.485 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:27:59.489 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:27:59.489 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:00.492 INFO:teuthology.orchestra.run.smithi132.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-17T00:28:00.508 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/688 2024-03-17T00:28:00.508 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/688 2024-03-17T00:28:00.508 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:00.521 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:00.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:00.596 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-03-17T00:28:01.296 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:01.315 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:01.316 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:01.316 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:01.317 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:02.154 INFO:teuthology.orchestra.run.smithi132.stdout:generic/689 [not run] vfstest not support by ceph 2024-03-17T00:28:02.163 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/689 2024-03-17T00:28:02.163 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/689 2024-03-17T00:28:02.164 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:02.173 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:02.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:02.221 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-03-17T00:28:02.960 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:02.981 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:02.982 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:02.985 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:02.985 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:03.824 INFO:teuthology.orchestra.run.smithi132.stdout:generic/690 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-17T00:28:03.836 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/690 2024-03-17T00:28:03.836 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/690 2024-03-17T00:28:03.837 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:03.846 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:03.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:03.918 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-03-17T00:28:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:04.631 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:04.631 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:04.632 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:04.632 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:05.367 INFO:teuthology.orchestra.run.smithi132.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-17T00:28:05.373 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/691 2024-03-17T00:28:05.373 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/691 2024-03-17T00:28:05.373 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:05.382 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:05.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:05.448 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-03-17T00:28:06.115 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:06.130 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:06.132 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:06.135 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:06.135 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:06.874 INFO:teuthology.orchestra.run.smithi132.stdout:generic/692 [not run] fsverity utility required, skipped this test 2024-03-17T00:28:06.902 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/692 2024-03-17T00:28:06.902 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/692 2024-03-17T00:28:06.904 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:06.906 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:06.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:06.951 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-03-17T00:28:07.627 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:07.641 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:07.642 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:07.646 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:07.646 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:08.889 INFO:teuthology.orchestra.run.smithi132.stdout:generic/693 [not run] kernel does not support ceph encryption 2024-03-17T00:28:08.918 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/693 2024-03-17T00:28:08.918 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/693 2024-03-17T00:28:08.919 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:08.922 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:08.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:08.961 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-03-17T00:28:09.634 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:09.641 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:09.642 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:09.643 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:09.643 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:22.340 INFO:teuthology.orchestra.run.smithi132.stdout:generic/694 13s 2024-03-17T00:28:22.371 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/694 2024-03-17T00:28:22.372 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:22.381 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:22.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:22.497 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-03-17T00:28:23.196 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:23.208 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:23.214 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:23.216 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:23.216 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:24.025 INFO:teuthology.orchestra.run.smithi132.stdout:generic/695 [not run] require 172.21.15.132:6789:/scratch to be valid block disk 2024-03-17T00:28:24.037 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/695 2024-03-17T00:28:24.037 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/695 2024-03-17T00:28:24.037 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:24.043 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:24.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:24.089 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-03-17T00:28:24.739 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:24.755 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:24.756 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:24.759 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:24.759 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:26.331 INFO:teuthology.orchestra.run.smithi132.stdout:generic/696 1s 2024-03-17T00:28:26.366 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/696 2024-03-17T00:28:26.366 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:26.373 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:26.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:26.442 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-03-17T00:28:27.362 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:27.378 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:27.379 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:27.381 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:27.381 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:28.592 INFO:teuthology.orchestra.run.smithi132.stdout:generic/697 1s 2024-03-17T00:28:28.606 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/697 2024-03-17T00:28:28.606 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:28.613 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:28.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:28.820 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-03-17T00:28:29.725 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:29.732 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:29.733 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:29.735 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:29.735 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:30.467 INFO:teuthology.orchestra.run.smithi132.stdout:generic/698 [not run] vfstest not support by ceph 2024-03-17T00:28:30.488 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/698 2024-03-17T00:28:30.488 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/698 2024-03-17T00:28:30.488 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:30.497 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:30.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:30.576 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-03-17T00:28:31.199 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:31.210 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:31.211 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:31.214 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:31.214 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:32.067 INFO:teuthology.orchestra.run.smithi132.stdout:generic/699 [not run] vfstest not support by ceph 2024-03-17T00:28:32.080 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/699 2024-03-17T00:28:32.081 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/699 2024-03-17T00:28:32.081 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:32.090 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:32.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:32.145 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-03-17T00:28:32.764 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:32.780 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:32.782 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:32.785 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:32.785 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:33.635 INFO:teuthology.orchestra.run.smithi132.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2024-03-17T00:28:33.647 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/700 2024-03-17T00:28:33.647 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/700 2024-03-17T00:28:33.647 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:33.656 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:33.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:33.724 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-03-17T00:28:34.351 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:34.366 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:34.370 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:34.373 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:34.373 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:47.405 INFO:teuthology.orchestra.run.smithi132.stdout:generic/701 13s 2024-03-17T00:28:47.443 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/701 2024-03-17T00:28:47.444 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:47.464 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:51.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:51.095 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-03-17T00:28:52.022 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:52.033 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:52.038 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:52.038 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:52.038 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:53.237 INFO:teuthology.orchestra.run.smithi132.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-17T00:28:53.258 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/702 2024-03-17T00:28:53.259 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/702 2024-03-17T00:28:53.260 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:53.274 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:53.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:53.582 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-03-17T00:28:54.405 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:54.422 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:54.423 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:54.426 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:54.426 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:55.413 INFO:teuthology.orchestra.run.smithi132.stdout:generic/703 [not run] kernel does not support IO_URING 2024-03-17T00:28:55.419 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/703 2024-03-17T00:28:55.420 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/703 2024-03-17T00:28:55.420 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:55.425 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:55.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:55.467 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-03-17T00:28:56.140 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:56.155 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:56.157 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:56.160 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:56.160 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:57.036 INFO:teuthology.orchestra.run.smithi132.stdout:generic/704 [not run] require 172.21.15.132:6789:/test to be valid block disk 2024-03-17T00:28:57.054 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/704 2024-03-17T00:28:57.054 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/704 2024-03-17T00:28:57.054 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:57.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:57.123 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-03-17T00:28:57.701 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:57.712 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:57.713 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:57.715 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:57.716 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:58.673 INFO:teuthology.orchestra.run.smithi132.stdout:generic/705 [not run] ceph does not support shutdown 2024-03-17T00:28:58.712 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/705 2024-03-17T00:28:58.712 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/705 2024-03-17T00:28:58.712 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:28:58.714 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:28:58.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:28:58.775 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-03-17T00:28:59.516 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:28:59.529 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:28:59.531 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:28:59.535 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:28:59.535 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:29:02.981 INFO:teuthology.orchestra.run.smithi132.stdout:generic/706 3s 2024-03-17T00:29:03.005 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/706 2024-03-17T00:29:03.005 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2024-03-17T00:29:03.016 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:29:03.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-17T00:29:03.193 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.elA9P9Bv3mxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-03-17T00:29:03.866 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph 2024-03-17T00:29:03.880 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-17T00:29:03.883 INFO:teuthology.orchestra.run.smithi132.stdout:MKFS_OPTIONS -- 172.21.15.132:6789:/scratch 2024-03-17T00:29:03.885 INFO:teuthology.orchestra.run.smithi132.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAG2/VltlzDFRAAJ0V5Ac01EvK5aqiutZuCjA== -o context=system_u:object_r:root_t:s0 172.21.15.132:6789:/scratch /tmp/tmp.ZUDwMxKonOscratch 2024-03-17T00:29:03.885 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-03-17T00:32:56.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T00:32:56.922 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T00:32:57.034 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-17T00:32:57.032+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 741592) UID: 0 2024-03-17T00:32:57.034 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-17T00:32:57.032+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 741592) UID: 0 2024-03-17T00:32:57.071 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-17T00:32:57.070+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55930) UID: 0 2024-03-17T00:32:57.071 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-17T00:32:57.070+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55930) UID: 0 2024-03-17T00:32:57.072 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-17T00:32:57.070+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55930) UID: 0 2024-03-17T00:32:57.072 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-17T00:32:57.070+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55930) UID: 0 2024-03-17T00:49:10.252 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-17T00:49:10.250+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 743808) UID: 0 2024-03-17T00:49:10.253 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-17T00:49:10.250+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 743808) UID: 0 2024-03-17T00:49:10.253 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-17T00:49:10.250+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 743808) UID: 0 2024-03-17T00:49:10.254 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-17T00:49:10.250+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 743808) UID: 0 2024-03-17T00:55:56.245 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T00:55:56.249 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T00:55:56.550 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-17T00:55:56.549+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55968) UID: 0 2024-03-17T00:55:56.550 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-17T00:55:56.549+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55968) UID: 0 2024-03-17T00:55:56.551 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-17T00:55:56.549+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55968) UID: 0 2024-03-17T00:55:56.551 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-17T00:55:56.549+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55968) UID: 0 2024-03-17T01:02:28.363 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:02:28.368 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:02:58.474 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:02:58.479 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:03:28.591 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:03:28.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:03:58.692 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:03:58.700 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:04:28.812 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:04:28.817 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:04:58.971 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:04:58.979 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:05:29.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:05:29.123 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:05:59.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:05:59.247 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:05:59.386 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-17T01:05:59.383+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 748469) UID: 0 2024-03-17T01:05:59.386 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-17T01:05:59.383+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 748469) UID: 0 2024-03-17T01:05:59.386 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-17T01:05:59.383+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 748469) UID: 0 2024-03-17T01:05:59.387 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-17T01:05:59.383+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 748469) UID: 0 2024-03-17T01:13:35.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:13:35.885 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:14:05.992 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:14:05.996 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:14:36.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:14:36.397 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:15:06.498 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:15:06.501 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:15:36.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:15:36.648 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:16:06.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:16:06.804 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:16:36.924 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:16:36.928 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:17:07.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:17:07.087 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:17:37.201 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:17:37.206 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:18:07.332 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:18:07.339 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:18:37.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:18:37.457 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:19:07.606 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:19:07.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:19:37.734 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:19:37.739 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:20:08.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:20:08.116 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:20:38.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:20:38.245 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:21:08.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:21:08.359 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:21:38.667 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:21:38.671 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:22:08.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:22:08.950 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:22:39.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:22:39.079 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:23:09.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:23:09.208 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:23:39.312 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:23:39.316 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:24:09.408 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:24:09.412 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:24:39.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:24:39.537 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:25:10.001 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:25:10.006 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:25:40.238 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:25:40.243 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:26:10.581 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:26:10.586 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:26:40.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:26:40.703 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:27:10.831 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:27:10.839 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:27:40.932 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:27:40.941 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:28:11.042 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:28:11.046 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:28:41.157 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:28:41.162 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:29:11.298 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:29:11.303 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:29:41.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:29:41.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:30:11.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:30:11.554 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:30:41.713 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:30:41.717 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:31:11.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:31:11.855 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:31:42.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:31:42.185 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:32:12.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:32:12.458 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:32:42.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:32:42.542 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:33:12.838 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:33:12.843 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:33:42.962 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:33:42.966 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:34:13.119 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:34:13.128 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:34:44.001 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:34:44.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:35:14.128 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:35:14.133 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:35:44.566 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:35:44.569 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:36:14.651 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:36:14.656 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:36:44.783 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:36:44.787 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:37:15.020 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:37:15.029 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:37:45.279 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:37:45.283 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:38:15.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:38:15.396 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:38:45.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:38:45.534 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:38:45.605 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-17T01:38:45.605+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57080) UID: 0 2024-03-17T01:38:45.606 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-17T01:38:45.605+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57080) UID: 0 2024-03-17T01:38:45.606 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-17T01:38:45.605+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57080) UID: 0 2024-03-17T01:38:45.606 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-17T01:38:45.605+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57080) UID: 0 2024-03-17T01:41:32.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:41:32.293 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:41:32.328 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-03-17T01:41:32.327+0000 7fbaf41b9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57104) UID: 0 2024-03-17T01:41:32.328 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-03-17T01:41:32.327+0000 7fdcbc10c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57104) UID: 0 2024-03-17T01:41:32.329 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-03-17T01:41:32.327+0000 7f77b3cf3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57104) UID: 0 2024-03-17T01:41:32.329 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-03-17T01:41:32.327+0000 7ff3012c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 57104) UID: 0 2024-03-17T01:44:24.062 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:44:24.067 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:44:54.156 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:44:54.161 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:45:24.297 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:45:24.302 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:45:54.655 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:45:54.661 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:46:24.817 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:46:24.821 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:46:24.945 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-17T01:46:24.944+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757847) UID: 0 2024-03-17T01:46:24.946 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-17T01:46:24.944+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757847) UID: 0 2024-03-17T01:46:24.946 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-17T01:46:24.944+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757847) UID: 0 2024-03-17T01:46:24.947 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-17T01:46:24.945+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757847) UID: 0 2024-03-17T01:51:22.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:51:22.008 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:51:22.099 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-03-17T01:51:22.098+0000 7f9fd4d91640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 758745) UID: 0 2024-03-17T01:51:22.099 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-03-17T01:51:22.098+0000 7fc9fd2d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 758745) UID: 0 2024-03-17T01:51:22.099 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-03-17T01:51:22.098+0000 7fabfe11d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 758745) UID: 0 2024-03-17T01:51:22.100 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-03-17T01:51:22.098+0000 7f94d54a1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 758745) UID: 0 2024-03-17T01:54:35.163 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:54:35.167 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:55:05.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:55:05.330 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:55:35.455 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:55:35.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:56:05.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:56:05.674 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:56:35.775 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:56:35.779 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:57:05.912 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:57:05.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:57:36.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:57:36.041 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:58:06.181 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:58:06.185 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:58:36.350 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:58:36.354 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:59:06.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:59:06.536 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:59:36.721 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T01:59:36.724 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:00:06.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:00:06.883 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:00:37.007 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:00:37.011 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:01:07.163 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:01:07.168 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:01:37.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:01:37.332 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:02:07.619 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:02:07.623 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:02:37.784 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:02:37.788 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:03:07.918 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:03:07.923 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:03:38.020 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:03:38.024 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:04:08.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:04:08.196 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:04:38.390 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:04:38.395 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:05:08.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:05:08.503 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:05:38.668 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:05:38.673 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:06:08.884 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:06:08.888 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:06:38.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:06:38.984 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:07:09.144 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:07:09.148 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:07:39.316 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:07:39.319 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:08:09.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:08:09.409 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:08:39.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:08:39.490 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:09:09.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:09:09.639 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:09:39.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:09:39.778 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:10:09.887 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:10:09.891 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:10:39.993 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:10:39.997 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:11:10.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:11:10.180 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:11:40.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:11:40.331 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:12:10.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:12:10.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:12:40.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:12:40.563 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:13:10.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:13:10.784 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:13:40.893 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:13:40.897 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:14:11.040 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:14:11.044 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:14:41.197 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:14:41.201 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:15:11.436 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:15:11.440 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:15:41.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:15:41.579 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:16:11.748 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:16:11.752 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:16:41.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:16:41.934 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:17:12.085 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:17:12.089 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:17:42.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:17:42.245 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:18:12.397 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:18:12.402 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:18:42.563 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:18:42.566 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:19:12.676 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:19:12.679 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:19:42.807 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:19:42.811 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:20:12.904 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:20:12.907 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:20:43.017 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:20:43.021 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:21:13.143 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:21:13.148 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:21:43.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:21:43.280 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:22:13.406 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:22:13.410 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:22:43.545 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:22:43.548 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:23:13.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:23:13.663 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:23:43.789 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:23:43.794 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:24:13.936 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:24:13.940 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:24:44.049 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:24:44.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:25:14.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:25:14.141 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:25:44.268 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:25:44.271 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:26:14.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:26:14.395 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:26:44.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:26:44.524 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:27:14.652 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:27:14.655 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:27:44.742 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:27:44.746 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:28:14.887 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:28:14.891 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:28:45.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:28:45.047 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:29:15.172 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:29:15.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:29:45.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:29:45.324 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:30:15.420 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:30:15.424 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:30:45.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:30:45.572 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:31:15.759 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:31:15.763 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:31:45.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:31:45.949 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:32:16.071 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:32:16.075 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:32:46.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:32:46.170 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:33:16.273 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:33:16.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:33:46.421 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:33:46.426 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:34:16.526 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:34:16.530 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:34:46.714 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:34:46.718 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:35:16.853 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:35:16.858 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:35:47.027 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:35:47.031 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:36:17.182 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:36:17.186 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:36:47.306 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:36:47.310 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:37:17.471 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:37:17.474 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:37:47.657 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:37:47.662 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:38:17.823 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:38:17.826 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:38:48.002 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:38:48.007 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:39:18.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:39:18.106 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:39:48.240 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:39:48.244 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:40:18.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:40:18.441 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:40:48.618 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:40:48.622 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:41:18.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:41:18.836 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:41:48.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:41:49.002 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:42:19.094 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:42:19.098 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:42:49.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:42:49.264 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:43:19.356 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:43:19.360 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:43:49.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:43:49.450 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:44:19.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:44:19.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:44:49.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:44:49.779 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:45:19.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:45:19.935 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:45:50.119 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:45:50.123 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:46:20.273 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:46:20.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:46:50.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:46:50.572 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:47:20.688 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:47:20.692 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:47:50.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:47:50.825 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:48:20.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:48:20.943 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:48:51.082 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:48:51.087 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:49:21.271 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:49:21.274 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:49:51.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:49:51.413 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:50:21.505 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:50:21.509 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:50:51.702 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:50:51.706 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:51:21.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:51:21.895 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:51:51.988 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:51:51.992 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:52:22.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:52:22.129 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:52:52.247 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:52:52.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:53:22.439 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:53:22.442 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:53:52.563 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:53:52.567 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:54:22.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:54:22.759 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:54:52.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:54:52.910 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:55:23.076 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:55:23.080 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:55:53.250 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:55:53.254 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:56:23.421 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:56:23.425 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:56:53.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:56:53.598 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:57:23.800 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:57:23.804 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:57:53.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:57:53.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:58:24.087 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:58:24.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:58:54.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:58:54.288 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:59:24.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:59:24.433 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:59:54.569 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T02:59:54.572 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:00:24.783 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:00:24.787 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:00:54.898 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:00:54.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:01:25.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:01:25.047 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:01:55.202 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:01:55.205 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:02:25.356 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:02:25.361 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:02:55.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:02:55.512 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:03:25.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:03:25.732 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:03:55.869 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:03:55.873 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:04:25.999 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:04:26.002 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:04:56.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:04:56.118 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:05:26.285 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:05:26.289 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:05:56.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:05:56.454 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:06:26.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:06:26.627 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:06:56.785 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:06:56.791 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:07:26.884 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:07:26.888 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:07:57.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:07:57.048 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:08:27.229 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:08:27.234 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:08:57.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:08:57.399 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:09:27.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:09:27.572 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:09:57.698 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:09:57.701 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:10:27.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:10:27.892 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:10:58.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:10:58.089 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:11:28.266 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:11:28.270 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:11:58.421 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:11:58.425 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:12:28.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:12:28.624 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:12:58.749 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:12:58.754 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:13:28.956 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:13:28.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:13:59.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:13:59.149 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:14:29.319 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:14:29.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:14:59.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:14:59.480 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:15:29.607 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:15:29.611 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:15:59.762 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:15:59.765 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:16:29.901 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:16:29.905 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:17:00.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:17:00.058 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:17:30.185 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:17:30.189 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:18:00.324 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:18:00.327 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:18:30.487 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:18:30.490 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:19:00.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:19:00.649 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:19:30.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:19:30.830 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:20:00.981 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:20:00.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:20:31.133 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:20:31.138 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:21:01.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:21:01.393 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:21:31.511 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:21:31.514 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:22:01.632 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:22:01.637 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:22:31.788 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:22:31.792 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:22:31.886 INFO:tasks.ceph.mds.c.smithi132.stderr:2024-03-17T03:22:31.894+0000 7fdc26dfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 787862) UID: 0 2024-03-17T03:22:31.886 INFO:tasks.ceph.mds.a.smithi132.stderr:2024-03-17T03:22:31.894+0000 7f7621818640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 787862) UID: 0 2024-03-17T03:25:19.612 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:25:19.616 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:25:49.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:25:49.822 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:26:20.048 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:26:20.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:26:50.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:26:50.220 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:27:20.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:27:20.321 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:27:50.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:27:50.453 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:28:20.604 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:28:20.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:28:50.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:28:50.805 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:29:20.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:29:20.979 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:29:51.090 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:29:51.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:30:21.252 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:30:21.256 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:30:51.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:30:51.371 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:31:21.541 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:31:21.545 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:31:51.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:31:51.633 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:32:21.786 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:32:21.790 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:32:51.951 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:32:51.955 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:33:22.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:33:22.085 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:33:52.212 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:33:52.216 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:34:22.359 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:34:22.362 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:34:52.523 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:34:52.527 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:35:22.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:35:22.663 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:35:52.777 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:35:52.781 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:36:22.882 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:36:22.885 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:36:52.972 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:36:52.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:37:23.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:37:23.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:37:53.200 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:37:53.204 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:38:23.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:38:23.337 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:38:53.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:38:53.476 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:39:23.611 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:39:23.615 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:39:53.784 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:39:53.788 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:40:23.981 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:40:23.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:40:54.101 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:40:54.104 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:41:24.249 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:41:24.252 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:41:54.394 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:41:54.398 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:42:24.517 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:42:24.521 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:42:54.655 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:42:54.659 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:43:24.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:43:24.770 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:43:54.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:43:54.921 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:44:25.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:44:25.058 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:44:55.249 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:44:55.253 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:45:25.408 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:45:25.412 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:45:55.555 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:45:55.558 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:46:25.685 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:46:25.688 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:46:55.807 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:46:55.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:47:25.969 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:47:25.973 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:47:56.092 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:47:56.098 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:48:26.264 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:48:26.268 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:48:56.370 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:48:56.375 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:49:26.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:49:26.516 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:49:56.652 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:49:56.657 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:50:26.790 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:50:26.794 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:50:56.897 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:50:56.900 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:51:27.076 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:51:27.080 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:51:57.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:51:57.211 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:52:27.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:52:27.399 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:52:57.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:52:57.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:53:27.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:53:27.785 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:53:57.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:53:57.893 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:54:28.042 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:54:28.046 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:54:58.206 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:54:58.210 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:55:28.332 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:55:28.337 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:55:58.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:55:58.478 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:56:28.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:56:28.633 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:56:58.758 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:56:58.762 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:57:28.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:57:28.910 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:57:59.029 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:57:59.033 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:58:29.210 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:58:29.214 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:58:59.358 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:58:59.362 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:59:29.480 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:59:29.484 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:59:59.610 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T03:59:59.615 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:00:29.758 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:00:29.761 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:00:59.922 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:00:59.925 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:01:30.057 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:01:30.061 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:02:00.209 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:02:00.213 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:02:30.354 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:02:30.358 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:03:00.494 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:03:00.498 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:03:30.674 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:03:30.678 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:04:00.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:04:00.836 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:04:30.995 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:04:30.999 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:05:01.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:05:01.180 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:05:31.350 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:05:31.354 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:06:01.523 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:06:01.527 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:06:31.677 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:06:31.681 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:07:01.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:07:01.826 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:07:31.987 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:07:31.990 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:08:02.165 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:08:02.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:08:32.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:08:32.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:09:02.609 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:09:02.614 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:09:32.742 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:09:32.746 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:10:02.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:10:02.935 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:10:33.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:10:33.049 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:11:03.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:11:03.187 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:11:33.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:11:33.335 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:12:03.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:12:03.516 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:12:33.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:12:33.673 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:13:03.841 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:13:03.845 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:13:34.021 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:13:34.026 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:14:04.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:14:04.208 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:14:34.330 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:14:34.334 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:15:04.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:15:04.503 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:15:34.648 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:15:34.651 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:16:04.796 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:16:04.800 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:16:34.927 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:16:34.931 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:17:05.048 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:17:05.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:17:35.371 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:17:35.375 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:18:05.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:18:05.489 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:18:35.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:18:35.644 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:19:05.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:19:05.825 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:19:36.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:19:36.006 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:20:06.167 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:20:06.171 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:20:36.350 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:20:36.355 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:21:06.547 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:21:06.551 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:21:36.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:21:36.702 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:22:06.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:22:06.856 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:22:37.016 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:22:37.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:23:07.172 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:23:07.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:23:37.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:23:37.347 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:24:07.483 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:24:07.487 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:24:37.656 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:24:37.663 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:25:07.849 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:25:07.853 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:25:38.007 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:25:38.012 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:26:08.146 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:26:08.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:26:38.237 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:26:38.241 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:27:08.410 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:27:08.415 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:27:38.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:27:38.572 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:28:08.706 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:28:08.710 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:28:38.856 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:28:38.859 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:29:08.995 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:29:08.999 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:29:39.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:29:39.170 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:30:09.280 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:30:09.283 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:30:39.453 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:30:39.457 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:31:09.607 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:31:09.612 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:31:39.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:31:39.988 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:32:10.088 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:32:10.092 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:32:40.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:32:40.211 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:33:10.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:33:10.346 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:33:40.485 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:33:40.489 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:34:10.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:34:10.674 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:34:41.047 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:34:41.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:35:11.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:35:11.196 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:35:41.348 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:35:41.352 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:36:11.487 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:36:11.493 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:36:41.666 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:36:41.670 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:37:11.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:37:11.785 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:37:41.935 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:37:41.939 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:38:12.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:38:12.087 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:38:42.265 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:38:42.269 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:39:12.385 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:39:12.390 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:39:42.524 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:39:42.528 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:40:12.671 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:40:12.677 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:40:42.794 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:40:42.831 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:41:13.002 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:41:13.006 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:41:43.101 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:41:43.105 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:42:13.298 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:42:13.302 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:42:43.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:42:43.434 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:43:13.603 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:43:13.607 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:43:43.760 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:43:43.764 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:44:13.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:44:13.933 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:44:44.070 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:44:44.074 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:45:14.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:45:14.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:45:44.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:45:44.396 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:46:14.488 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:46:14.493 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:46:44.612 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:46:44.616 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:47:14.783 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:47:14.786 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:47:44.948 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:47:44.952 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:48:15.104 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:48:15.107 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:48:45.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:48:45.304 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:49:15.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:49:15.511 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:49:45.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:49:45.700 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:50:15.895 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:50:15.899 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:50:46.024 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:50:46.029 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:51:16.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:51:16.142 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:51:46.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:51:46.258 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:52:16.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:52:16.392 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:52:46.490 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:52:46.494 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:53:16.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:53:16.620 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:53:46.765 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:53:46.769 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:54:16.886 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:54:16.911 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:54:47.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:54:47.038 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:55:17.172 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:55:17.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:55:47.319 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:55:47.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:56:17.542 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:56:17.546 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:56:47.647 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:56:47.651 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:57:17.829 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:57:17.834 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:57:47.982 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:57:47.986 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:58:18.103 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:58:18.107 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:58:48.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:58:48.305 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:59:18.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:59:18.460 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:59:48.611 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T04:59:48.615 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:00:18.807 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:00:18.811 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:00:48.996 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:00:49.000 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:01:19.153 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:01:19.157 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:01:49.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:01:49.347 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:02:19.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:02:19.643 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:02:49.770 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:02:49.774 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:03:19.925 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:03:19.929 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:03:50.023 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:03:50.027 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:04:20.162 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:04:20.167 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:04:50.307 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:04:50.311 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:05:20.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:05:20.441 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:05:50.560 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:05:50.564 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:06:20.691 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:06:20.695 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:06:50.838 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:06:50.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:07:20.985 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:07:20.989 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:07:51.132 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:07:51.136 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:08:21.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:08:21.291 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:08:51.465 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:08:51.469 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:09:21.604 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:09:21.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:09:51.775 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:09:51.779 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:10:21.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:10:21.894 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:10:52.080 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:10:52.084 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:11:22.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:11:22.247 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:11:52.416 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:11:52.420 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:12:22.597 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:12:22.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:12:52.744 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:12:52.748 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:13:22.898 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:13:22.908 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:13:53.089 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:13:53.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:14:23.200 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:14:23.204 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:14:53.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:14:53.326 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:15:23.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:15:23.482 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:15:53.633 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:15:53.638 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:16:23.743 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:16:23.747 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:16:53.849 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:16:53.853 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:17:24.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:17:24.059 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:17:54.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:17:54.221 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:18:24.400 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:18:24.403 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:18:54.522 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:18:54.526 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:19:24.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:19:24.631 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:19:54.758 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:19:54.762 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:20:24.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:20:24.859 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:20:54.986 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:20:54.990 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:21:25.105 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:21:25.109 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:21:55.247 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:21:55.251 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:22:25.377 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:22:25.381 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:22:55.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:22:55.520 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:23:25.671 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:23:25.675 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:23:55.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:23:55.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:24:25.921 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:24:25.925 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:24:56.062 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:24:56.067 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:25:26.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:25:26.388 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:25:56.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:25:56.533 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:26:26.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:26:26.673 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:26:56.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:26:56.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:27:26.903 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:27:26.907 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:27:57.093 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:27:57.097 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:28:27.281 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:28:27.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:28:57.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:28:57.436 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:29:27.619 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:29:27.623 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:29:57.791 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:29:57.795 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:30:27.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:30:27.934 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:30:58.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:30:58.089 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:31:28.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:31:28.237 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:31:58.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:31:58.365 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:32:28.493 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:32:28.497 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:32:58.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:32:58.604 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:33:28.745 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:33:28.748 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:33:58.846 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:33:58.850 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:34:28.955 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:34:28.959 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:34:59.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:34:59.091 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:35:29.208 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:35:29.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:35:59.330 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:35:59.334 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:36:29.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:36:29.472 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:36:59.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:36:59.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:37:29.695 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:37:29.699 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-17T05:37:53.151 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-03-17T05:37:53.152 DEBUG:teuthology.task.console_log:Killing console logger for smithi132 2024-03-17T05:37:53.152 DEBUG:teuthology.task.console_log:Killing console logger for smithi194 2024-03-17T05:37:53.152 DEBUG:teuthology.exit:Finished running handlers